Jul 27 19:24:16.884302 ip-10-0-142-24 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 27 19:24:16.884314 ip-10-0-142-24 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 27 19:24:16.884323 ip-10-0-142-24 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 27 19:24:16.884619 ip-10-0-142-24 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 27 19:24:28.141907 ip-10-0-142-24 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 27 19:24:28.141925 ip-10-0-142-24 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e0d1d665b4ea4ae28cc87ad276ca208c --
Jul 27 19:26:22.767363 ip-10-0-142-24 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 19:26:23.131000 ip-10-0-142-24 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:26:23.131000 ip-10-0-142-24 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 19:26:23.131000 ip-10-0-142-24 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:26:23.131000 ip-10-0-142-24 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 19:26:23.131000 ip-10-0-142-24 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:26:23.133595 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.133508    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 19:26:23.139845 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139819    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:26:23.139845 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139842    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:26:23.139845 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139846    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:26:23.139845 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139849    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:26:23.139845 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139852    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139856    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139859    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139863    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139866    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139869    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139871    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139874    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139876    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139879    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139881    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139884    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139886    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139889    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139891    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139894    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139896    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139899    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139901    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:26:23.140075 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139904    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139906    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139909    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139911    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139914    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139916    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139919    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139921    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139927    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139929    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139931    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139934    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139936    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139939    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139941    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139945    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139947    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139950    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139952    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139955    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:26:23.140540 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139957    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139959    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139962    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139964    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139967    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139970    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139973    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139976    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139978    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139981    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139983    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139986    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139988    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139991    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139993    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139995    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.139997    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140000    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140002    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140005    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:26:23.141029 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140007    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140010    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140012    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140015    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140018    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140022    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140026    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140029    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140032    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140035    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140037    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140040    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140043    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140045    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140048    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140050    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140071    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140077    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140081    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:26:23.141519 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140084    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140087    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140090    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140093    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140096    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140099    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140103    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140106    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140108    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140111    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140113    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140117    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140119    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140122    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140124    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140126    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140130    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140825    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140831    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:26:23.141974 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140834    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140837    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140839    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140842    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140845    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140848    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140851    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140854    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140856    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140859    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140861    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140864    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140866    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140868    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140871    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140874    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140877    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140879    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140881    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:26:23.142456 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140884    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140886    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140889    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140891    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140894    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140896    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140898    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140901    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140903    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140906    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140909    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140911    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140914    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140916    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140919    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140922    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140924    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140926    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140929    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140931    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:26:23.142915 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140934    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140936    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140939    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140941    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140943    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140946    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140948    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140950    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140953    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140956    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140959    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140963    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140966    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140969    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140972    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140974    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140977    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140979    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140982    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140984    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:26:23.143411 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140986    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140989    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140992    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140996    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.140999    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141002    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141006    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141009    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141012    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141014    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141017    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141019    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141023    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141026    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141028    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141031    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141033    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141036    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141039    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141042    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:26:23.143998 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141044    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141047    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141050    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141068    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141071    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141073    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141076    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141078    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141081    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141083    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141086    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141088    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141091    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141093    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141096    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141098    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141101    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141104    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141534    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:26:23.144512 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141540    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141545    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141549    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141552    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141555    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141558    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141561    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141564    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141566    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141569    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141571    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141574    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141577    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141579    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141581    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141585    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141588    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141591    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141593    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141596    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:26:23.144976 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141599    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141602    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141604    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141607    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141609    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141612    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141614    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141617    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141619    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141622    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141625    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141627    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141630    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141632    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141634    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141637    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141639    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141641    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141644    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141646    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:26:23.145509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141649    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141651    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141654    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141658    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141660    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141663    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141665    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141668    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141671    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141673    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141676    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141678    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141680    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141683    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141685    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141687    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141690    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141693    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141695    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:26:23.145988 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141697    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141700    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141702    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141705    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141707    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141709    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141712    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141714    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141716    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141719    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141722    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141724    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141727    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141729    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141731    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141734    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141736    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141739    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141741    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141743    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:26:23.146462 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141746    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141748    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141751    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141753    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141756    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141760    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141763    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141766    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141769    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141771    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141774    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141777    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141779    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141782    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141784    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141786    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141789    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141791    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.141795    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141862    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 19:26:23.146959 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141871    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141878    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141882    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141886    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141889    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141893    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141909    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141913    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141917    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141920    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141923    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141926    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141929    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141932    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141935    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141939    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141943    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141947    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141950    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141953    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141956    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141959    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141962    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 19:26:23.147470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141966    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141969    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141972    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141975    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141978    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141981    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141984    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141987    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141991    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141996    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.141998    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142001    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142004    2578 flags.go:64] FLAG: --enable-server="true"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142007    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142011    2578 flags.go:64] FLAG: --event-burst="100"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142014    2578 flags.go:64] FLAG: --event-qps="50"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142017    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142020    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142023    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142027    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142030    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142037    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142039    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142042    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142045    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 19:26:23.148069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142049    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142066    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142069    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142071    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142074    2578 flags.go:64] FLAG: --feature-gates=""
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142078    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142080    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142083    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142086    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142089    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142092    2578 flags.go:64] FLAG: --help="false"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142094    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142098    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142100    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142103    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142106    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142110    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142113    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142116    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142118    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142121    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142124    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142127    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142130    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 27 19:26:23.148718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142132    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142135    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142138    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142141    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142143    2578 flags.go:64] FLAG: --lock-file=""
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142146    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142149    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142151    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142157    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142160    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142163    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142166    2578 flags.go:64] FLAG: --logging-format="text"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142169    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142172    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142174    2578 flags.go:64] FLAG: --manifest-url=""
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142177    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142181    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142184    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142188    2578 flags.go:64] FLAG: --max-pods="110"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142191    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142194    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142197    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142199    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142202    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142206    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 19:26:23.149345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142208    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142218    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142221    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142224    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142227    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142230    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142235    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142238    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142241    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142243    2578 flags.go:64] FLAG: --port="10250"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142246    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142249    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0918033e1acd57dfd"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142252    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142255    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142257    2578 flags.go:64] FLAG: --register-node="true"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142260    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142263    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142267    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142269    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142272    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142275    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142278    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142281    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142283    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142286    2578 flags.go:64] FLAG: --runonce="false"
Jul 27 19:26:23.149945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142288    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142291    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142294    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142297    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142300    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142302    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142306    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142309    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142312    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142314    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142317    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142320    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142322    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142325    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142328    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142333    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142335    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142346    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142350    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142353    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142355    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142358    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142361    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142363    2578 flags.go:64] FLAG: --v="2"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142367    2578 flags.go:64] FLAG: --version="false"
Jul 27 19:26:23.150572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142372    2578 flags.go:64] FLAG: --vmodule=""
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142375    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.142379    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142492    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142496    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142498    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142501    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142504    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142507    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142510    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142514    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142517    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142520    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142523    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142526    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142529    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142531    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142534    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142538    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:26:23.151202 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142540    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142543    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142545    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142548    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142550    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142553    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142555    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142558    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142560    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142563    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142565    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142568    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142570    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142572    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142575    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142578    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142580    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142582    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142585    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142587    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:26:23.151695 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142591    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142594    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142596    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142599    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142602    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142606    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142610    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142613    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142616    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142618    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142622    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142625    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142628    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142631    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142634    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142636    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142639    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142641    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142644    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:26:23.152314 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142646    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142649    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142651    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142654    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142656    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142658    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142661    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142663    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142666    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142669    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142671    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142673    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142676    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142678    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142680    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142683    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142685    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142687    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142690    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142693    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:26:23.152779 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142696    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142698    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142701    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142703    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142707    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142710    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142712    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142714    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142717    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142719    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142722    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142724    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142726    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142729    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142731    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142734    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142736    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142739    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142741    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142743    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:26:23.153289 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142746    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:26:23.153767 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142749    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:26:23.153767 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142751    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:26:23.153767 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.142754    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:26:23.153767 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.143413    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:26:23.153767 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.150497    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 19:26:23.153767 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.150514    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 19:26:23.153767 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.150533    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 19:26:23.153767 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.150538    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 19:26:23.153767 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150598    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:26:23.153767 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150602    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:26:23.153767 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150606    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:26:23.153767 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150609    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:26:23.153767 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150612    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:26:23.153767 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150615    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:26:23.153767 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150618    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150621    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150624    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150626    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150629    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150631    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150634    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150636    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150639    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150641    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150644    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150646    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150649    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150652    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150654    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150656    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150659    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150661    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150664    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150666    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:26:23.154214 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150669    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150671    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150674    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150677    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150680    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150684    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150688    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150691    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150693    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150696    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150700    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150703    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150705    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150708    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150710    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150713    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150716    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150718    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150720    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:26:23.154719 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150723    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150725    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150728    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150730    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150733    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150735    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150737    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150740    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150742    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150744    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150747    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150750    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150753    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150755    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150758    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150760    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150764    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150767    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150769    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150772    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:26:23.155211 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150774    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150777    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150779    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150781    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150784    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150786    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150788    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150791    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150793    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150795    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150798    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150800    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150803    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150806    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150808    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150811    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150822    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150825    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150827    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:26:23.155741 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150830    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:26:23.156228 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150834    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:26:23.156228 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150838    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:26:23.156228 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150840    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:26:23.156228 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150843    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:26:23.156228 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150846    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:26:23.156228 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150848    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:26:23.156228 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150851    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:26:23.156228 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150853    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:26:23.156228 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150857    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:26:23.156228 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150860    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:26:23.156228 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150863    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:26:23.156228 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150865    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:26:23.156228 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150868    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:26:23.156228 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.150870    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:26:23.156554 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.150875    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:26:23.156554 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151005    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:26:23.156554 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151010    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:26:23.156554 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151013    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:26:23.156554 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151016    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:26:23.156554 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151019    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:26:23.156554 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151022    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:26:23.156554 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151025    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:26:23.156554 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151028    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:26:23.156554 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151031    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:26:23.156554 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151033    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:26:23.156554 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151036    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:26:23.156554 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151038    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:26:23.156554 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151041    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:26:23.156554 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151043    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151045    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151048    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151067    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151072    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151076    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151080    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151083    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151087    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151090    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151094    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151098    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151103    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151106    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151109    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151113    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151115    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151118    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151121    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151123    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:26:23.156918 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151126    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151128    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151131    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151133    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151136    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151138    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151140    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151143    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151145    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151148    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151150    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151153    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151155    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151158    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151161    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151165    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151167    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151170    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151173    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:26:23.157501 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151175    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151178    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151181    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151183    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151186    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151188    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151191    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151194    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151197    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151200    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151202    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151205    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151208    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151210    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151212    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151215    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151217    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151220    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151222    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151225    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:26:23.157967 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151227    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151230    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151232    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151234    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151237    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151239    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151241    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151244    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151246    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151248    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151251    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151254    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151257    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151260    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151263    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151266    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151269    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151272    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151276    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:26:23.158455 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151278    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:26:23.158905 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151280    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:26:23.158905 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151283    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:26:23.158905 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151286    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:26:23.158905 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151288    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:26:23.158905 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151291    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:26:23.158905 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151293    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:26:23.158905 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:23.151295    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:26:23.158905 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.151300    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:26:23.158905 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.151429    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 19:26:23.158905 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.153711    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 19:26:23.158905 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.155088    2578 server.go:1019] "Starting client certificate rotation"
Jul 27 19:26:23.158905 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.155195    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 19:26:23.158905 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.155226    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 19:26:23.159239 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.157368    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 19:26:23.164600 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.164578    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 19:26:23.175835 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.175815    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 27 19:26:23.179390 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.179369    2578 log.go:25] "Validated CRI v1 image API"
Jul 27 19:26:23.180183 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.180165    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 19:26:23.182480 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.182461    2578 fs.go:135] Filesystem UUIDs: map[2cdf2c6c-c5ae-4455-8f00-acd348d3f8d2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b384307e-1b54-4e3f-9b16-4ab85ea27012:/dev/nvme0n1p4]
Jul 27 19:26:23.182540 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.182481    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 19:26:23.188358 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.188247    2578 manager.go:216] Machine: {Timestamp:2026-07-27 19:26:23.186917226 +0000 UTC m=+0.315281013 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3129451 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2864bf322cbbd024a8597d2e130f21 SystemUUID:ec2864bf-322c-bbd0-24a8-597d2e130f21 BootID:e0d1d665-b4ea-4ae2-8cc8-7ad276ca208c Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a0:b9:d2:24:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a0:b9:d2:24:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:55:d0:fb:93:dc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 19:26:23.188358 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.188353    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 19:26:23.188471 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.188401    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 19:26:23.188471 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.188431    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 19:26:23.191218 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.191190    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 19:26:23.191370 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.191220    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-24.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 19:26:23.191947 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.191937    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 19:26:23.191980 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.191951    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 19:26:23.191980 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.191958    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 19:26:23.192514 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.192504    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 19:26:23.194396 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.194386    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 19:26:23.198431 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.198420    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 19:26:23.198559 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.198550    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 19:26:23.198589 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.198579    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 19:26:23.198616 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.198590    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 19:26:23.198616 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.198603    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 19:26:23.198616 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.198612    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 27 19:26:23.198713 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.198622    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 19:26:23.199049 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.199034    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 19:26:23.199049 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.199067    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 19:26:23.201079 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.201044    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 19:26:23.203183 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.203169    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 19:26:23.203230 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.203201    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 19:26:23.204591 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.204579    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 19:26:23.204642 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.204595    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 19:26:23.204642 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.204601    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 19:26:23.204642 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.204607    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 19:26:23.204642 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.204615    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 19:26:23.204642 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.204620    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 19:26:23.204642 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.204627    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 19:26:23.204642 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.204644    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 19:26:23.204821 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.204651    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 19:26:23.204821 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.204656    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 19:26:23.204821 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.204670    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 19:26:23.204821 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.204675    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 19:26:23.206215 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.206137    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 19:26:23.206215 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.206212    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 19:26:23.210111 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.210089    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:23.210553 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.210524    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 19:26:23.210553 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.210530    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 19:26:23.210708 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.210556    2578 server.go:1268] "Started kubelet"
Jul 27 19:26:23.210708 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.210649    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 19:26:23.210708 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.210591    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 19:26:23.210830 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.210743    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 19:26:23.211706 ip-10-0-142-24 systemd[1]: Started Kubernetes Kubelet.
Jul 27 19:26:23.212346 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.212233    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 19:26:23.215040 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.215023    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 19:26:23.216158 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.216128    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 19:26:23.218743 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.217924    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19a941eb5c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.210498908 +0000 UTC m=+0.338862696,LastTimestamp:2026-07-27 19:26:23.210498908 +0000 UTC m=+0.338862696,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.221740 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.221723    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 19:26:23.221740 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.221738    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 19:26:23.221857 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.221792    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:26:23.222199 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.222179    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 19:26:23.222199 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.222201    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 19:26:23.222335 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.222185    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 19:26:23.222335 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.222316    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 19:26:23.222335 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.222325    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 19:26:23.222796 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.222765    2578 factory.go:153] Registering CRI-O factory
Jul 27 19:26:23.222796 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.222785    2578 factory.go:223] Registration of the crio container factory successfully
Jul 27 19:26:23.222913 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.222839    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 19:26:23.222913 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.222849    2578 factory.go:55] Registering systemd factory
Jul 27 19:26:23.222913 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.222858    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 27 19:26:23.222913 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.222880    2578 factory.go:103] Registering Raw factory
Jul 27 19:26:23.222913 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.222895    2578 manager.go:1196] Started watching for new ooms in manager
Jul 27 19:26:23.223317 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.223304    2578 manager.go:349] Starting recovery of all containers
Jul 27 19:26:23.231875 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.231744    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 19:26:23.231875 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.231756    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 19:26:23.232190 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.232174    2578 manager.go:354] Recovery completed
Jul 27 19:26:23.237470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.237456    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:23.239805 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.239788    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:23.239865 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.239822    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:23.240253 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.240141    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:23.240873 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.240833    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 19:26:23.240873 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.240852    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 19:26:23.240873 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.240871    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 19:26:23.241161 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.241144    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:23.242121 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.242100    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:23.242205 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.242136    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:23.242205 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.242156    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:23.243581 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.243567    2578 policy_none.go:49] "None policy: Start"
Jul 27 19:26:23.243663 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.243586    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 19:26:23.243663 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.243600    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 19:26:23.245652 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.245638    2578 policy_none.go:47] "Start"
Jul 27 19:26:23.250360 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.250281    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab0117a8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.23980484 +0000 UTC m=+0.368168630,LastTimestamp:2026-07-27 19:26:23.23980484 +0000 UTC m=+0.368168630,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.258366 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.258289    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab017a46  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.239830086 +0000 UTC m=+0.368193876,LastTimestamp:2026-07-27 19:26:23.239830086 +0000 UTC m=+0.368193876,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.268270 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.268201    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab06811e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.240159518 +0000 UTC m=+0.368523316,LastTimestamp:2026-07-27 19:26:23.240159518 +0000 UTC m=+0.368523316,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.277371 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.277310    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab0117a8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab0117a8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.23980484 +0000 UTC m=+0.368168630,LastTimestamp:2026-07-27 19:26:23.242121994 +0000 UTC m=+0.370485782,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.286290 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.286229    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab017a46\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab017a46  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.239830086 +0000 UTC m=+0.368193876,LastTimestamp:2026-07-27 19:26:23.242143716 +0000 UTC m=+0.370507508,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.294490 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.294475    2578 manager.go:337] "Starting Device Plugin manager"
Jul 27 19:26:23.294574 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.294513    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 19:26:23.294574 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.294527    2578 server.go:87] "Starting device plugin registration server"
Jul 27 19:26:23.294808 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.294786    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 19:26:23.294868 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.294804    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 19:26:23.294928 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.294895    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 19:26:23.294990 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.294903    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab06811e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab06811e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.240159518 +0000 UTC m=+0.368523316,LastTimestamp:2026-07-27 19:26:23.24216101 +0000 UTC m=+0.370524797,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.294990 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.294977    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 19:26:23.295151 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.294997    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 19:26:23.295568 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.295548    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 19:26:23.295644 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.295607    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:26:23.314702 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.314632    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19aedb2e9d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.304429213 +0000 UTC m=+0.432792988,LastTimestamp:2026-07-27 19:26:23.304429213 +0000 UTC m=+0.432792988,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.375293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.375242    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 19:26:23.377374 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.376605    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 19:26:23.377374 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.376641    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 19:26:23.377374 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.376663    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 19:26:23.377374 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.376696    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 19:26:23.386576 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.386522    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 27 19:26:23.395586 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.395571    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:23.396373 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.396353    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:23.396464 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.396393    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:23.396464 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.396408    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:23.396464 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.396437    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.404668 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.404599    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab0117a8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab0117a8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.23980484 +0000 UTC m=+0.368168630,LastTimestamp:2026-07-27 19:26:23.3963745 +0000 UTC m=+0.524738295,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.412890 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.412865    2578 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.412890 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.412832    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab017a46\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab017a46  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.239830086 +0000 UTC m=+0.368193876,LastTimestamp:2026-07-27 19:26:23.396400737 +0000 UTC m=+0.524764532,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.422315 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.422248    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab06811e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab06811e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.240159518 +0000 UTC m=+0.368523316,LastTimestamp:2026-07-27 19:26:23.396413576 +0000 UTC m=+0.524777367,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.442451 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.442420    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms"
Jul 27 19:26:23.477687 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.477616    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-24.ec2.internal"]
Jul 27 19:26:23.477798 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.477736    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:23.479229 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.479211    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:23.479328 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.479248    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:23.479328 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.479262    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:23.481583 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.481566    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:23.481696 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.481679    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.481761 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.481714    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:23.482298 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.482280    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:23.482397 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.482308    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:23.482397 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.482318    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:23.482397 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.482281    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:23.482397 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.482382    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:23.482397 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.482391    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:23.484593 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.484578    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.484652 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.484611    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:23.485330 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.485309    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:23.485423 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.485344    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:23.485423 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.485358    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:23.490783 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.490717    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab0117a8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab0117a8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.23980484 +0000 UTC m=+0.368168630,LastTimestamp:2026-07-27 19:26:23.479230291 +0000 UTC m=+0.607594085,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.500014 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.499943    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab017a46\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab017a46  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.239830086 +0000 UTC m=+0.368193876,LastTimestamp:2026-07-27 19:26:23.479254467 +0000 UTC m=+0.607618257,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.508517 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.508420    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab06811e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab06811e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.240159518 +0000 UTC m=+0.368523316,LastTimestamp:2026-07-27 19:26:23.47926733 +0000 UTC m=+0.607631121,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.510138 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.510122    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.514695 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.514679    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.518540 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.518474    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab0117a8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab0117a8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.23980484 +0000 UTC m=+0.368168630,LastTimestamp:2026-07-27 19:26:23.482299714 +0000 UTC m=+0.610663500,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.524138 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.524116    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6746e0202d8b715f80728def55766a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal\" (UID: \"d6746e0202d8b715f80728def55766a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.524221 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.524146    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/162f7fc2d5317b26ca4e84b4b15f251a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-24.ec2.internal\" (UID: \"162f7fc2d5317b26ca4e84b4b15f251a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.524221 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.524174    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6746e0202d8b715f80728def55766a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal\" (UID: \"d6746e0202d8b715f80728def55766a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.528266 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.528195    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab017a46\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab017a46  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.239830086 +0000 UTC m=+0.368193876,LastTimestamp:2026-07-27 19:26:23.482313126 +0000 UTC m=+0.610676912,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.539449 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.539373    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab06811e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab06811e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.240159518 +0000 UTC m=+0.368523316,LastTimestamp:2026-07-27 19:26:23.482323531 +0000 UTC m=+0.610687317,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.548563 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.548484    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab0117a8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab0117a8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.23980484 +0000 UTC m=+0.368168630,LastTimestamp:2026-07-27 19:26:23.482372336 +0000 UTC m=+0.610736124,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.555910 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.555849    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab017a46\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab017a46  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.239830086 +0000 UTC m=+0.368193876,LastTimestamp:2026-07-27 19:26:23.482386182 +0000 UTC m=+0.610749969,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.564106 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.564032    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab06811e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab06811e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.240159518 +0000 UTC m=+0.368523316,LastTimestamp:2026-07-27 19:26:23.482395504 +0000 UTC m=+0.610759290,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.573327 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.573244    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab0117a8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab0117a8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.23980484 +0000 UTC m=+0.368168630,LastTimestamp:2026-07-27 19:26:23.485328092 +0000 UTC m=+0.613691883,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.582314 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.582247    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab017a46\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab017a46  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.239830086 +0000 UTC m=+0.368193876,LastTimestamp:2026-07-27 19:26:23.485350752 +0000 UTC m=+0.613714539,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.591045 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.590973    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab06811e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab06811e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.240159518 +0000 UTC m=+0.368523316,LastTimestamp:2026-07-27 19:26:23.485362345 +0000 UTC m=+0.613726132,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.613126 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.613095    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:23.614113 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.614095    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:23.614187 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.614128    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:23.614187 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.614138    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:23.614187 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.614171    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.623309 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.623239    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab0117a8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab0117a8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.23980484 +0000 UTC m=+0.368168630,LastTimestamp:2026-07-27 19:26:23.614113225 +0000 UTC m=+0.742477012,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.624926 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.624908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6746e0202d8b715f80728def55766a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal\" (UID: \"d6746e0202d8b715f80728def55766a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.624980 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.624936    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6746e0202d8b715f80728def55766a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal\" (UID: \"d6746e0202d8b715f80728def55766a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.624980 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.624954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/162f7fc2d5317b26ca4e84b4b15f251a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-24.ec2.internal\" (UID: \"162f7fc2d5317b26ca4e84b4b15f251a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.625050 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.624999    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/162f7fc2d5317b26ca4e84b4b15f251a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-24.ec2.internal\" (UID: \"162f7fc2d5317b26ca4e84b4b15f251a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.625050 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.625007    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6746e0202d8b715f80728def55766a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal\" (UID: \"d6746e0202d8b715f80728def55766a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.625050 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.625022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6746e0202d8b715f80728def55766a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal\" (UID: \"d6746e0202d8b715f80728def55766a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.631679 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.631654    2578 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.631745 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.631651    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-24.ec2.internal.18c63c19ab017a46\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-24.ec2.internal.18c63c19ab017a46  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-24.ec2.internal,UID:ip-10-0-142-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-24.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:23.239830086 +0000 UTC m=+0.368193876,LastTimestamp:2026-07-27 19:26:23.61413273 +0000 UTC m=+0.742496518,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:23.813458 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.813418    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.818678 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:23.818539    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-24.ec2.internal"
Jul 27 19:26:23.850992 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:23.850954    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="800ms"
Jul 27 19:26:24.031869 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.031835    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:24.032818 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.032801    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:24.032928 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.032832    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:24.032928 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.032841    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:24.032928 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.032866    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:24.052650 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:24.052615    2578 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:24.221707 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.221680    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:24.363176 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:24.363132    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6746e0202d8b715f80728def55766a0.slice/crio-5f0a0bccf59d1d59efc8f35aba179726f55711a768106f0049a3df7084828d17 WatchSource:0}: Error finding container 5f0a0bccf59d1d59efc8f35aba179726f55711a768106f0049a3df7084828d17: Status 404 returned error can't find the container with id 5f0a0bccf59d1d59efc8f35aba179726f55711a768106f0049a3df7084828d17
Jul 27 19:26:24.368611 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.368592    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:26:24.372720 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.372703    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:24.373864 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.373845    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:24.373933 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.373883    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:24.373933 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.373898    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:24.374939 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:26:24.374916    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod162f7fc2d5317b26ca4e84b4b15f251a.slice/crio-f0a2acc49a8b17466a57f55684e01468a8aaf52a6c149fb80ab3dc1ac687f783 WatchSource:0}: Error finding container f0a2acc49a8b17466a57f55684e01468a8aaf52a6c149fb80ab3dc1ac687f783: Status 404 returned error can't find the container with id f0a2acc49a8b17466a57f55684e01468a8aaf52a6c149fb80ab3dc1ac687f783
Jul 27 19:26:24.380805 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.380758    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-24.ec2.internal" event={"ID":"162f7fc2d5317b26ca4e84b4b15f251a","Type":"ContainerStarted","Data":"f0a2acc49a8b17466a57f55684e01468a8aaf52a6c149fb80ab3dc1ac687f783"}
Jul 27 19:26:24.381553 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:24.381455    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal.18c63c19ee4cdbd6  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal,UID:d6746e0202d8b715f80728def55766a0,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\",Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:24.368843734 +0000 UTC m=+1.497207529,LastTimestamp:2026-07-27 19:26:24.368843734 +0000 UTC m=+1.497207529,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:24.381936 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.381915    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" event={"ID":"d6746e0202d8b715f80728def55766a0","Type":"ContainerStarted","Data":"5f0a0bccf59d1d59efc8f35aba179726f55711a768106f0049a3df7084828d17"}
Jul 27 19:26:24.390944 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:24.390846    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-142-24.ec2.internal.18c63c19eec4f1ba  kube-system    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-142-24.ec2.internal,UID:162f7fc2d5317b26ca4e84b4b15f251a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\",Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:24.376713658 +0000 UTC m=+1.505077438,LastTimestamp:2026-07-27 19:26:24.376713658 +0000 UTC m=+1.505077438,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:24.413282 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:24.413254    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 27 19:26:24.551322 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:24.551286    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 19:26:24.610031 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:24.610000    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 19:26:24.661170 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:24.661095    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="1.6s"
Jul 27 19:26:24.699829 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:24.699791    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 19:26:24.853501 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.853455    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:24.855045 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.854623    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:24.855045 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.854667    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:24.855045 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.854679    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:24.855045 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:24.854712    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:24.872766 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:24.872726    2578 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:25.219456 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:25.219423    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:26.223469 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:26.223385    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:26.270828 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:26.270780    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="3.2s"
Jul 27 19:26:26.379766 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:26.379683    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-142-24.ec2.internal.18c63c1a659112da  kube-system    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-142-24.ec2.internal,UID:162f7fc2d5317b26ca4e84b4b15f251a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\" in 1.993s (1.993s including waiting). Image size: 317186379 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:26.36980297 +0000 UTC m=+3.498166750,LastTimestamp:2026-07-27 19:26:26.36980297 +0000 UTC m=+3.498166750,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:26.388545 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:26.388436    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal.18c63c1a65a4b625  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal,UID:d6746e0202d8b715f80728def55766a0,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\" in 2.002s (2.002s including waiting). Image size: 278280461 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:26.371089957 +0000 UTC m=+3.499453950,LastTimestamp:2026-07-27 19:26:26.371089957 +0000 UTC m=+3.499453950,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:26.447355 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:26.447138    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-142-24.ec2.internal.18c63c1a699bd1ee  kube-system    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-142-24.ec2.internal,UID:162f7fc2d5317b26ca4e84b4b15f251a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Created,Message:Created container: haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:26.43761611 +0000 UTC m=+3.565979910,LastTimestamp:2026-07-27 19:26:26.43761611 +0000 UTC m=+3.565979910,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:26.457695 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:26.457616    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-142-24.ec2.internal.18c63c1a6a1c4cf6  kube-system    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-142-24.ec2.internal,UID:162f7fc2d5317b26ca4e84b4b15f251a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Started,Message:Started container haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:26.446036214 +0000 UTC m=+3.574399993,LastTimestamp:2026-07-27 19:26:26.446036214 +0000 UTC m=+3.574399993,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:26.473841 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:26.473767    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:26.474976 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:26.474949    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:26.475102 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:26.474997    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:26.475102 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:26.475012    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:26.475102 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:26.475042    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:26.496197 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:26.496165    2578 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:26.590189 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:26.590075    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal.18c63c1a7224bdb9  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal,UID:d6746e0202d8b715f80728def55766a0,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:26.580807097 +0000 UTC m=+3.709170888,LastTimestamp:2026-07-27 19:26:26.580807097 +0000 UTC m=+3.709170888,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:26.599385 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:26.599309    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal.18c63c1a72b2f2ab  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal,UID:d6746e0202d8b715f80728def55766a0,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:26.590126763 +0000 UTC m=+3.718490540,LastTimestamp:2026-07-27 19:26:26.590126763 +0000 UTC m=+3.718490540,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:26.741028 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:26.740907    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:26.742006 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:26.741984    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:26.742146 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:26.742026    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:26.742146 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:26.742042    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:26.972812 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:26.972779    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 19:26:27.220012 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:27.219988    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:27.319744 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:27.319712    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 19:26:27.388188 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:27.388154    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-24.ec2.internal" event={"ID":"162f7fc2d5317b26ca4e84b4b15f251a","Type":"ContainerStarted","Data":"836555cd194b0bfe456dd1a0bbb505549da0a18edf2fb8fc6138e2e137bf0f10"}
Jul 27 19:26:27.388324 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:27.388201    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:27.389113 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:27.389095    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:27.389211 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:27.389130    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:27.389211 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:27.389140    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:27.389420 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:27.389403    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:27.389589 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:27.389565    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" event={"ID":"d6746e0202d8b715f80728def55766a0","Type":"ContainerStarted","Data":"3c935a40077cbcb8c8d8c54c187f85d166cb87d8b197a4e18cf3ef01d187d6de"}
Jul 27 19:26:27.389660 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:27.389649    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:27.390323 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:27.390309    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:27.390403 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:27.390334    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:27.390403 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:27.390345    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:27.390501 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:27.390483    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:27.463637 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:27.463602    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 27 19:26:27.620070 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:27.620020    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 19:26:28.219355 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:28.219324    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:28.391031 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:28.391009    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:28.391459 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:28.391009    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:28.391827 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:28.391810    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:28.391905 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:28.391835    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:28.391905 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:28.391856    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:28.391905 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:28.391865    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:28.392015 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:28.391839    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:28.392015 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:28.391936    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:28.392132 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:28.392082    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:28.392186 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:28.392144    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:29.219524 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:29.219490    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:29.480777 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:29.480688    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="6.4s"
Jul 27 19:26:29.696732 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:29.696699    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:29.697712 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:29.697693    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:29.697794 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:29.697730    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:29.697794 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:29.697741    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:29.697794 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:29.697768    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:29.715341 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:29.715312    2578 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:30.218783 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:30.218753    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:31.132531 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:31.132495    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 19:26:31.218114 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:31.218089    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:31.344869 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:31.344822    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 27 19:26:31.480722 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:31.480635    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:31.481639 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:31.481619    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:31.481736 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:31.481655    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:31.481736 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:31.481670    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:31.662789 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:31.662756    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 19:26:31.662789 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:31.662779    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 19:26:32.213112 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:32.213081    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:33.219009 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:33.218975    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:33.295800 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:33.295764    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:26:34.219634 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:34.219602    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:35.220410 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:35.220377    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:35.890540 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:35.890501    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 27 19:26:36.115718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:36.115689    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:36.116742 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:36.116726    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:36.116822 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:36.116760    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:36.116822 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:36.116775    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:36.116822 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:36.116800    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:36.133481 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:36.133448    2578 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:36.218891 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:36.218817    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:37.220521 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:37.220490    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:38.090436 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:38.090404    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 19:26:38.220296 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:38.220269    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:38.407443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:38.407369    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_d6746e0202d8b715f80728def55766a0/setup/0.log"
Jul 27 19:26:38.407443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:38.407410    2578 generic.go:356] "Generic (PLEG): container finished" podID="d6746e0202d8b715f80728def55766a0" containerID="3c935a40077cbcb8c8d8c54c187f85d166cb87d8b197a4e18cf3ef01d187d6de" exitCode=1
Jul 27 19:26:38.407880 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:38.407444    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" event={"ID":"d6746e0202d8b715f80728def55766a0","Type":"ContainerDied","Data":"3c935a40077cbcb8c8d8c54c187f85d166cb87d8b197a4e18cf3ef01d187d6de"}
Jul 27 19:26:38.407880 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:38.407613    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:38.408469 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:38.408452    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:38.408570 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:38.408488    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:38.408570 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:38.408502    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:38.408738 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:38.408724    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:38.420299 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:38.420224    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal.18c63c1d334d1419  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal,UID:d6746e0202d8b715f80728def55766a0,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:38.411387929 +0000 UTC m=+15.539751703,LastTimestamp:2026-07-27 19:26:38.411387929 +0000 UTC m=+15.539751703,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:38.491394 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:38.491318    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal.18c63c1a7224bdb9\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal.18c63c1a7224bdb9  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal,UID:d6746e0202d8b715f80728def55766a0,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:26.580807097 +0000 UTC m=+3.709170888,LastTimestamp:2026-07-27 19:26:38.483091191 +0000 UTC m=+15.611454977,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:38.500009 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:38.499934    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal.18c63c1a72b2f2ab\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal.18c63c1a72b2f2ab  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal,UID:d6746e0202d8b715f80728def55766a0,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:26.590126763 +0000 UTC m=+3.718490540,LastTimestamp:2026-07-27 19:26:38.492001563 +0000 UTC m=+15.620365361,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:39.124264 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:39.124229    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 27 19:26:39.219663 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:39.219640    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:39.410607 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:39.410532    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_d6746e0202d8b715f80728def55766a0/setup/0.log"
Jul 27 19:26:39.410607 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:39.410578    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" event={"ID":"d6746e0202d8b715f80728def55766a0","Type":"ContainerStarted","Data":"40c318004c72fdef184057266a24aabb6c123570bc0bde3ed2c22ce8a7062339"}
Jul 27 19:26:39.410987 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:39.410684    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:39.411548 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:39.411533    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:39.411599 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:39.411564    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:39.411599 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:39.411577    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:39.411797 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:39.411782    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:39.671080 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:39.670975    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:39.672033 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:39.672015    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:39.672137 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:39.672049    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:39.672137 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:39.672082    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:40.219314 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:40.219287    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:40.816295 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:40.816265    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 19:26:41.220134 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:41.220042    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:42.220307 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:42.220275    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:42.517314 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:42.517239    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 19:26:42.900362 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:42.900329    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 27 19:26:43.133863 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:43.133828    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:43.136325 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:43.136306    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:43.136395 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:43.136345    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:43.136395 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:43.136357    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:43.136395 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:43.136387    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:43.153210 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:43.153144    2578 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:43.218774 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:43.218743    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:43.296282 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:43.296246    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:26:44.219300 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:44.219269    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:45.219012 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:45.218976    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:46.220516 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:46.220491    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:47.219878 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:47.219842    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:48.220044 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:48.220014    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:49.219274 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:49.219243    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:49.909654 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:49.909618    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 27 19:26:50.153643 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:50.153606    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:50.154603 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:50.154587    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:50.154681 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:50.154620    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:50.154681 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:50.154632    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:50.154681 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:50.154660    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:50.173390 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:50.173312    2578 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:50.218572 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:50.218538    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:50.426933 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:50.426859    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_d6746e0202d8b715f80728def55766a0/setup/1.log"
Jul 27 19:26:50.427222 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:50.427208    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_d6746e0202d8b715f80728def55766a0/setup/0.log"
Jul 27 19:26:50.427278 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:50.427242    2578 generic.go:356] "Generic (PLEG): container finished" podID="d6746e0202d8b715f80728def55766a0" containerID="40c318004c72fdef184057266a24aabb6c123570bc0bde3ed2c22ce8a7062339" exitCode=1
Jul 27 19:26:50.427278 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:50.427267    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" event={"ID":"d6746e0202d8b715f80728def55766a0","Type":"ContainerDied","Data":"40c318004c72fdef184057266a24aabb6c123570bc0bde3ed2c22ce8a7062339"}
Jul 27 19:26:50.427432 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:50.427417    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:50.428080 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:50.428028    2578 scope.go:117] "RemoveContainer" containerID="3c935a40077cbcb8c8d8c54c187f85d166cb87d8b197a4e18cf3ef01d187d6de"
Jul 27 19:26:50.428247 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:50.428234    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:50.428295 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:50.428262    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:50.428295 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:50.428271    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:50.428500 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:50.428484    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:50.428546 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:50.428539    2578 scope.go:117] "RemoveContainer" containerID="3c935a40077cbcb8c8d8c54c187f85d166cb87d8b197a4e18cf3ef01d187d6de"
Jul 27 19:26:50.438608 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:50.438571    2578 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator_d6746e0202d8b715f80728def55766a0_0 in pod sandbox 5f0a0bccf59d1d59efc8f35aba179726f55711a768106f0049a3df7084828d17 from index: no such id: '3c935a40077cbcb8c8d8c54c187f85d166cb87d8b197a4e18cf3ef01d187d6de'" containerID="3c935a40077cbcb8c8d8c54c187f85d166cb87d8b197a4e18cf3ef01d187d6de"
Jul 27 19:26:50.438711 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:50.438639    2578 kuberuntime_container.go:962] "Unhandled Error" err="failed to remove pod init container \"setup\": rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator_d6746e0202d8b715f80728def55766a0_0 in pod sandbox 5f0a0bccf59d1d59efc8f35aba179726f55711a768106f0049a3df7084828d17 from index: no such id: '3c935a40077cbcb8c8d8c54c187f85d166cb87d8b197a4e18cf3ef01d187d6de'; Skipping pod \"kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator(d6746e0202d8b715f80728def55766a0)\"" logger="UnhandledError"
Jul 27 19:26:50.438841 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:50.438820    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator(d6746e0202d8b715f80728def55766a0)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" podUID="d6746e0202d8b715f80728def55766a0"
Jul 27 19:26:50.447336 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:50.447259    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal.18c63c20003061c4  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal,UID:d6746e0202d8b715f80728def55766a0,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator(d6746e0202d8b715f80728def55766a0),Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:50.43877114 +0000 UTC m=+27.567134936,LastTimestamp:2026-07-27 19:26:50.43877114 +0000 UTC m=+27.567134936,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:26:51.220321 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:51.220292    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:51.430114 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:51.430027    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_d6746e0202d8b715f80728def55766a0/setup/1.log"
Jul 27 19:26:52.218892 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:52.218859    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:53.219726 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:53.219699    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:53.297089 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:53.297037    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:26:53.885033 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:53.884995    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 19:26:54.220095 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:54.220030    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:55.218898 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:55.218867    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:56.226193 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:56.226165    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:56.683753 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:56.683711    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:56.684749 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:56.684727    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:56.684869 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:56.684767    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:56.684869 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:56.684778    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:56.918957 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:56.918919    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 27 19:26:57.151022 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:57.150984    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 27 19:26:57.174437 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:57.174413    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:26:57.175350 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:57.175335    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:26:57.175437 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:57.175364    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:26:57.175437 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:57.175376    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:26:57.175437 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:57.175405    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:57.192868 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:26:57.192836    2578 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:26:57.219761 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:57.219734    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:58.220774 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:58.220738    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:26:59.220113 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:26:59.220078    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:27:00.220797 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:00.220761    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:27:00.619132 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:00.619096    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 19:27:01.220591 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:01.220559    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:27:02.219336 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:02.219307    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:27:02.377614 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:02.377572    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:27:02.378553 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:02.378537    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:27:02.378637 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:02.378567    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:27:02.378637 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:02.378577    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:27:02.378749 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:02.378738    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:27:02.388645 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:02.388560    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal.18c63c1d334d1419\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal.18c63c1d334d1419  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal,UID:d6746e0202d8b715f80728def55766a0,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:38.411387929 +0000 UTC m=+15.539751703,LastTimestamp:2026-07-27 19:27:02.379487171 +0000 UTC m=+39.507850946,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:27:02.448751 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:02.448733    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_d6746e0202d8b715f80728def55766a0/setup/1.log"
Jul 27 19:27:02.453246 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:02.453172    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal.18c63c1a7224bdb9\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal.18c63c1a7224bdb9  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal,UID:d6746e0202d8b715f80728def55766a0,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:26.580807097 +0000 UTC m=+3.709170888,LastTimestamp:2026-07-27 19:27:02.44259882 +0000 UTC m=+39.570962613,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:27:02.462528 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:02.462452    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal.18c63c1a72b2f2ab\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal.18c63c1a72b2f2ab  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal,UID:d6746e0202d8b715f80728def55766a0,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-142-24.ec2.internal,},FirstTimestamp:2026-07-27 19:26:26.590126763 +0000 UTC m=+3.718490540,LastTimestamp:2026-07-27 19:27:02.450314253 +0000 UTC m=+39.578678026,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-24.ec2.internal,}"
Jul 27 19:27:02.780837 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:02.780806    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 19:27:03.221318 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:03.221243    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:27:03.297810 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:03.297777    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:03.452093 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:03.452050    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_d6746e0202d8b715f80728def55766a0/setup/1.log"
Jul 27 19:27:03.452234 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:03.452110    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" event={"ID":"d6746e0202d8b715f80728def55766a0","Type":"ContainerStarted","Data":"07ddc56e1ed9f91885851e9b7f392b7873595e351e6a98fa3528afa45312c588"}
Jul 27 19:27:03.452277 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:03.452248    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:27:03.457333 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:03.457315    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:27:03.457428 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:03.457343    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:27:03.457428 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:03.457353    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:27:03.457549 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:03.457537    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:27:03.928199 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:03.928166    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 27 19:27:04.193490 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:04.193401    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:27:04.195367 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:04.195351    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:27:04.195454 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:04.195379    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:27:04.195454 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:04.195389    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:27:04.195454 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:04.195421    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:27:04.215926 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:04.215899    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:27:04.216004 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:04.215980    2578 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:27:05.212689 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:05.212659    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:27:06.223106 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:06.223078    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:27:07.220956 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:07.220923    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:27:08.218353 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:08.218322    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:27:09.219099 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:09.219049    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:27:10.219856 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:10.219828    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:27:10.938329 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:10.938294    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 27 19:27:11.216234 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:11.216177    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:27:11.217018 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:11.217000    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:27:11.217143 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:11.217033    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:27:11.217143 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:11.217047    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:27:11.217143 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:11.217100    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:27:11.220122 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:11.220103    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:27:11.225296 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:11.225273    2578 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:27:11.892078 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:11.892017    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lwb6q"
Jul 27 19:27:11.899889 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:11.899868    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lwb6q"
Jul 27 19:27:12.155067 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:12.154967    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 19:27:12.210716 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:12.210674    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: Get "https://a6d1d56ccd0f74549854785fc68ba13b-4831d91d707b7d93.elb.us-east-1.amazonaws.com:6443/apis/storage.k8s.io/v1/csinodes/ip-10-0-142-24.ec2.internal?resourceVersion=0": http2: client conn could not be established
Jul 27 19:27:12.901977 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:12.901931    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 19:22:11 +0000 UTC" deadline="2028-04-24 00:08:09.247517586 +0000 UTC"
Jul 27 19:27:12.901977 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:12.901968    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15268h40m56.345553205s"
Jul 27 19:27:13.227932 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:13.227855    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:13.243687 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:13.243659    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:13.298304 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:13.298276    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:13.301145 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:13.301127    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:13.560701 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:13.560672    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:13.560701 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:13.560700    2578 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:13.599342 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:13.599317    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:13.614912 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:13.614897    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:13.669782 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:13.669760    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:13.935555 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:13.935489    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:13.935555 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:13.935514    2578 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:14.204745 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:14.204673    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:14.220696 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:14.220669    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:14.279535 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:14.279505    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:14.467896 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:14.467829    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_d6746e0202d8b715f80728def55766a0/setup/2.log"
Jul 27 19:27:14.468193 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:14.468179    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_d6746e0202d8b715f80728def55766a0/setup/1.log"
Jul 27 19:27:14.468238 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:14.468215    2578 generic.go:356] "Generic (PLEG): container finished" podID="d6746e0202d8b715f80728def55766a0" containerID="07ddc56e1ed9f91885851e9b7f392b7873595e351e6a98fa3528afa45312c588" exitCode=1
Jul 27 19:27:14.468270 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:14.468243    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" event={"ID":"d6746e0202d8b715f80728def55766a0","Type":"ContainerDied","Data":"07ddc56e1ed9f91885851e9b7f392b7873595e351e6a98fa3528afa45312c588"}
Jul 27 19:27:14.468335 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:14.468322    2578 scope.go:117] "RemoveContainer" containerID="40c318004c72fdef184057266a24aabb6c123570bc0bde3ed2c22ce8a7062339"
Jul 27 19:27:14.468410 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:14.468397    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:27:14.469875 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:14.469856    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:27:14.469934 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:14.469895    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:27:14.469934 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:14.469910    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:27:14.470115 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:14.470102    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:27:14.470160 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:14.470147    2578 scope.go:117] "RemoveContainer" containerID="40c318004c72fdef184057266a24aabb6c123570bc0bde3ed2c22ce8a7062339"
Jul 27 19:27:14.478197 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:14.478168    2578 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator_d6746e0202d8b715f80728def55766a0_1 in pod sandbox 5f0a0bccf59d1d59efc8f35aba179726f55711a768106f0049a3df7084828d17 from index: no such id: '40c318004c72fdef184057266a24aabb6c123570bc0bde3ed2c22ce8a7062339'" containerID="40c318004c72fdef184057266a24aabb6c123570bc0bde3ed2c22ce8a7062339"
Jul 27 19:27:14.478288 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:14.478208    2578 kuberuntime_container.go:962] "Unhandled Error" err="failed to remove pod init container \"setup\": rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator_d6746e0202d8b715f80728def55766a0_1 in pod sandbox 5f0a0bccf59d1d59efc8f35aba179726f55711a768106f0049a3df7084828d17 from index: no such id: '40c318004c72fdef184057266a24aabb6c123570bc0bde3ed2c22ce8a7062339'; Skipping pod \"kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator(d6746e0202d8b715f80728def55766a0)\"" logger="UnhandledError"
Jul 27 19:27:14.478355 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:14.478339    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator(d6746e0202d8b715f80728def55766a0)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" podUID="d6746e0202d8b715f80728def55766a0"
Jul 27 19:27:14.550689 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:14.550655    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:14.550689 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:14.550685    2578 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:15.471038 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:15.471013    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_d6746e0202d8b715f80728def55766a0/setup/2.log"
Jul 27 19:27:16.588466 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:16.588434    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:16.604319 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:16.604299    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:16.665382 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:16.665361    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:16.945694 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:16.945613    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:16.945694 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:16.945645    2578 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-142-24.ec2.internal" not found
Jul 27 19:27:17.944559 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:17.944525    2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:27:18.226443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:18.226368    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:27:18.227654 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:18.227638    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:27:18.227743 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:18.227668    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:27:18.227743 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:18.227685    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:27:18.227743 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:18.227720    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:27:18.236112 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:18.236098    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:27:18.236170 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:18.236118    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-24.ec2.internal\": node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:18.247738 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:18.247717    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:18.348039 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:18.348004    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:18.448708 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:18.448660    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:18.549042 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:18.549012    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:18.649564 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:18.649534    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:18.750424 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:18.750383    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:18.850908 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:18.850847    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:18.951409 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:18.951369    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:19.052396 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:19.052357    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:19.152885 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:19.152828    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:19.253971 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:19.253935    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:19.354749 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:19.354712    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:19.455504 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:19.455421    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:19.555901 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:19.555853    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:19.656424 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:19.656390    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:19.757148 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:19.757089    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:19.857982 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:19.857961    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:19.958570 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:19.958536    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:20.058999 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:20.058975    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:20.159535 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:20.159506    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:20.259817 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:20.259785    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:20.360512 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:20.360452    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:20.461363 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:20.461329    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:20.561778 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:20.561735    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:20.662376 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:20.662316    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:20.762820 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:20.762790    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:20.863699 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:20.863666    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:20.964514 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:20.964437    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:21.064921 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:21.064880    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:21.165590 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:21.165562    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:21.266719 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:21.266659    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:21.367289 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:21.367252    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:21.467533 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:21.467481    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:21.567968 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:21.567936    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:21.668607 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:21.668577    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:21.769295 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:21.769251    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:21.869786 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:21.869729    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:21.970277 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:21.970232    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:22.070477 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:22.070448    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:22.171140 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:22.171078    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:22.271547 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:22.271524    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:22.371621 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:22.371582    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:22.472277 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:22.472192    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:22.573230 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:22.573187    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:22.673860 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:22.673822    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:22.774648 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:22.774575    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:22.875051 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:22.875015    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:22.975576 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:22.975548    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:23.076034 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:23.076007    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:23.176261 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:23.176233    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:23.276647 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:23.276610    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:23.298952 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:23.298932    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:23.377806 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:23.377718    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:23.478098 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:23.478044    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:23.578945 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:23.578894    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:23.679626 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:23.679565    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:23.780280 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:23.780242    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:23.880738 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:23.880699    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:23.981499 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:23.981407    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:24.081917 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:24.081883    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:24.182588 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:24.182556    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:24.283646 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:24.283620    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:24.384399 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:24.384370    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:24.484465 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:24.484441    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:24.585269 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:24.585185    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:24.685820 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:24.685790    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:24.786532 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:24.786493    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:24.887522 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:24.887459    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:24.987969 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:24.987926    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:25.088526 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:25.088481    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:25.189211 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:25.189137    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:25.290188 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:25.290157    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:25.390878 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:25.390849    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:25.491381 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:25.491308    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:25.591851 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:25.591814    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:25.692570 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:25.692541    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:25.793200 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:25.793163    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:25.894439 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:25.894288    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:25.994599 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:25.994559    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:26.095103 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:26.095012    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:26.195595 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:26.195560    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:26.296651 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:26.296610    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:26.380386 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:26.380312    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:27:26.397300 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:26.397275    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:26.497866 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:26.497834    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:26.598445 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:26.598402    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:26.699144 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:26.699082    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:26.799674 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:26.799635    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:26.900152 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:26.900110    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:27.000901 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:27.000814    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:27.101834 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:27.101791    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:27.202209 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:27.202172    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:27.303132 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:27.303104    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:27.403923 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:27.403888    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:27.504499 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:27.504470    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:27.605558 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:27.605487    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:27.706282 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:27.706252    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:27.806753 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:27.806716    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:27.907233 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:27.907168    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:28.007681 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:28.007635    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:28.108137 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:28.108096    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:28.208232 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:28.208164    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:28.212087 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:28.212069    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:27:28.308576 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:28.308552    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:28.377362 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:28.377339    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:27:28.380500 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:28.380481    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:27:28.380616 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:28.380516    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:27:28.380616 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:28.380530    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:27:28.380761 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:28.380748    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:27:28.380926 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:28.380907    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator(d6746e0202d8b715f80728def55766a0)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" podUID="d6746e0202d8b715f80728def55766a0"
Jul 27 19:27:28.408867 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:28.408825    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:28.509943 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:28.509845    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:28.560276 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:28.560251    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-24.ec2.internal\": node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:28.610781 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:28.610750    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:28.711489 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:28.711447    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:28.811993 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:28.811955    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:28.912491 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:28.912468    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:29.012999 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:29.012961    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:29.113548 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:29.113483    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:29.214277 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:29.214242    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:29.315115 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:29.315076    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:29.415267 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:29.415198    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:29.515634 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:29.515604    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:29.616138 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:29.616097    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:29.716928 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:29.716870    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:29.817430 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:29.817395    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:29.917875 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:29.917855    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:30.018906 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:30.018833    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:30.119441 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:30.119402    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:30.219631 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:30.219605    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:30.319852 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:30.319827    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:30.420624 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:30.420602    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:30.521113 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:30.521083    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:30.621787 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:30.621715    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:30.722466 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:30.722441    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:30.822819 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:30.822791    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:30.923325 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:30.923261    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:31.023703 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:31.023664    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:31.124188 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:31.124155    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:31.225147 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:31.225081    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:31.325913 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:31.325875    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:31.426111 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:31.426081    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:31.526526 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:31.526500    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:31.627009 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:31.626974    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:31.727764 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:31.727728    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:31.828741 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:31.828672    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:31.929257 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:31.929219    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:32.030272 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:32.030234    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:32.130741 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:32.130686    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:32.231624 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:32.231595    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:32.332511 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:32.332474    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:32.377895 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:32.377858    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:27:32.378823 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:32.378808    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:27:32.378918 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:32.378839    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:27:32.378918 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:32.378852    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:27:32.379113 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:32.379099    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:27:32.432833 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:32.432757    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:32.533505 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:32.533472    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:32.633958 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:32.633923    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:32.735097 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:32.735003    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:32.835690 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:32.835664    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:32.936273 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:32.936241    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:33.036742 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:33.036719    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:33.137334 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:33.137297    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:33.237401 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:33.237365    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:33.299810 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:33.299747    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:33.338427 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:33.338391    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:33.439068 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:33.439024    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:33.539491 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:33.539458    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:33.639973 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:33.639907    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:33.740459 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:33.740436    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:33.810209 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:33.810175    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:27:33.811185 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:33.811161    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:27:33.811301 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:33.811199    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:27:33.811301 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:33.811216    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:27:33.841012 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:33.840977    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:33.941604 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:33.941548    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:34.042507 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:34.042468    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:34.142930 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:34.142901    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:34.234657 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:34.234607    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:27:34.243779 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:34.243757    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:34.344641 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:34.344603    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:34.445049 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:34.445026    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:34.545489 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:34.545460    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:34.646515 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:34.646482    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:34.747353 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:34.747315    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:34.848281 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:34.848234    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:34.948737 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:34.948702    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:35.049291 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:35.049254    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:35.149816 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:35.149751    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:35.250244 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:35.250218    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:35.350978 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:35.350943    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:35.451600 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:35.451547    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:35.552038 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:35.552004    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:35.652468 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:35.652441    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:35.753331 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:35.753277    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:35.853770 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:35.853739    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:35.954350 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:35.954319    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:36.054771 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:36.054751    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:36.155346 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:36.155325    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:36.256268 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:36.256236    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:36.357080 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:36.357007    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:36.457610 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:36.457579    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:36.558551 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:36.558518    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:36.659118 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:36.659037    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:36.759637 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:36.759605    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:36.860084 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:36.860030    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:36.960499 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:36.960435    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:37.061273 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:37.061243    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:37.161861 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:37.161823    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:37.262688 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:37.262625    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:37.363415 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:37.363381    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:37.464045 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:37.464003    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:37.564540 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:37.564499    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:37.665116 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:37.665091    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:37.765448 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:37.765424    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:37.865953 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:37.865891    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:37.966326 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:37.966292    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:38.067265 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:38.067227    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:38.168072 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:38.167992    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:38.269091 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:38.269061    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:38.369371 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:38.369333    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:38.470031 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:38.469956    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:38.570395 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:38.570357    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:38.671000 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:38.670973    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:38.769632 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:38.769578    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-24.ec2.internal\": node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:38.784396 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:38.784371    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:38.884751 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:38.884725    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:38.985239 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:38.985210    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:39.086023 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:39.085998    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:39.186653 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:39.186615    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:39.286763 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:39.286720    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:39.377284 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:39.377235    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:27:39.378219 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:39.378203    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:27:39.378289 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:39.378234    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:27:39.378289 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:39.378243    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:27:39.378464 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:39.378453    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:27:39.387946 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:39.387926    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:39.488203 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:39.488170    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:39.508873 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:39.508854    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_d6746e0202d8b715f80728def55766a0/setup/2.log"
Jul 27 19:27:39.509002 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:39.508898    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" event={"ID":"d6746e0202d8b715f80728def55766a0","Type":"ContainerStarted","Data":"e04ad8487daa8c0f5c021a5f709ec00a860673f177e6a4e2f11372adc9f9c21b"}
Jul 27 19:27:39.509040 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:39.509007    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:27:39.509815 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:39.509802    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:27:39.509871 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:39.509830    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:27:39.509871 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:39.509844    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:27:39.510063 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:39.510038    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:27:39.589116 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:39.589090    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:39.689802 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:39.689748    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:39.790522 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:39.790482    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:39.891006 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:39.890967    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:39.991610 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:39.991526    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:40.092025 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:40.091993    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:40.192725 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:40.192685    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:40.293820 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:40.293796    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:40.394639 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:40.394607    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:40.495583 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:40.495548    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:40.596114 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:40.596009    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:40.696551 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:40.696521    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:40.797155 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:40.797120    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:40.897690 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:40.897635    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:40.998295 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:40.998254    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:41.099224 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:41.099189    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:41.199894 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:41.199821    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:41.300892 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:41.300860    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:41.401677 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:41.401643    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:41.502218 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:41.502125    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:41.603168 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:41.603121    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:41.703960 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:41.703919    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:41.804526 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:41.804489    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:41.905285 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:41.905261    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:42.005740 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:42.005711    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:42.106220 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:42.106160    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:42.207003 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:42.206967    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:42.307191 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:42.307164    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:42.407962 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:42.407900    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:42.508506 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:42.508467    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:42.608933 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:42.608890    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:42.709864 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:42.709804    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:42.810389 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:42.810351    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:42.910863 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:42.910826    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:43.011407 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:43.011331    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:43.111828 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:43.111795    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:43.212891 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:43.212867    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:43.300606 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:43.300573    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:43.313219 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:43.313199    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:43.414014 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:43.413984    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:43.514604 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:43.514559    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:43.614933 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:43.614842    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:43.715839 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:43.715810    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:43.816375 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:43.816337    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:43.916923 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:43.916809    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:44.017402 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:44.017366    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:44.117872 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:44.117844    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:44.218747 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:44.218682    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:44.318984 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:44.318937    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:44.419874 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:44.419840    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:44.520138 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:44.520069    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:44.620634 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:44.620590    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:44.721420 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:44.721379    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:44.821806 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:44.821772    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:44.922179 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:44.922155    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:45.022610 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:45.022574    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:45.123462 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:45.123408    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:45.224235 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:45.224199    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:45.324330 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:45.324311    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:45.425031 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:45.424971    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:45.525392 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:45.525365    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:45.625850 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:45.625812    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:45.726643 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:45.726598    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:45.827127 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:45.827092    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:45.927576 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:45.927548    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:46.028088 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:46.028050    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:46.128533 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:46.128504    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:46.229400 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:46.229371    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:46.330291 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:46.330221    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:46.431024 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:46.430995    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:46.531526 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:46.531498    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:46.632040 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:46.631968    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:46.732755 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:46.732720    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:46.833379 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:46.833334    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:46.934344 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:46.934281    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:47.034761 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:47.034732    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:47.135330 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:47.135285    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:47.236169 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:47.236091    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:47.336896 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:47.336868    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:47.437667 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:47.437642    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:47.538116 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:47.538091    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:47.638587 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:47.638553    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:47.739397 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:47.739370    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:47.840476 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:47.840395    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:47.940890 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:47.940859    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:48.041405 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:48.041376    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:48.141910 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:48.141832    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:48.242681 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:48.242637    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:48.343013 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:48.342982    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:48.443670 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:48.443617    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:48.544016 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:48.543980    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:48.644524 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:48.644486    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:48.745386 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:48.745318    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:48.845836 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:48.845805    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:48.946409 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:48.946384    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:49.046819 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:49.046797    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:49.064977 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:49.064953    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-24.ec2.internal\": node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:49.147720 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:49.147682    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:49.248655 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:49.248617    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:49.349547 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:49.349470    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:49.450159 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:49.450127    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:49.550512 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:49.550480    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:49.651033 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:49.650960    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:49.751737 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:49.751704    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:49.852739 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:49.852708    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:49.953315 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:49.953249    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:50.053714 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:50.053668    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:50.154671 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:50.154644    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:50.255716 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:50.255649    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:50.356546 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:50.356510    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:50.457237 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:50.457209    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:50.525796 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:50.525778    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_d6746e0202d8b715f80728def55766a0/setup/3.log"
Jul 27 19:27:50.526148 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:50.526132    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_d6746e0202d8b715f80728def55766a0/setup/2.log"
Jul 27 19:27:50.526201 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:50.526169    2578 generic.go:356] "Generic (PLEG): container finished" podID="d6746e0202d8b715f80728def55766a0" containerID="e04ad8487daa8c0f5c021a5f709ec00a860673f177e6a4e2f11372adc9f9c21b" exitCode=1
Jul 27 19:27:50.526234 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:50.526197    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" event={"ID":"d6746e0202d8b715f80728def55766a0","Type":"ContainerDied","Data":"e04ad8487daa8c0f5c021a5f709ec00a860673f177e6a4e2f11372adc9f9c21b"}
Jul 27 19:27:50.526304 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:50.526272    2578 scope.go:117] "RemoveContainer" containerID="07ddc56e1ed9f91885851e9b7f392b7873595e351e6a98fa3528afa45312c588"
Jul 27 19:27:50.526411 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:50.526398    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:27:50.527509 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:50.527265    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:27:50.527509 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:50.527292    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:27:50.527509 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:50.527307    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:27:50.527611 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:50.527525    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-24.ec2.internal\" not found" node="ip-10-0-142-24.ec2.internal"
Jul 27 19:27:50.527611 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:50.527583    2578 scope.go:117] "RemoveContainer" containerID="07ddc56e1ed9f91885851e9b7f392b7873595e351e6a98fa3528afa45312c588"
Jul 27 19:27:50.536212 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:50.536186    2578 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator_d6746e0202d8b715f80728def55766a0_2 in pod sandbox 5f0a0bccf59d1d59efc8f35aba179726f55711a768106f0049a3df7084828d17 from index: no such id: '07ddc56e1ed9f91885851e9b7f392b7873595e351e6a98fa3528afa45312c588'" containerID="07ddc56e1ed9f91885851e9b7f392b7873595e351e6a98fa3528afa45312c588"
Jul 27 19:27:50.536280 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:50.536229    2578 kuberuntime_container.go:962] "Unhandled Error" err="failed to remove pod init container \"setup\": rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator_d6746e0202d8b715f80728def55766a0_2 in pod sandbox 5f0a0bccf59d1d59efc8f35aba179726f55711a768106f0049a3df7084828d17 from index: no such id: '07ddc56e1ed9f91885851e9b7f392b7873595e351e6a98fa3528afa45312c588'; Skipping pod \"kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator(d6746e0202d8b715f80728def55766a0)\"" logger="UnhandledError"
Jul 27 19:27:50.536373 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:50.536357    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 40s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator(d6746e0202d8b715f80728def55766a0)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" podUID="d6746e0202d8b715f80728def55766a0"
Jul 27 19:27:50.557330 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:50.557296    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-24.ec2.internal\" not found"
Jul 27 19:27:50.632347 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:50.632318    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:27:50.722713 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:50.722672    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal"
Jul 27 19:27:50.732949 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:50.732926    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 19:27:50.733606 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:50.733593    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-24.ec2.internal"
Jul 27 19:27:50.742419 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:50.742400    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 19:27:51.246577 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.246541    2578 apiserver.go:52] "Watching apiserver"
Jul 27 19:27:51.254334 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.254315    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 19:27:51.254678 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.254658    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-9hjwq","openshift-image-registry/node-ca-5jr4b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal","openshift-multus/multus-4ljfw","openshift-network-diagnostics/network-check-target-p2kwp","kube-system/global-pull-secret-syncer-m8s7m","openshift-cluster-node-tuning-operator/tuned-s6bhg","openshift-multus/multus-additional-cni-plugins-9zv9c","openshift-multus/network-metrics-daemon-drqtg","openshift-network-operator/iptables-alerter-jhrr7","openshift-ovn-kubernetes/ovnkube-node-d2tm8","kube-system/konnectivity-agent-xgzv4","kube-system/kube-apiserver-proxy-ip-10-0-142-24.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"]
Jul 27 19:27:51.257912 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.257898    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.259897 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.259875    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.260517 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.260483    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 19:27:51.260610 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.260517    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:27:51.260663 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.260608    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lrdkg\""
Jul 27 19:27:51.261903 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.261882    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.262341 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.262307    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 19:27:51.263362 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.263327    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 19:27:51.263362 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.263342    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pklxz\""
Jul 27 19:27:51.263362 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.263372    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 19:27:51.263594 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.263403    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 19:27:51.263594 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.263427    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 19:27:51.263594 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.263344    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 19:27:51.263898 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.263883    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.264089 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.263961    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 19:27:51.264331 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.264311    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 19:27:51.264457 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.264442    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 19:27:51.264457 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.264451    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dvtqg\""
Jul 27 19:27:51.266410 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.266394    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:27:51.266485 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.266455    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 19:27:51.266485 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.266476    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 19:27:51.266485 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.266483    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 19:27:51.266623 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:51.266471    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2kwp" podUID="562374d2-5897-4f0a-86b5-0d13689d70fa"
Jul 27 19:27:51.266667 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.266662    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 19:27:51.266768 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.266753    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xng96\""
Jul 27 19:27:51.268576 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.268562    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:27:51.268649 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:51.268613    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8s7m" podUID="4493ab60-935e-4993-800b-a69eccd1cc16"
Jul 27 19:27:51.270757 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.270741    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:27:51.270837 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:51.270804    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:27:51.272933 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.272918    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.275204 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.275187    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f2lp5\""
Jul 27 19:27:51.275293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.275218    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5jr4b"
Jul 27 19:27:51.275806 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.275789    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 19:27:51.278433 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.276166    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 19:27:51.278433 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.278358    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jhrr7"
Jul 27 19:27:51.278566 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.278455    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 19:27:51.278807 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.278789    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 19:27:51.278901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.278878    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 19:27:51.278994 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.278977    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f4fwn\""
Jul 27 19:27:51.279107 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.278986    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 19:27:51.280273 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.280258    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9hjwq"
Jul 27 19:27:51.280853 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.280839    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:27:51.281036 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.281025    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 19:27:51.281230 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.281217    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-48rxj\""
Jul 27 19:27:51.281395 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.281379    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 19:27:51.282241 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.282227    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 19:27:51.282413 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.282396    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 19:27:51.282495 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.282477    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xgzv4"
Jul 27 19:27:51.283398 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.283380    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nmhfp\""
Jul 27 19:27:51.284552 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.284533    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 19:27:51.284632 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.284550    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 19:27:51.284632 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.284599    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6zvbh\""
Jul 27 19:27:51.289291 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.289272    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 19:27:51.322024 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.321999    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5bv2s"
Jul 27 19:27:51.323713 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.323699    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 19:27:51.330848 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.330834    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5bv2s"
Jul 27 19:27:51.411960 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.411930    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-env-overrides\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.411960 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.411958    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-ovnkube-script-lib\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.412220 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.411976    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fa7739f-0905-421b-89b3-857fee7c68d9-system-cni-dir\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.412220 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.411993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f664404-7594-4137-8e24-27ff3689a210-hosts-file\") pod \"node-resolver-9hjwq\" (UID: \"8f664404-7594-4137-8e24-27ff3689a210\") " pod="openshift-dns/node-resolver-9hjwq"
Jul 27 19:27:51.412220 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c782a78c-3c18-4684-aac1-41c516961e11-iptables-alerter-script\") pod \"iptables-alerter-jhrr7\" (UID: \"c782a78c-3c18-4684-aac1-41c516961e11\") " pod="openshift-network-operator/iptables-alerter-jhrr7"
Jul 27 19:27:51.412220 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412024    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-run-systemd\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.412220 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412040    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-multus-conf-dir\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.412220 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbc7k\" (UniqueName: \"kubernetes.io/projected/8f664404-7594-4137-8e24-27ff3689a210-kube-api-access-rbc7k\") pod \"node-resolver-9hjwq\" (UID: \"8f664404-7594-4137-8e24-27ff3689a210\") " pod="openshift-dns/node-resolver-9hjwq"
Jul 27 19:27:51.412220 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412083    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e3ca0d2d-d38c-46cb-9d80-ad52098df555-agent-certs\") pod \"konnectivity-agent-xgzv4\" (UID: \"e3ca0d2d-d38c-46cb-9d80-ad52098df555\") " pod="kube-system/konnectivity-agent-xgzv4"
Jul 27 19:27:51.412220 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-sysctl-conf\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.412220 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412110    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-kubelet\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.412220 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-systemd-units\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.412220 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412167    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.412220 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412190    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpjc4\" (UniqueName: \"kubernetes.io/projected/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-kube-api-access-wpjc4\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.412763 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412230    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a14be9a-be34-4ab7-b669-e84cf323d3db-cni-binary-copy\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.412763 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-run-netns\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.412763 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412306    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnqhg\" (UniqueName: \"kubernetes.io/projected/13ef0d06-a352-4060-84ff-a0f6f76d745e-kube-api-access-qnqhg\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.412763 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412330    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.412763 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412353    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-multus-cni-dir\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.412763 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412375    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-var-lib-cni-bin\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.412763 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4493ab60-935e-4993-800b-a69eccd1cc16-dbus\") pod \"global-pull-secret-syncer-m8s7m\" (UID: \"4493ab60-935e-4993-800b-a69eccd1cc16\") " pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:27:51.412763 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-run-openvswitch\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.412763 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412473    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-ovnkube-config\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.412763 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412497    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-var-lib-cni-multus\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.412763 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-modprobe-d\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.412763 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412546    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-tuned\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.412763 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412569    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nm4v\" (UniqueName: \"kubernetes.io/projected/c782a78c-3c18-4684-aac1-41c516961e11-kube-api-access-8nm4v\") pod \"iptables-alerter-jhrr7\" (UID: \"c782a78c-3c18-4684-aac1-41c516961e11\") " pod="openshift-network-operator/iptables-alerter-jhrr7"
Jul 27 19:27:51.412763 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412591    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-var-lib-kubelet\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.412763 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412616    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fa7739f-0905-421b-89b3-857fee7c68d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.412763 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412643    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4493ab60-935e-4993-800b-a69eccd1cc16-kubelet-config\") pod \"global-pull-secret-syncer-m8s7m\" (UID: \"4493ab60-935e-4993-800b-a69eccd1cc16\") " pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:27:51.413314 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412677    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-sysconfig\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.413314 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412702    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-sys\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.413314 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412724    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-lib-modules\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.413314 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-etc-openvswitch\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.413314 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412778    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7942r\" (UniqueName: \"kubernetes.io/projected/a635d151-c940-4f0c-bd3c-69e8fdf67942-kube-api-access-7942r\") pod \"network-metrics-daemon-drqtg\" (UID: \"a635d151-c940-4f0c-bd3c-69e8fdf67942\") " pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:27:51.413314 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412801    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fa7739f-0905-421b-89b3-857fee7c68d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.413314 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412846    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c782a78c-3c18-4684-aac1-41c516961e11-host-slash\") pod \"iptables-alerter-jhrr7\" (UID: \"c782a78c-3c18-4684-aac1-41c516961e11\") " pod="openshift-network-operator/iptables-alerter-jhrr7"
Jul 27 19:27:51.413314 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412871    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-run-ovn\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.413314 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412886    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-ovn-node-metrics-cert\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.413314 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412900    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-os-release\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.413314 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-run-k8s-cni-cncf-io\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.413314 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412967    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhrsk\" (UniqueName: \"kubernetes.io/projected/9a14be9a-be34-4ab7-b669-e84cf323d3db-kube-api-access-rhrsk\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.413314 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.412987    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fa7739f-0905-421b-89b3-857fee7c68d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.413314 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fa7739f-0905-421b-89b3-857fee7c68d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.413314 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413019    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-systemd\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.413314 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413032    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-device-dir\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.413800 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret\") pod \"global-pull-secret-syncer-m8s7m\" (UID: \"4493ab60-935e-4993-800b-a69eccd1cc16\") " pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:27:51.413800 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413072    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-run-netns\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.413800 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-node-log\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.413800 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-multus-socket-dir-parent\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.413800 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413140    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fa7739f-0905-421b-89b3-857fee7c68d9-os-release\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.413800 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413158    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbtvg\" (UniqueName: \"kubernetes.io/projected/2fa7739f-0905-421b-89b3-857fee7c68d9-kube-api-access-gbtvg\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.413800 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24v65\" (UniqueName: \"kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65\") pod \"network-check-target-p2kwp\" (UID: \"562374d2-5897-4f0a-86b5-0d13689d70fa\") " pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:27:51.413800 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-slash\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.413800 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413205    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-var-lib-openvswitch\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.413800 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-log-socket\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.413800 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e3ca0d2d-d38c-46cb-9d80-ad52098df555-konnectivity-ca\") pod \"konnectivity-agent-xgzv4\" (UID: \"e3ca0d2d-d38c-46cb-9d80-ad52098df555\") " pod="kube-system/konnectivity-agent-xgzv4"
Jul 27 19:27:51.413800 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13ef0d06-a352-4060-84ff-a0f6f76d745e-tmp\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.413800 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413294    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-registration-dir\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.413800 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413315    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-cni-bin\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.413800 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a14be9a-be34-4ab7-b669-e84cf323d3db-multus-daemon-config\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.413800 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f664404-7594-4137-8e24-27ff3689a210-tmp-dir\") pod \"node-resolver-9hjwq\" (UID: \"8f664404-7594-4137-8e24-27ff3689a210\") " pod="openshift-dns/node-resolver-9hjwq"
Jul 27 19:27:51.414293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413376    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-kubernetes\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.414293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413390    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-var-lib-kubelet\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.414293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bn4w\" (UniqueName: \"kubernetes.io/projected/b24a2662-243e-418c-9933-60326769bf3a-kube-api-access-6bn4w\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.414293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413421    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-cni-netd\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.414293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-hostroot\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.414293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413456    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-run-multus-certs\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.414293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413471    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fa7739f-0905-421b-89b3-857fee7c68d9-cnibin\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.414293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413485    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-socket-dir\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.414293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413498    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-cnibin\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.414293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-etc-selinux\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.414293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90259da6-ff35-437b-a596-853d2a96bc12-host\") pod \"node-ca-5jr4b\" (UID: \"90259da6-ff35-437b-a596-853d2a96bc12\") " pod="openshift-image-registry/node-ca-5jr4b"
Jul 27 19:27:51.414293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413570    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90259da6-ff35-437b-a596-853d2a96bc12-serviceca\") pod \"node-ca-5jr4b\" (UID: \"90259da6-ff35-437b-a596-853d2a96bc12\") " pod="openshift-image-registry/node-ca-5jr4b"
Jul 27 19:27:51.414293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.414293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413600    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-system-cni-dir\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.414293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413622    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-sys-fs\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.414293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.413639    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-run\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.414293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.414049    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fjzx\" (UniqueName: \"kubernetes.io/projected/90259da6-ff35-437b-a596-853d2a96bc12-kube-api-access-9fjzx\") pod \"node-ca-5jr4b\" (UID: \"90259da6-ff35-437b-a596-853d2a96bc12\") " pod="openshift-image-registry/node-ca-5jr4b"
Jul 27 19:27:51.414746 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.414087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-etc-kubernetes\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.414746 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.414102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs\") pod \"network-metrics-daemon-drqtg\" (UID: \"a635d151-c940-4f0c-bd3c-69e8fdf67942\") " pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:27:51.414746 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.414115    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-host\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.414746 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.414131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-sysctl-d\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.483640 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.483587    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-24.ec2.internal" podStartSLOduration=1.483571509 podStartE2EDuration="1.483571509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:27:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:51.483321111 +0000 UTC m=+88.611684905" watchObservedRunningTime="2026-07-27 19:27:51.483571509 +0000 UTC m=+88.611935303"
Jul 27 19:27:51.514638 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.514557    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7942r\" (UniqueName: \"kubernetes.io/projected/a635d151-c940-4f0c-bd3c-69e8fdf67942-kube-api-access-7942r\") pod \"network-metrics-daemon-drqtg\" (UID: \"a635d151-c940-4f0c-bd3c-69e8fdf67942\") " pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:27:51.514638 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.514598    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fa7739f-0905-421b-89b3-857fee7c68d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.514638 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.514614    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c782a78c-3c18-4684-aac1-41c516961e11-host-slash\") pod \"iptables-alerter-jhrr7\" (UID: \"c782a78c-3c18-4684-aac1-41c516961e11\") " pod="openshift-network-operator/iptables-alerter-jhrr7"
Jul 27 19:27:51.514638 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.514632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-run-ovn\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.514894 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.514655    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-ovn-node-metrics-cert\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.514894 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.514718    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c782a78c-3c18-4684-aac1-41c516961e11-host-slash\") pod \"iptables-alerter-jhrr7\" (UID: \"c782a78c-3c18-4684-aac1-41c516961e11\") " pod="openshift-network-operator/iptables-alerter-jhrr7"
Jul 27 19:27:51.514894 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.514724    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-run-ovn\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.514894 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.514760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-os-release\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.514894 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.514796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-run-k8s-cni-cncf-io\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.514894 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.514821    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhrsk\" (UniqueName: \"kubernetes.io/projected/9a14be9a-be34-4ab7-b669-e84cf323d3db-kube-api-access-rhrsk\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.514894 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.514831    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-os-release\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.514894 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.514843    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fa7739f-0905-421b-89b3-857fee7c68d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.514894 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.514840    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fa7739f-0905-421b-89b3-857fee7c68d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.514894 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.514878    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-run-k8s-cni-cncf-io\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.515443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.514942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fa7739f-0905-421b-89b3-857fee7c68d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.515443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.514968    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-systemd\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.515443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.514984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-device-dir\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.515443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret\") pod \"global-pull-secret-syncer-m8s7m\" (UID: \"4493ab60-935e-4993-800b-a69eccd1cc16\") " pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:27:51.515443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-run-netns\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.515443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-node-log\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.515443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-device-dir\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.515443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515100    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-multus-socket-dir-parent\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.515443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515114    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-run-netns\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.515443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515119    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-systemd\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.515443 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:51.515133    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:27:51.515443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fa7739f-0905-421b-89b3-857fee7c68d9-os-release\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.515443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515162    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-node-log\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.515443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515169    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbtvg\" (UniqueName: \"kubernetes.io/projected/2fa7739f-0905-421b-89b3-857fee7c68d9-kube-api-access-gbtvg\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.515443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515144    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-multus-socket-dir-parent\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.515443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515212    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fa7739f-0905-421b-89b3-857fee7c68d9-os-release\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.515443 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:51.515229    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret podName:4493ab60-935e-4993-800b-a69eccd1cc16 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:52.015186353 +0000 UTC m=+89.143550126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret") pod "global-pull-secret-syncer-m8s7m" (UID: "4493ab60-935e-4993-800b-a69eccd1cc16") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515263    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24v65\" (UniqueName: \"kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65\") pod \"network-check-target-p2kwp\" (UID: \"562374d2-5897-4f0a-86b5-0d13689d70fa\") " pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515292    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-slash\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-var-lib-openvswitch\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-log-socket\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515352    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-slash\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515362    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e3ca0d2d-d38c-46cb-9d80-ad52098df555-konnectivity-ca\") pod \"konnectivity-agent-xgzv4\" (UID: \"e3ca0d2d-d38c-46cb-9d80-ad52098df555\") " pod="kube-system/konnectivity-agent-xgzv4"
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515362    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-var-lib-openvswitch\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515389    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13ef0d06-a352-4060-84ff-a0f6f76d745e-tmp\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515390    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-log-socket\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515424    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-registration-dir\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-cni-bin\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a14be9a-be34-4ab7-b669-e84cf323d3db-multus-daemon-config\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515464    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515480    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f664404-7594-4137-8e24-27ff3689a210-tmp-dir\") pod \"node-resolver-9hjwq\" (UID: \"8f664404-7594-4137-8e24-27ff3689a210\") " pod="openshift-dns/node-resolver-9hjwq"
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515505    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-kubernetes\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515513    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-cni-bin\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515527    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fa7739f-0905-421b-89b3-857fee7c68d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.516217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515553    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-kubernetes\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.516996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515558    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-registration-dir\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.516996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515584    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-var-lib-kubelet\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.516996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515602    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bn4w\" (UniqueName: \"kubernetes.io/projected/b24a2662-243e-418c-9933-60326769bf3a-kube-api-access-6bn4w\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.516996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515616    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-cni-netd\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.516996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-hostroot\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.516996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-run-multus-certs\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.516996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515675    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fa7739f-0905-421b-89b3-857fee7c68d9-cnibin\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.516996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515704    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-socket-dir\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.516996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515726    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-cnibin\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.516996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515748    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-etc-selinux\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.516996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515770    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90259da6-ff35-437b-a596-853d2a96bc12-host\") pod \"node-ca-5jr4b\" (UID: \"90259da6-ff35-437b-a596-853d2a96bc12\") " pod="openshift-image-registry/node-ca-5jr4b"
Jul 27 19:27:51.516996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515789    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90259da6-ff35-437b-a596-853d2a96bc12-serviceca\") pod \"node-ca-5jr4b\" (UID: \"90259da6-ff35-437b-a596-853d2a96bc12\") " pod="openshift-image-registry/node-ca-5jr4b"
Jul 27 19:27:51.516996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.516996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515830    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f664404-7594-4137-8e24-27ff3689a210-tmp-dir\") pod \"node-resolver-9hjwq\" (UID: \"8f664404-7594-4137-8e24-27ff3689a210\") " pod="openshift-dns/node-resolver-9hjwq"
Jul 27 19:27:51.516996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515835    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-system-cni-dir\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.516996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-var-lib-kubelet\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.516996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515860    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-sys-fs\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515886    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-run\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-cnibin\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fjzx\" (UniqueName: \"kubernetes.io/projected/90259da6-ff35-437b-a596-853d2a96bc12-kube-api-access-9fjzx\") pod \"node-ca-5jr4b\" (UID: \"90259da6-ff35-437b-a596-853d2a96bc12\") " pod="openshift-image-registry/node-ca-5jr4b"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-etc-kubernetes\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515957    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs\") pod \"network-metrics-daemon-drqtg\" (UID: \"a635d151-c940-4f0c-bd3c-69e8fdf67942\") " pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515961    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-hostroot\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-host\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e3ca0d2d-d38c-46cb-9d80-ad52098df555-konnectivity-ca\") pod \"konnectivity-agent-xgzv4\" (UID: \"e3ca0d2d-d38c-46cb-9d80-ad52098df555\") " pod="kube-system/konnectivity-agent-xgzv4"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516003    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-sysctl-d\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515996    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-run-multus-certs\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516025    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fa7739f-0905-421b-89b3-857fee7c68d9-cnibin\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.515933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-cni-netd\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-env-overrides\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516082    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-ovnkube-script-lib\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-etc-kubernetes\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516105    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fa7739f-0905-421b-89b3-857fee7c68d9-system-cni-dir\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516142    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.517758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516145    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fa7739f-0905-421b-89b3-857fee7c68d9-system-cni-dir\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.518447 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a14be9a-be34-4ab7-b669-e84cf323d3db-multus-daemon-config\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.518447 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516163    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-socket-dir\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.518447 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516170    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f664404-7594-4137-8e24-27ff3689a210-hosts-file\") pod \"node-resolver-9hjwq\" (UID: \"8f664404-7594-4137-8e24-27ff3689a210\") " pod="openshift-dns/node-resolver-9hjwq"
Jul 27 19:27:51.518447 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c782a78c-3c18-4684-aac1-41c516961e11-iptables-alerter-script\") pod \"iptables-alerter-jhrr7\" (UID: \"c782a78c-3c18-4684-aac1-41c516961e11\") " pod="openshift-network-operator/iptables-alerter-jhrr7"
Jul 27 19:27:51.518447 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:51.516234    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:27:51.518447 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516245    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-run-systemd\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.518447 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516269    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-multus-conf-dir\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.518447 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516271    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-system-cni-dir\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.518447 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516283    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-sysctl-d\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.518447 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516295    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-etc-selinux\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.518447 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-host\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.518447 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516330    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-run\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.518447 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516342    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90259da6-ff35-437b-a596-853d2a96bc12-host\") pod \"node-ca-5jr4b\" (UID: \"90259da6-ff35-437b-a596-853d2a96bc12\") " pod="openshift-image-registry/node-ca-5jr4b"
Jul 27 19:27:51.518447 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516370    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f664404-7594-4137-8e24-27ff3689a210-hosts-file\") pod \"node-resolver-9hjwq\" (UID: \"8f664404-7594-4137-8e24-27ff3689a210\") " pod="openshift-dns/node-resolver-9hjwq"
Jul 27 19:27:51.518447 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:51.516290    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs podName:a635d151-c940-4f0c-bd3c-69e8fdf67942 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:52.016273454 +0000 UTC m=+89.144637234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs") pod "network-metrics-daemon-drqtg" (UID: "a635d151-c940-4f0c-bd3c-69e8fdf67942") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:27:51.518447 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516375    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-sys-fs\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.518447 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbc7k\" (UniqueName: \"kubernetes.io/projected/8f664404-7594-4137-8e24-27ff3689a210-kube-api-access-rbc7k\") pod \"node-resolver-9hjwq\" (UID: \"8f664404-7594-4137-8e24-27ff3689a210\") " pod="openshift-dns/node-resolver-9hjwq"
Jul 27 19:27:51.518901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e3ca0d2d-d38c-46cb-9d80-ad52098df555-agent-certs\") pod \"konnectivity-agent-xgzv4\" (UID: \"e3ca0d2d-d38c-46cb-9d80-ad52098df555\") " pod="kube-system/konnectivity-agent-xgzv4"
Jul 27 19:27:51.518901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516471    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-sysctl-conf\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.518901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516493    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-kubelet\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.518901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-systemd-units\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.518901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516537    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.518901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpjc4\" (UniqueName: \"kubernetes.io/projected/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-kube-api-access-wpjc4\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.518901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a14be9a-be34-4ab7-b669-e84cf323d3db-cni-binary-copy\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.518901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-run-netns\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.518901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnqhg\" (UniqueName: \"kubernetes.io/projected/13ef0d06-a352-4060-84ff-a0f6f76d745e-kube-api-access-qnqhg\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.518901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516657    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.518901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-multus-cni-dir\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.518901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516691    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-sysctl-conf\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.518901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-var-lib-cni-bin\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.518901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516725    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-env-overrides\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.518901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-kubelet\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.518901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516795    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-systemd-units\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.518901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516729    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4493ab60-935e-4993-800b-a69eccd1cc16-dbus\") pod \"global-pull-secret-syncer-m8s7m\" (UID: \"4493ab60-935e-4993-800b-a69eccd1cc16\") " pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516812    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4493ab60-935e-4993-800b-a69eccd1cc16-dbus\") pod \"global-pull-secret-syncer-m8s7m\" (UID: \"4493ab60-935e-4993-800b-a69eccd1cc16\") " pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516815    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-ovnkube-script-lib\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516835    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516204    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90259da6-ff35-437b-a596-853d2a96bc12-serviceca\") pod \"node-ca-5jr4b\" (UID: \"90259da6-ff35-437b-a596-853d2a96bc12\") " pod="openshift-image-registry/node-ca-5jr4b"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516874    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-var-lib-cni-bin\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516854    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-run-openvswitch\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-run-openvswitch\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516911    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-run-netns\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516934    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-run-systemd\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516922    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-ovnkube-config\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.516970    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-multus-cni-dir\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517042    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b24a2662-243e-418c-9933-60326769bf3a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517099    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-multus-conf-dir\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517275    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c782a78c-3c18-4684-aac1-41c516961e11-iptables-alerter-script\") pod \"iptables-alerter-jhrr7\" (UID: \"c782a78c-3c18-4684-aac1-41c516961e11\") " pod="openshift-network-operator/iptables-alerter-jhrr7"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-var-lib-cni-multus\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517478    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-var-lib-cni-multus\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-modprobe-d\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.519401 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517532    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a14be9a-be34-4ab7-b669-e84cf323d3db-cni-binary-copy\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.519989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-tuned\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.519989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517429    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-ovnkube-config\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.519989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nm4v\" (UniqueName: \"kubernetes.io/projected/c782a78c-3c18-4684-aac1-41c516961e11-kube-api-access-8nm4v\") pod \"iptables-alerter-jhrr7\" (UID: \"c782a78c-3c18-4684-aac1-41c516961e11\") " pod="openshift-network-operator/iptables-alerter-jhrr7"
Jul 27 19:27:51.519989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-var-lib-kubelet\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.519989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517628    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fa7739f-0905-421b-89b3-857fee7c68d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.519989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517641    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fa7739f-0905-421b-89b3-857fee7c68d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.519989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517664    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4493ab60-935e-4993-800b-a69eccd1cc16-kubelet-config\") pod \"global-pull-secret-syncer-m8s7m\" (UID: \"4493ab60-935e-4993-800b-a69eccd1cc16\") " pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:27:51.519989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517668    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-modprobe-d\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.519989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517685    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-sysconfig\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.519989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-sys\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.519989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-lib-modules\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.519989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517743    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-etc-openvswitch\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.519989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517811    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-etc-openvswitch\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.519989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517845    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-sysconfig\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.519989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-sys\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.519989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517892    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4493ab60-935e-4993-800b-a69eccd1cc16-kubelet-config\") pod \"global-pull-secret-syncer-m8s7m\" (UID: \"4493ab60-935e-4993-800b-a69eccd1cc16\") " pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:27:51.519989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517927    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a14be9a-be34-4ab7-b669-e84cf323d3db-host-var-lib-kubelet\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.520466 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.517942    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13ef0d06-a352-4060-84ff-a0f6f76d745e-lib-modules\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.520466 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.518183    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fa7739f-0905-421b-89b3-857fee7c68d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.520466 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.519805    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13ef0d06-a352-4060-84ff-a0f6f76d745e-tmp\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.520466 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.519830    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13ef0d06-a352-4060-84ff-a0f6f76d745e-etc-tuned\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.520466 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.519880    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-ovn-node-metrics-cert\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.520466 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.520016    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e3ca0d2d-d38c-46cb-9d80-ad52098df555-agent-certs\") pod \"konnectivity-agent-xgzv4\" (UID: \"e3ca0d2d-d38c-46cb-9d80-ad52098df555\") " pod="kube-system/konnectivity-agent-xgzv4"
Jul 27 19:27:51.528772 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.528649    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_d6746e0202d8b715f80728def55766a0/setup/3.log"
Jul 27 19:27:51.529282 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:51.529257    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 40s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator(d6746e0202d8b715f80728def55766a0)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" podUID="d6746e0202d8b715f80728def55766a0"
Jul 27 19:27:51.532243 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.532223    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbtvg\" (UniqueName: \"kubernetes.io/projected/2fa7739f-0905-421b-89b3-857fee7c68d9-kube-api-access-gbtvg\") pod \"multus-additional-cni-plugins-9zv9c\" (UID: \"2fa7739f-0905-421b-89b3-857fee7c68d9\") " pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.532326 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.532312    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7942r\" (UniqueName: \"kubernetes.io/projected/a635d151-c940-4f0c-bd3c-69e8fdf67942-kube-api-access-7942r\") pod \"network-metrics-daemon-drqtg\" (UID: \"a635d151-c940-4f0c-bd3c-69e8fdf67942\") " pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:27:51.538471 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.538446    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhrsk\" (UniqueName: \"kubernetes.io/projected/9a14be9a-be34-4ab7-b669-e84cf323d3db-kube-api-access-rhrsk\") pod \"multus-4ljfw\" (UID: \"9a14be9a-be34-4ab7-b669-e84cf323d3db\") " pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.538726 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.538711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnqhg\" (UniqueName: \"kubernetes.io/projected/13ef0d06-a352-4060-84ff-a0f6f76d745e-kube-api-access-qnqhg\") pod \"tuned-s6bhg\" (UID: \"13ef0d06-a352-4060-84ff-a0f6f76d745e\") " pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.545774 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:51.545748    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:27:51.545877 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:51.545779    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:27:51.545877 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:51.545794    2578 projected.go:196] Error preparing data for projected volume kube-api-access-24v65 for pod openshift-network-diagnostics/network-check-target-p2kwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:27:51.545877 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:51.545864    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65 podName:562374d2-5897-4f0a-86b5-0d13689d70fa nodeName:}" failed. No retries permitted until 2026-07-27 19:27:52.045845774 +0000 UTC m=+89.174209563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-24v65" (UniqueName: "kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65") pod "network-check-target-p2kwp" (UID: "562374d2-5897-4f0a-86b5-0d13689d70fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:27:51.548123 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.548104    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbc7k\" (UniqueName: \"kubernetes.io/projected/8f664404-7594-4137-8e24-27ff3689a210-kube-api-access-rbc7k\") pod \"node-resolver-9hjwq\" (UID: \"8f664404-7594-4137-8e24-27ff3689a210\") " pod="openshift-dns/node-resolver-9hjwq"
Jul 27 19:27:51.548195 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.548130    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpjc4\" (UniqueName: \"kubernetes.io/projected/80fa6490-c0f5-41d6-bf0a-a5d1de4537d0-kube-api-access-wpjc4\") pod \"ovnkube-node-d2tm8\" (UID: \"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.548337 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.548322    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bn4w\" (UniqueName: \"kubernetes.io/projected/b24a2662-243e-418c-9933-60326769bf3a-kube-api-access-6bn4w\") pod \"aws-ebs-csi-driver-node-cqqbw\" (UID: \"b24a2662-243e-418c-9933-60326769bf3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.548606 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.548585    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fjzx\" (UniqueName: \"kubernetes.io/projected/90259da6-ff35-437b-a596-853d2a96bc12-kube-api-access-9fjzx\") pod \"node-ca-5jr4b\" (UID: \"90259da6-ff35-437b-a596-853d2a96bc12\") " pod="openshift-image-registry/node-ca-5jr4b"
Jul 27 19:27:51.549610 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.549592    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nm4v\" (UniqueName: \"kubernetes.io/projected/c782a78c-3c18-4684-aac1-41c516961e11-kube-api-access-8nm4v\") pod \"iptables-alerter-jhrr7\" (UID: \"c782a78c-3c18-4684-aac1-41c516961e11\") " pod="openshift-network-operator/iptables-alerter-jhrr7"
Jul 27 19:27:51.567348 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.567330    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s6bhg"
Jul 27 19:27:51.573528 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.573505    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:27:51.578388 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:27:51.578357    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13ef0d06_a352_4060_84ff_a0f6f76d745e.slice/crio-1f3598e32e143222f9b91e5bd2bdfbe09326c50400750960b10ff7fb14c8e9eb WatchSource:0}: Error finding container 1f3598e32e143222f9b91e5bd2bdfbe09326c50400750960b10ff7fb14c8e9eb: Status 404 returned error can't find the container with id 1f3598e32e143222f9b91e5bd2bdfbe09326c50400750960b10ff7fb14c8e9eb
Jul 27 19:27:51.579215 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.579198    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw"
Jul 27 19:27:51.583623 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:27:51.583598    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80fa6490_c0f5_41d6_bf0a_a5d1de4537d0.slice/crio-85d198abdefc76c4e34526cfea7809848658d2f4acdc2a6cc682ce9ad445f0d2 WatchSource:0}: Error finding container 85d198abdefc76c4e34526cfea7809848658d2f4acdc2a6cc682ce9ad445f0d2: Status 404 returned error can't find the container with id 85d198abdefc76c4e34526cfea7809848658d2f4acdc2a6cc682ce9ad445f0d2
Jul 27 19:27:51.586100 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.586074    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4ljfw"
Jul 27 19:27:51.589024 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:27:51.588998    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb24a2662_243e_418c_9933_60326769bf3a.slice/crio-56f6a1805d006d40816e45e10b9b95e6275ca06d0cfb65ba4a9024f46042d147 WatchSource:0}: Error finding container 56f6a1805d006d40816e45e10b9b95e6275ca06d0cfb65ba4a9024f46042d147: Status 404 returned error can't find the container with id 56f6a1805d006d40816e45e10b9b95e6275ca06d0cfb65ba4a9024f46042d147
Jul 27 19:27:51.590946 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.590925    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9zv9c"
Jul 27 19:27:51.594398 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:27:51.594380    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a14be9a_be34_4ab7_b669_e84cf323d3db.slice/crio-f69f78dbe74e26e2c00a6bf14b34aa569da9ce6a398714d4afe29fc062532420 WatchSource:0}: Error finding container f69f78dbe74e26e2c00a6bf14b34aa569da9ce6a398714d4afe29fc062532420: Status 404 returned error can't find the container with id f69f78dbe74e26e2c00a6bf14b34aa569da9ce6a398714d4afe29fc062532420
Jul 27 19:27:51.595480 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.595461    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5jr4b"
Jul 27 19:27:51.600555 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:27:51.600533    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa7739f_0905_421b_89b3_857fee7c68d9.slice/crio-74f8daa419f2b19a5bcb36b4892f7b637d840c350eb0f2896e9398e93efceb7e WatchSource:0}: Error finding container 74f8daa419f2b19a5bcb36b4892f7b637d840c350eb0f2896e9398e93efceb7e: Status 404 returned error can't find the container with id 74f8daa419f2b19a5bcb36b4892f7b637d840c350eb0f2896e9398e93efceb7e
Jul 27 19:27:51.601150 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.601132    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jhrr7"
Jul 27 19:27:51.605283 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:27:51.605263    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90259da6_ff35_437b_a596_853d2a96bc12.slice/crio-c038434f1276ccda7de2e04676b778fc2dc84ad6bce700df27d7dcf0eb39e87b WatchSource:0}: Error finding container c038434f1276ccda7de2e04676b778fc2dc84ad6bce700df27d7dcf0eb39e87b: Status 404 returned error can't find the container with id c038434f1276ccda7de2e04676b778fc2dc84ad6bce700df27d7dcf0eb39e87b
Jul 27 19:27:51.606067 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.606039    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9hjwq"
Jul 27 19:27:51.609464 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:27:51.609447    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc782a78c_3c18_4684_aac1_41c516961e11.slice/crio-72a25ea435ec66a4041b72536308901d4f2c15f1192a0df6fef1371db1a47a2c WatchSource:0}: Error finding container 72a25ea435ec66a4041b72536308901d4f2c15f1192a0df6fef1371db1a47a2c: Status 404 returned error can't find the container with id 72a25ea435ec66a4041b72536308901d4f2c15f1192a0df6fef1371db1a47a2c
Jul 27 19:27:51.610383 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:51.610339    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xgzv4"
Jul 27 19:27:51.615361 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:27:51.615340    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f664404_7594_4137_8e24_27ff3689a210.slice/crio-fce7b8a44c550f79a743b45bb4971ffc97da5b78230ea2a15bca6bd2584c1013 WatchSource:0}: Error finding container fce7b8a44c550f79a743b45bb4971ffc97da5b78230ea2a15bca6bd2584c1013: Status 404 returned error can't find the container with id fce7b8a44c550f79a743b45bb4971ffc97da5b78230ea2a15bca6bd2584c1013
Jul 27 19:27:51.621233 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:27:51.621215    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ca0d2d_d38c_46cb_9d80_ad52098df555.slice/crio-84d2f683a6867447109cde265a91f07e33c8d65570e998b108f8a6ed5486dd8a WatchSource:0}: Error finding container 84d2f683a6867447109cde265a91f07e33c8d65570e998b108f8a6ed5486dd8a: Status 404 returned error can't find the container with id 84d2f683a6867447109cde265a91f07e33c8d65570e998b108f8a6ed5486dd8a
Jul 27 19:27:52.020901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:52.020867    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs\") pod \"network-metrics-daemon-drqtg\" (UID: \"a635d151-c940-4f0c-bd3c-69e8fdf67942\") " pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:27:52.021111 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:52.020949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret\") pod \"global-pull-secret-syncer-m8s7m\" (UID: \"4493ab60-935e-4993-800b-a69eccd1cc16\") " pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:27:52.021111 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:52.021080    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:27:52.021226 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:52.021137    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret podName:4493ab60-935e-4993-800b-a69eccd1cc16 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:53.021123677 +0000 UTC m=+90.149487451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret") pod "global-pull-secret-syncer-m8s7m" (UID: "4493ab60-935e-4993-800b-a69eccd1cc16") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:27:52.021226 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:52.021209    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:27:52.021331 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:52.021273    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs podName:a635d151-c940-4f0c-bd3c-69e8fdf67942 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:53.021254103 +0000 UTC m=+90.149617890 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs") pod "network-metrics-daemon-drqtg" (UID: "a635d151-c940-4f0c-bd3c-69e8fdf67942") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:27:52.121721 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:52.121687    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24v65\" (UniqueName: \"kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65\") pod \"network-check-target-p2kwp\" (UID: \"562374d2-5897-4f0a-86b5-0d13689d70fa\") " pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:27:52.121900 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:52.121860    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:27:52.121900 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:52.121877    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:27:52.121900 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:52.121886    2578 projected.go:196] Error preparing data for projected volume kube-api-access-24v65 for pod openshift-network-diagnostics/network-check-target-p2kwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:27:52.122048 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:52.121934    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65 podName:562374d2-5897-4f0a-86b5-0d13689d70fa nodeName:}" failed. No retries permitted until 2026-07-27 19:27:53.121918205 +0000 UTC m=+90.250281981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-24v65" (UniqueName: "kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65") pod "network-check-target-p2kwp" (UID: "562374d2-5897-4f0a-86b5-0d13689d70fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:27:52.333904 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:52.333860    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:22:51 +0000 UTC" deadline="2028-04-27 07:39:23.037830652 +0000 UTC"
Jul 27 19:27:52.333904 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:52.333902    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15348h11m30.70393356s"
Jul 27 19:27:52.377523 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:52.377488    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:27:52.377723 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:52.377643    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:27:52.543349 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:52.543207    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4ljfw" event={"ID":"9a14be9a-be34-4ab7-b669-e84cf323d3db","Type":"ContainerStarted","Data":"f69f78dbe74e26e2c00a6bf14b34aa569da9ce6a398714d4afe29fc062532420"}
Jul 27 19:27:52.549995 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:52.549884    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw" event={"ID":"b24a2662-243e-418c-9933-60326769bf3a","Type":"ContainerStarted","Data":"56f6a1805d006d40816e45e10b9b95e6275ca06d0cfb65ba4a9024f46042d147"}
Jul 27 19:27:52.564562 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:52.564521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8" event={"ID":"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0","Type":"ContainerStarted","Data":"85d198abdefc76c4e34526cfea7809848658d2f4acdc2a6cc682ce9ad445f0d2"}
Jul 27 19:27:52.577720 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:52.577680    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s6bhg" event={"ID":"13ef0d06-a352-4060-84ff-a0f6f76d745e","Type":"ContainerStarted","Data":"1f3598e32e143222f9b91e5bd2bdfbe09326c50400750960b10ff7fb14c8e9eb"}
Jul 27 19:27:52.589773 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:52.589612    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xgzv4" event={"ID":"e3ca0d2d-d38c-46cb-9d80-ad52098df555","Type":"ContainerStarted","Data":"84d2f683a6867447109cde265a91f07e33c8d65570e998b108f8a6ed5486dd8a"}
Jul 27 19:27:52.591655 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:52.591614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jhrr7" event={"ID":"c782a78c-3c18-4684-aac1-41c516961e11","Type":"ContainerStarted","Data":"72a25ea435ec66a4041b72536308901d4f2c15f1192a0df6fef1371db1a47a2c"}
Jul 27 19:27:52.594694 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:52.594663    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9zv9c" event={"ID":"2fa7739f-0905-421b-89b3-857fee7c68d9","Type":"ContainerStarted","Data":"74f8daa419f2b19a5bcb36b4892f7b637d840c350eb0f2896e9398e93efceb7e"}
Jul 27 19:27:52.596855 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:52.596807    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9hjwq" event={"ID":"8f664404-7594-4137-8e24-27ff3689a210","Type":"ContainerStarted","Data":"fce7b8a44c550f79a743b45bb4971ffc97da5b78230ea2a15bca6bd2584c1013"}
Jul 27 19:27:52.604459 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:52.604423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5jr4b" event={"ID":"90259da6-ff35-437b-a596-853d2a96bc12","Type":"ContainerStarted","Data":"c038434f1276ccda7de2e04676b778fc2dc84ad6bce700df27d7dcf0eb39e87b"}
Jul 27 19:27:53.032669 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:53.032634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret\") pod \"global-pull-secret-syncer-m8s7m\" (UID: \"4493ab60-935e-4993-800b-a69eccd1cc16\") " pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:27:53.032848 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:53.032705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs\") pod \"network-metrics-daemon-drqtg\" (UID: \"a635d151-c940-4f0c-bd3c-69e8fdf67942\") " pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:27:53.032848 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:53.032817    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:27:53.032848 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:53.032831    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:27:53.033014 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:53.032887    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs podName:a635d151-c940-4f0c-bd3c-69e8fdf67942 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:55.032869503 +0000 UTC m=+92.161233280 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs") pod "network-metrics-daemon-drqtg" (UID: "a635d151-c940-4f0c-bd3c-69e8fdf67942") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:27:53.033014 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:53.032903    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret podName:4493ab60-935e-4993-800b-a69eccd1cc16 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:55.032894413 +0000 UTC m=+92.161258194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret") pod "global-pull-secret-syncer-m8s7m" (UID: "4493ab60-935e-4993-800b-a69eccd1cc16") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:27:53.133931 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:53.133887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24v65\" (UniqueName: \"kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65\") pod \"network-check-target-p2kwp\" (UID: \"562374d2-5897-4f0a-86b5-0d13689d70fa\") " pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:27:53.134153 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:53.134112    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:27:53.134153 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:53.134137    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:27:53.134153 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:53.134151    2578 projected.go:196] Error preparing data for projected volume kube-api-access-24v65 for pod openshift-network-diagnostics/network-check-target-p2kwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:27:53.134315 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:53.134212    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65 podName:562374d2-5897-4f0a-86b5-0d13689d70fa nodeName:}" failed. No retries permitted until 2026-07-27 19:27:55.134192938 +0000 UTC m=+92.262556722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-24v65" (UniqueName: "kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65") pod "network-check-target-p2kwp" (UID: "562374d2-5897-4f0a-86b5-0d13689d70fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:27:53.334964 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:53.334850    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:22:51 +0000 UTC" deadline="2028-03-24 08:02:24.257904256 +0000 UTC"
Jul 27 19:27:53.334964 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:53.334914    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14532h34m30.922994364s"
Jul 27 19:27:53.385297 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:53.385252    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:27:53.385297 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:53.385283    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:27:53.385613 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:53.385447    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2kwp" podUID="562374d2-5897-4f0a-86b5-0d13689d70fa"
Jul 27 19:27:53.385674 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:53.385634    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8s7m" podUID="4493ab60-935e-4993-800b-a69eccd1cc16"
Jul 27 19:27:54.378806 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:54.378270    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:27:54.378806 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:54.378452    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:27:55.052459 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:55.052417    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs\") pod \"network-metrics-daemon-drqtg\" (UID: \"a635d151-c940-4f0c-bd3c-69e8fdf67942\") " pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:27:55.052655 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:55.052506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret\") pod \"global-pull-secret-syncer-m8s7m\" (UID: \"4493ab60-935e-4993-800b-a69eccd1cc16\") " pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:27:55.052733 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:55.052655    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:27:55.052733 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:55.052719    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret podName:4493ab60-935e-4993-800b-a69eccd1cc16 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:59.052701137 +0000 UTC m=+96.181064937 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret") pod "global-pull-secret-syncer-m8s7m" (UID: "4493ab60-935e-4993-800b-a69eccd1cc16") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:27:55.052957 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:55.052864    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:27:55.052957 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:55.052905    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs podName:a635d151-c940-4f0c-bd3c-69e8fdf67942 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:59.052891393 +0000 UTC m=+96.181255173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs") pod "network-metrics-daemon-drqtg" (UID: "a635d151-c940-4f0c-bd3c-69e8fdf67942") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:27:55.153256 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:55.153151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24v65\" (UniqueName: \"kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65\") pod \"network-check-target-p2kwp\" (UID: \"562374d2-5897-4f0a-86b5-0d13689d70fa\") " pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:27:55.153446 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:55.153319    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:27:55.153446 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:55.153344    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:27:55.153446 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:55.153357    2578 projected.go:196] Error preparing data for projected volume kube-api-access-24v65 for pod openshift-network-diagnostics/network-check-target-p2kwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:27:55.153446 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:55.153416    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65 podName:562374d2-5897-4f0a-86b5-0d13689d70fa nodeName:}" failed. No retries permitted until 2026-07-27 19:27:59.153395994 +0000 UTC m=+96.281759786 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-24v65" (UniqueName: "kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65") pod "network-check-target-p2kwp" (UID: "562374d2-5897-4f0a-86b5-0d13689d70fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:27:55.380711 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:55.380236    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:27:55.380711 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:55.380375    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2kwp" podUID="562374d2-5897-4f0a-86b5-0d13689d70fa"
Jul 27 19:27:55.380711 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:55.380418    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:27:55.380711 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:55.380537    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8s7m" podUID="4493ab60-935e-4993-800b-a69eccd1cc16"
Jul 27 19:27:56.377438 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:56.376872    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:27:56.377438 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:56.377024    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:27:57.377265 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:57.377173    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:27:57.377731 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:57.377173    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:27:57.377731 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:57.377306    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8s7m" podUID="4493ab60-935e-4993-800b-a69eccd1cc16"
Jul 27 19:27:57.377731 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:57.377467    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2kwp" podUID="562374d2-5897-4f0a-86b5-0d13689d70fa"
Jul 27 19:27:58.377427 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:58.377390    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:27:58.377890 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:58.377520    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:27:59.087986 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:59.087951    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret\") pod \"global-pull-secret-syncer-m8s7m\" (UID: \"4493ab60-935e-4993-800b-a69eccd1cc16\") " pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:27:59.088212 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:59.088024    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs\") pod \"network-metrics-daemon-drqtg\" (UID: \"a635d151-c940-4f0c-bd3c-69e8fdf67942\") " pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:27:59.088212 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:59.088164    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:27:59.088212 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:59.088213    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs podName:a635d151-c940-4f0c-bd3c-69e8fdf67942 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:07.088199984 +0000 UTC m=+104.216563758 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs") pod "network-metrics-daemon-drqtg" (UID: "a635d151-c940-4f0c-bd3c-69e8fdf67942") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:27:59.088496 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:59.088458    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:27:59.088599 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:59.088534    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret podName:4493ab60-935e-4993-800b-a69eccd1cc16 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:07.088516916 +0000 UTC m=+104.216880708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret") pod "global-pull-secret-syncer-m8s7m" (UID: "4493ab60-935e-4993-800b-a69eccd1cc16") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:27:59.189038 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:59.188984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24v65\" (UniqueName: \"kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65\") pod \"network-check-target-p2kwp\" (UID: \"562374d2-5897-4f0a-86b5-0d13689d70fa\") " pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:27:59.189224 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:59.189148    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:27:59.189224 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:59.189167    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:27:59.189224 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:59.189178    2578 projected.go:196] Error preparing data for projected volume kube-api-access-24v65 for pod openshift-network-diagnostics/network-check-target-p2kwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:27:59.189375 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:59.189241    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65 podName:562374d2-5897-4f0a-86b5-0d13689d70fa nodeName:}" failed. No retries permitted until 2026-07-27 19:28:07.189225696 +0000 UTC m=+104.317589471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-24v65" (UniqueName: "kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65") pod "network-check-target-p2kwp" (UID: "562374d2-5897-4f0a-86b5-0d13689d70fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:27:59.379881 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:59.379167    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:27:59.379881 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:59.379300    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2kwp" podUID="562374d2-5897-4f0a-86b5-0d13689d70fa"
Jul 27 19:27:59.379881 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:27:59.379687    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:27:59.379881 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:27:59.379776    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8s7m" podUID="4493ab60-935e-4993-800b-a69eccd1cc16"
Jul 27 19:28:00.377499 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:00.377462    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:28:00.377699 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:00.377625    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:28:01.377518 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:01.377481    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:01.377518 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:01.377526    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:01.378076 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:01.377648    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8s7m" podUID="4493ab60-935e-4993-800b-a69eccd1cc16"
Jul 27 19:28:01.378076 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:01.377747    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2kwp" podUID="562374d2-5897-4f0a-86b5-0d13689d70fa"
Jul 27 19:28:02.377876 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:02.377792    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:28:02.378365 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:02.377937    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:28:03.378550 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:03.378513    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:03.379021 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:03.378600    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:03.379021 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:03.378607    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2kwp" podUID="562374d2-5897-4f0a-86b5-0d13689d70fa"
Jul 27 19:28:03.379021 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:03.378704    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8s7m" podUID="4493ab60-935e-4993-800b-a69eccd1cc16"
Jul 27 19:28:03.379253 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:03.379230    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 40s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator(d6746e0202d8b715f80728def55766a0)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" podUID="d6746e0202d8b715f80728def55766a0"
Jul 27 19:28:04.377123 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:04.377088    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:28:04.377284 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:04.377241    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:28:05.377156 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:05.377120    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:05.377156 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:05.377120    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:05.377682 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:05.377385    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8s7m" podUID="4493ab60-935e-4993-800b-a69eccd1cc16"
Jul 27 19:28:05.377682 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:05.377408    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2kwp" podUID="562374d2-5897-4f0a-86b5-0d13689d70fa"
Jul 27 19:28:06.377733 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:06.377692    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:28:06.378258 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:06.377832    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:28:07.150393 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:07.150356    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret\") pod \"global-pull-secret-syncer-m8s7m\" (UID: \"4493ab60-935e-4993-800b-a69eccd1cc16\") " pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:07.150577 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:07.150425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs\") pod \"network-metrics-daemon-drqtg\" (UID: \"a635d151-c940-4f0c-bd3c-69e8fdf67942\") " pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:28:07.150577 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:07.150535    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:28:07.150577 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:07.150537    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:28:07.150693 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:07.150598    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret podName:4493ab60-935e-4993-800b-a69eccd1cc16 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:23.15057894 +0000 UTC m=+120.278942715 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret") pod "global-pull-secret-syncer-m8s7m" (UID: "4493ab60-935e-4993-800b-a69eccd1cc16") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:28:07.150693 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:07.150625    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs podName:a635d151-c940-4f0c-bd3c-69e8fdf67942 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:23.150615062 +0000 UTC m=+120.278978837 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs") pod "network-metrics-daemon-drqtg" (UID: "a635d151-c940-4f0c-bd3c-69e8fdf67942") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:28:07.251534 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:07.251492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24v65\" (UniqueName: \"kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65\") pod \"network-check-target-p2kwp\" (UID: \"562374d2-5897-4f0a-86b5-0d13689d70fa\") " pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:07.251712 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:07.251639    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:28:07.251712 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:07.251655    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:28:07.251712 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:07.251664    2578 projected.go:196] Error preparing data for projected volume kube-api-access-24v65 for pod openshift-network-diagnostics/network-check-target-p2kwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:28:07.251865 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:07.251715    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65 podName:562374d2-5897-4f0a-86b5-0d13689d70fa nodeName:}" failed. No retries permitted until 2026-07-27 19:28:23.251701416 +0000 UTC m=+120.380065194 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-24v65" (UniqueName: "kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65") pod "network-check-target-p2kwp" (UID: "562374d2-5897-4f0a-86b5-0d13689d70fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:28:07.377349 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:07.377314    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:07.377529 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:07.377451    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2kwp" podUID="562374d2-5897-4f0a-86b5-0d13689d70fa"
Jul 27 19:28:07.377924 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:07.377769    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:07.377924 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:07.377888    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8s7m" podUID="4493ab60-935e-4993-800b-a69eccd1cc16"
Jul 27 19:28:08.376989 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:08.376960    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:28:08.377280 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:08.377109    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:28:09.377349 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:09.377309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:09.377866 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:09.377483    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2kwp" podUID="562374d2-5897-4f0a-86b5-0d13689d70fa"
Jul 27 19:28:09.377866 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:09.377555    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:09.377866 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:09.377673    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8s7m" podUID="4493ab60-935e-4993-800b-a69eccd1cc16"
Jul 27 19:28:10.378511 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:10.378013    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:28:10.378511 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:10.378173    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:28:10.649916 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:10.649723    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9hjwq" event={"ID":"8f664404-7594-4137-8e24-27ff3689a210","Type":"ContainerStarted","Data":"b7bdc53caab1d3f19cc0ae083c3c6aca31f890e2429a9a180e75e188e985e4b5"}
Jul 27 19:28:10.651346 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:10.651317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5jr4b" event={"ID":"90259da6-ff35-437b-a596-853d2a96bc12","Type":"ContainerStarted","Data":"2fc3877817e037c30be8f16e1305203e2442bf6a24077e70af5dcc79fcb8f12a"}
Jul 27 19:28:10.652783 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:10.652755    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4ljfw" event={"ID":"9a14be9a-be34-4ab7-b669-e84cf323d3db","Type":"ContainerStarted","Data":"733bfa4854dc368ce58d8c2efb387b9b1a5990d4e0c0d290b4bd89d2d7cc787e"}
Jul 27 19:28:10.654245 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:10.654220    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw" event={"ID":"b24a2662-243e-418c-9933-60326769bf3a","Type":"ContainerStarted","Data":"cc4b4ded0f4bcee8223eae07b7c95e32f87cc6d363ece73e316a0d0afd3dce65"}
Jul 27 19:28:10.656104 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:10.656049    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8" event={"ID":"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0","Type":"ContainerStarted","Data":"6be6932103ffd18e06ea7ba73a934c21d0556aef9b0ad1855ee1acdd0830de70"}
Jul 27 19:28:10.656210 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:10.656150    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8" event={"ID":"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0","Type":"ContainerStarted","Data":"8fc6c4824deea64d7e8d87f8777ce5c008bc8007d28380eac166afcbdbddc119"}
Jul 27 19:28:10.656210 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:10.656197    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8" event={"ID":"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0","Type":"ContainerStarted","Data":"6b541d29d49b22943be1e7f170a5203d2688ee090237b5cd72720c00689171e7"}
Jul 27 19:28:10.657653 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:10.657617    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s6bhg" event={"ID":"13ef0d06-a352-4060-84ff-a0f6f76d745e","Type":"ContainerStarted","Data":"66a9b8af84f8dc8dc3e400fb262de3da58304490f2ef5f77d3fc8dd23b0accbe"}
Jul 27 19:28:10.659226 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:10.659130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xgzv4" event={"ID":"e3ca0d2d-d38c-46cb-9d80-ad52098df555","Type":"ContainerStarted","Data":"a3d36685a309ee07530a2af055193ddcc1d6444a0b5eef7ef0a8f32d57cffabc"}
Jul 27 19:28:10.660684 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:10.660662    2578 generic.go:356] "Generic (PLEG): container finished" podID="2fa7739f-0905-421b-89b3-857fee7c68d9" containerID="a837fff7c9ccb1e6a4aa1847d97c680e3836026ee46caa13f99107f633efe248" exitCode=0
Jul 27 19:28:10.660765 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:10.660690    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9zv9c" event={"ID":"2fa7739f-0905-421b-89b3-857fee7c68d9","Type":"ContainerDied","Data":"a837fff7c9ccb1e6a4aa1847d97c680e3836026ee46caa13f99107f633efe248"}
Jul 27 19:28:10.665202 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:10.665009    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9hjwq" podStartSLOduration=33.994287717 podStartE2EDuration="52.664997391s" totalImagesPullingTime="18.670709674s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:10.664554503 +0000 UTC m=+107.792918298" watchObservedRunningTime="2026-07-27 19:28:10.664997391 +0000 UTC m=+107.793361187"
Jul 27 19:28:10.683183 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:10.683146    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xgzv4" podStartSLOduration=42.231608776 podStartE2EDuration="52.683133772s" totalImagesPullingTime="10.451524996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:10.682871786 +0000 UTC m=+107.811235582" watchObservedRunningTime="2026-07-27 19:28:10.683133772 +0000 UTC m=+107.811497567"
Jul 27 19:28:10.700971 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:10.700932    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4ljfw" podStartSLOduration=33.993513578 podStartE2EDuration="52.700916173s" totalImagesPullingTime="18.707402595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:10.700890234 +0000 UTC m=+107.829254029" watchObservedRunningTime="2026-07-27 19:28:10.700916173 +0000 UTC m=+107.829279969"
Jul 27 19:28:10.736284 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:10.736245    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5jr4b" podStartSLOduration=34.080703075 podStartE2EDuration="52.73623047s" totalImagesPullingTime="18.655527395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:10.736027034 +0000 UTC m=+107.864390829" watchObservedRunningTime="2026-07-27 19:28:10.73623047 +0000 UTC m=+107.864594266"
Jul 27 19:28:10.752652 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:10.752612    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s6bhg" podStartSLOduration=34.041074915 podStartE2EDuration="52.752595913s" totalImagesPullingTime="18.711520998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:10.75243394 +0000 UTC m=+107.880797737" watchObservedRunningTime="2026-07-27 19:28:10.752595913 +0000 UTC m=+107.880959709"
Jul 27 19:28:11.312652 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:11.312593    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 19:28:11.355280 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:11.355169    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T19:28:11.31261751Z","UUID":"aab6c95b-a5b3-40d2-a4a0-7f1e9f7d1f28","Handler":null,"Name":"","Endpoint":""}
Jul 27 19:28:11.356814 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:11.356789    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 19:28:11.356965 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:11.356829    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 19:28:11.377123 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:11.377090    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:11.377310 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:11.377090    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:11.377310 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:11.377209    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8s7m" podUID="4493ab60-935e-4993-800b-a69eccd1cc16"
Jul 27 19:28:11.377310 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:11.377298    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2kwp" podUID="562374d2-5897-4f0a-86b5-0d13689d70fa"
Jul 27 19:28:11.610599 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:11.610563    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xgzv4"
Jul 27 19:28:11.611286 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:11.611269    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xgzv4"
Jul 27 19:28:11.664911 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:11.664864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw" event={"ID":"b24a2662-243e-418c-9933-60326769bf3a","Type":"ContainerStarted","Data":"fd14f5055f0154a5cb02473f921f29a108a82314a73ecee3cb80e98f2eb50ecf"}
Jul 27 19:28:11.670151 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:11.670115    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8" event={"ID":"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0","Type":"ContainerStarted","Data":"0a29e10e3fc72f15f2d3e629d99e179eb9f73a6b0e576b8bdb4f107d551c427e"}
Jul 27 19:28:11.670341 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:11.670207    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8" event={"ID":"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0","Type":"ContainerStarted","Data":"39f1016714da71ea147ad27793ad5bad69b6df39b38a318b49eac13b2b71e74e"}
Jul 27 19:28:11.670971 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:11.670948    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xgzv4"
Jul 27 19:28:11.671088 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:11.671001    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8" event={"ID":"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0","Type":"ContainerStarted","Data":"f47b15c9eb67186bda2b6eeadbb4b1301f75614eb8ce321d8b5d2b4428a31da1"}
Jul 27 19:28:11.671150 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:11.671086    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xgzv4"
Jul 27 19:28:12.377073 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:12.377029    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:28:12.377210 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:12.377177    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:28:12.675172 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:12.675081    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw" event={"ID":"b24a2662-243e-418c-9933-60326769bf3a","Type":"ContainerStarted","Data":"9d122905c2fab50d9fc38087e057ac516de57106839af31f33ca89b80466c37c"}
Jul 27 19:28:12.676941 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:12.676913    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jhrr7" event={"ID":"c782a78c-3c18-4684-aac1-41c516961e11","Type":"ContainerStarted","Data":"2715c449ebc189985a073f3f8345fa54f8dc000eb46880b6baab1ea84e18575b"}
Jul 27 19:28:12.692610 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:12.692549    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqqbw" podStartSLOduration=34.211552076 podStartE2EDuration="54.69253055s" totalImagesPullingTime="20.480978474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:27:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:12.692429787 +0000 UTC m=+109.820793584" watchObservedRunningTime="2026-07-27 19:28:12.69253055 +0000 UTC m=+109.820894343"
Jul 27 19:28:12.705980 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:12.705935    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jhrr7" podStartSLOduration=36.055402761 podStartE2EDuration="54.705919859s" totalImagesPullingTime="18.650517098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:12.705622709 +0000 UTC m=+109.833986508" watchObservedRunningTime="2026-07-27 19:28:12.705919859 +0000 UTC m=+109.834283656"
Jul 27 19:28:13.378706 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:13.378672    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:13.378898 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:13.378778    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2kwp" podUID="562374d2-5897-4f0a-86b5-0d13689d70fa"
Jul 27 19:28:13.378898 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:13.378832    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:13.379016 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:13.378917    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8s7m" podUID="4493ab60-935e-4993-800b-a69eccd1cc16"
Jul 27 19:28:13.682535 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:13.682405    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8" event={"ID":"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0","Type":"ContainerStarted","Data":"05393a7cf7509f5df60cdc7d3b0d4bc950d017d48b663c1ee9c0258cc5127e4a"}
Jul 27 19:28:14.377003 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:14.376961    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:28:14.377198 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:14.377134    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:28:15.381234 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:15.380954    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:15.381778 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:15.380998    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:15.381778 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:15.381356    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8s7m" podUID="4493ab60-935e-4993-800b-a69eccd1cc16"
Jul 27 19:28:15.381778 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:15.381406    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2kwp" podUID="562374d2-5897-4f0a-86b5-0d13689d70fa"
Jul 27 19:28:15.689468 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:15.689424    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8" event={"ID":"80fa6490-c0f5-41d6-bf0a-a5d1de4537d0","Type":"ContainerStarted","Data":"e44126257164844c427e881bdee34529c2e949392600d36a90651e0cc4ae3e47"}
Jul 27 19:28:15.689737 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:15.689655    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:28:15.689737 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:15.689718    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:28:15.691255 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:15.691228    2578 generic.go:356] "Generic (PLEG): container finished" podID="2fa7739f-0905-421b-89b3-857fee7c68d9" containerID="b32b935a911b3325b8320659735c52f556eb217788479b256bf6c30901fd0f55" exitCode=0
Jul 27 19:28:15.691381 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:15.691269    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9zv9c" event={"ID":"2fa7739f-0905-421b-89b3-857fee7c68d9","Type":"ContainerDied","Data":"b32b935a911b3325b8320659735c52f556eb217788479b256bf6c30901fd0f55"}
Jul 27 19:28:15.708251 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:15.708227    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:28:15.717522 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:15.717477    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8" podStartSLOduration=38.943784435 podStartE2EDuration="57.717465377s" totalImagesPullingTime="18.773680942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:15.7163862 +0000 UTC m=+112.844749996" watchObservedRunningTime="2026-07-27 19:28:15.717465377 +0000 UTC m=+112.845829173"
Jul 27 19:28:16.377346 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:16.377166    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:28:16.377511 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:16.377418    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:28:16.377511 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:16.377415    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 40s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator(d6746e0202d8b715f80728def55766a0)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" podUID="d6746e0202d8b715f80728def55766a0"
Jul 27 19:28:16.694569 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:16.694497    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:28:16.709907 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:16.709881    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:28:17.029499 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:17.029468    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p2kwp"]
Jul 27 19:28:17.029683 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:17.029619    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:17.029777 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:17.029749    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2kwp" podUID="562374d2-5897-4f0a-86b5-0d13689d70fa"
Jul 27 19:28:17.032583 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:17.032557    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m8s7m"]
Jul 27 19:28:17.032713 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:17.032698    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:17.032816 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:17.032798    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8s7m" podUID="4493ab60-935e-4993-800b-a69eccd1cc16"
Jul 27 19:28:17.033152 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:17.033126    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-drqtg"]
Jul 27 19:28:17.033263 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:17.033219    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:28:17.033335 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:17.033319    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:28:17.701172 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:17.701140    2578 generic.go:356] "Generic (PLEG): container finished" podID="2fa7739f-0905-421b-89b3-857fee7c68d9" containerID="e22ebdd1af60e28bb85597ed42673de1c2cddfb711eaa42cf955b66a491d301d" exitCode=0
Jul 27 19:28:17.701935 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:17.701199    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9zv9c" event={"ID":"2fa7739f-0905-421b-89b3-857fee7c68d9","Type":"ContainerDied","Data":"e22ebdd1af60e28bb85597ed42673de1c2cddfb711eaa42cf955b66a491d301d"}
Jul 27 19:28:18.377005 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:18.376975    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:18.377221 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:18.376975    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:28:18.377221 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:18.377089    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2kwp" podUID="562374d2-5897-4f0a-86b5-0d13689d70fa"
Jul 27 19:28:18.377221 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:18.377106    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:18.377221 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:18.377169    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:28:18.377388 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:18.377268    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8s7m" podUID="4493ab60-935e-4993-800b-a69eccd1cc16"
Jul 27 19:28:19.708158 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:19.708118    2578 generic.go:356] "Generic (PLEG): container finished" podID="2fa7739f-0905-421b-89b3-857fee7c68d9" containerID="4d05f260c4c1148c7b0fb2034b8334966c3a6ef9fea06804374e2845034a76e5" exitCode=0
Jul 27 19:28:19.708865 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:19.708216    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9zv9c" event={"ID":"2fa7739f-0905-421b-89b3-857fee7c68d9","Type":"ContainerDied","Data":"4d05f260c4c1148c7b0fb2034b8334966c3a6ef9fea06804374e2845034a76e5"}
Jul 27 19:28:20.377581 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:20.377549    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:20.377581 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:20.377567    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:28:20.377830 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:20.377591    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:20.377830 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:20.377683    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8s7m" podUID="4493ab60-935e-4993-800b-a69eccd1cc16"
Jul 27 19:28:20.377946 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:20.377822    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:28:20.377946 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:20.377920    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2kwp" podUID="562374d2-5897-4f0a-86b5-0d13689d70fa"
Jul 27 19:28:22.377078 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:22.377014    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:22.377497 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:22.377027    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:22.377497 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:22.377170    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2kwp" podUID="562374d2-5897-4f0a-86b5-0d13689d70fa"
Jul 27 19:28:22.377497 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:22.377231    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8s7m" podUID="4493ab60-935e-4993-800b-a69eccd1cc16"
Jul 27 19:28:22.377497 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:22.377036    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:28:22.377497 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:22.377308    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drqtg" podUID="a635d151-c940-4f0c-bd3c-69e8fdf67942"
Jul 27 19:28:23.168115 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:23.168071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret\") pod \"global-pull-secret-syncer-m8s7m\" (UID: \"4493ab60-935e-4993-800b-a69eccd1cc16\") " pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:23.168312 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:23.168145    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs\") pod \"network-metrics-daemon-drqtg\" (UID: \"a635d151-c940-4f0c-bd3c-69e8fdf67942\") " pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:28:23.168312 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:23.168229    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:28:23.168312 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:23.168271    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:28:23.168312 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:23.168298    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret podName:4493ab60-935e-4993-800b-a69eccd1cc16 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:55.168282258 +0000 UTC m=+152.296646032 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret") pod "global-pull-secret-syncer-m8s7m" (UID: "4493ab60-935e-4993-800b-a69eccd1cc16") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:28:23.168482 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:23.168319    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs podName:a635d151-c940-4f0c-bd3c-69e8fdf67942 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:55.168304455 +0000 UTC m=+152.296668229 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs") pod "network-metrics-daemon-drqtg" (UID: "a635d151-c940-4f0c-bd3c-69e8fdf67942") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:28:23.214926 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:23.214892    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-24.ec2.internal" event="NodeReady"
Jul 27 19:28:23.215127 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:23.215071    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 19:28:23.268526 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:23.268484    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24v65\" (UniqueName: \"kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65\") pod \"network-check-target-p2kwp\" (UID: \"562374d2-5897-4f0a-86b5-0d13689d70fa\") " pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:23.268716 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:23.268671    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:28:23.268716 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:23.268697    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:28:23.268716 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:23.268710    2578 projected.go:196] Error preparing data for projected volume kube-api-access-24v65 for pod openshift-network-diagnostics/network-check-target-p2kwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:28:23.268863 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:23.268776    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65 podName:562374d2-5897-4f0a-86b5-0d13689d70fa nodeName:}" failed. No retries permitted until 2026-07-27 19:28:55.268757122 +0000 UTC m=+152.397120909 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-24v65" (UniqueName: "kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65") pod "network-check-target-p2kwp" (UID: "562374d2-5897-4f0a-86b5-0d13689d70fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:28:24.377579 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:24.377532    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:28:24.378029 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:24.377580    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:24.378029 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:24.377547    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:24.380577 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:24.380552    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 19:28:24.380695 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:24.380617    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 19:28:24.380695 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:24.380644    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 19:28:24.381612 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:24.381593    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lj4rj\""
Jul 27 19:28:24.381719 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:24.381646    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 19:28:24.381719 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:24.381657    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wght4\""
Jul 27 19:28:24.722675 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:24.722642    2578 generic.go:356] "Generic (PLEG): container finished" podID="2fa7739f-0905-421b-89b3-857fee7c68d9" containerID="a5cec40688d5e45a5a3ad9604cb15382ad9baf308d67428fd5b57fe333182fb9" exitCode=0
Jul 27 19:28:24.722881 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:24.722699    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9zv9c" event={"ID":"2fa7739f-0905-421b-89b3-857fee7c68d9","Type":"ContainerDied","Data":"a5cec40688d5e45a5a3ad9604cb15382ad9baf308d67428fd5b57fe333182fb9"}
Jul 27 19:28:25.727519 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:25.727491    2578 generic.go:356] "Generic (PLEG): container finished" podID="2fa7739f-0905-421b-89b3-857fee7c68d9" containerID="dfc878e98995762b609ef1d2fa405179f98743a2fcde3a6b17090f5339b29f6d" exitCode=0
Jul 27 19:28:25.727909 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:25.727526    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9zv9c" event={"ID":"2fa7739f-0905-421b-89b3-857fee7c68d9","Type":"ContainerDied","Data":"dfc878e98995762b609ef1d2fa405179f98743a2fcde3a6b17090f5339b29f6d"}
Jul 27 19:28:26.736286 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:26.736037    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9zv9c" event={"ID":"2fa7739f-0905-421b-89b3-857fee7c68d9","Type":"ContainerStarted","Data":"fd7664677eeb0dff15e3722488ca765f826462a6cb8e15b09d60dafb4924b698"}
Jul 27 19:28:26.764392 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:26.764339    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9zv9c" podStartSLOduration=38.553248985 podStartE2EDuration="1m8.764323676s" totalImagesPullingTime="30.211074691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:27:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:26.764101458 +0000 UTC m=+123.892465254" watchObservedRunningTime="2026-07-27 19:28:26.764323676 +0000 UTC m=+123.892687472"
Jul 27 19:28:29.377657 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:29.377617    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 40s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator(d6746e0202d8b715f80728def55766a0)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" podUID="d6746e0202d8b715f80728def55766a0"
Jul 27 19:28:43.774357 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:43.774289    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_d6746e0202d8b715f80728def55766a0/setup/3.log"
Jul 27 19:28:43.774357 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:43.774327    2578 generic.go:356] "Generic (PLEG): container finished" podID="d6746e0202d8b715f80728def55766a0" containerID="1d3886ad9c83a86c6fd4ff2836e890e32024d45e3d5c7d08c702e2030653fd39" exitCode=0
Jul 27 19:28:43.774829 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:43.774381    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" event={"ID":"d6746e0202d8b715f80728def55766a0","Type":"ContainerDied","Data":"1d3886ad9c83a86c6fd4ff2836e890e32024d45e3d5c7d08c702e2030653fd39"}
Jul 27 19:28:43.774829 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:43.774427    2578 scope.go:117] "RemoveContainer" containerID="e04ad8487daa8c0f5c021a5f709ec00a860673f177e6a4e2f11372adc9f9c21b"
Jul 27 19:28:43.774829 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:43.774686    2578 scope.go:117] "RemoveContainer" containerID="e04ad8487daa8c0f5c021a5f709ec00a860673f177e6a4e2f11372adc9f9c21b"
Jul 27 19:28:43.804236 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:43.804205    2578 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator_d6746e0202d8b715f80728def55766a0_3 in pod sandbox 5f0a0bccf59d1d59efc8f35aba179726f55711a768106f0049a3df7084828d17 from index: no such id: 'e04ad8487daa8c0f5c021a5f709ec00a860673f177e6a4e2f11372adc9f9c21b'" containerID="e04ad8487daa8c0f5c021a5f709ec00a860673f177e6a4e2f11372adc9f9c21b"
Jul 27 19:28:43.804321 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:43.804256    2578 kuberuntime_container.go:962] "Unhandled Error" err="failed to remove pod init container \"setup\": rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator_d6746e0202d8b715f80728def55766a0_3 in pod sandbox 5f0a0bccf59d1d59efc8f35aba179726f55711a768106f0049a3df7084828d17 from index: no such id: 'e04ad8487daa8c0f5c021a5f709ec00a860673f177e6a4e2f11372adc9f9c21b'; Skipping pod \"kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal_openshift-machine-config-operator(d6746e0202d8b715f80728def55766a0)\"" logger="UnhandledError"
Jul 27 19:28:44.777891 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:44.777856    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" event={"ID":"d6746e0202d8b715f80728def55766a0","Type":"ContainerStarted","Data":"4da91820778dd52066ebbdfd33bf2a45313a02912c43abb48f90347ff6b23578"}
Jul 27 19:28:48.716828 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:48.716801    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2tm8"
Jul 27 19:28:48.743289 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:48.743238    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-24.ec2.internal" podStartSLOduration=58.743220487 podStartE2EDuration="58.743220487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:27:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:44.793960742 +0000 UTC m=+141.922324538" watchObservedRunningTime="2026-07-27 19:28:48.743220487 +0000 UTC m=+145.871584280"
Jul 27 19:28:55.189290 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:55.189234    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret\") pod \"global-pull-secret-syncer-m8s7m\" (UID: \"4493ab60-935e-4993-800b-a69eccd1cc16\") " pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:55.189290 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:55.189308    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs\") pod \"network-metrics-daemon-drqtg\" (UID: \"a635d151-c940-4f0c-bd3c-69e8fdf67942\") " pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:28:55.189965 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:55.189398    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 19:28:55.189965 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:28:55.189462    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs podName:a635d151-c940-4f0c-bd3c-69e8fdf67942 nodeName:}" failed. No retries permitted until 2026-07-27 19:29:59.189446893 +0000 UTC m=+216.317810667 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs") pod "network-metrics-daemon-drqtg" (UID: "a635d151-c940-4f0c-bd3c-69e8fdf67942") : secret "metrics-daemon-secret" not found
Jul 27 19:28:55.193542 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:55.193517    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4493ab60-935e-4993-800b-a69eccd1cc16-original-pull-secret\") pod \"global-pull-secret-syncer-m8s7m\" (UID: \"4493ab60-935e-4993-800b-a69eccd1cc16\") " pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:55.289601 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:55.289558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24v65\" (UniqueName: \"kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65\") pod \"network-check-target-p2kwp\" (UID: \"562374d2-5897-4f0a-86b5-0d13689d70fa\") " pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:55.292173 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:55.292155    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24v65\" (UniqueName: \"kubernetes.io/projected/562374d2-5897-4f0a-86b5-0d13689d70fa-kube-api-access-24v65\") pod \"network-check-target-p2kwp\" (UID: \"562374d2-5897-4f0a-86b5-0d13689d70fa\") " pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:55.292901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:55.292882    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8s7m"
Jul 27 19:28:55.343093 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:55.343044    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:28:55.432879 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:55.432851    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m8s7m"]
Jul 27 19:28:55.473836 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:55.473806    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p2kwp"]
Jul 27 19:28:55.805016 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:55.804978    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p2kwp" event={"ID":"562374d2-5897-4f0a-86b5-0d13689d70fa","Type":"ContainerStarted","Data":"919e06dfa00afd19ccf5bdc8af711645b3e4051b272ea4c210167184b8724bd0"}
Jul 27 19:28:55.806115 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:28:55.806091    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m8s7m" event={"ID":"4493ab60-935e-4993-800b-a69eccd1cc16","Type":"ContainerStarted","Data":"81d10d82ac42cba00001446ee21a80f7057097278a629094c71b94a70d1229c7"}
Jul 27 19:29:00.819859 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:00.819824    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p2kwp" event={"ID":"562374d2-5897-4f0a-86b5-0d13689d70fa","Type":"ContainerStarted","Data":"2b83277bfeed748c2e7a2c12991f6707c8bca19fba14c9c49a6eb3a615ab0299"}
Jul 27 19:29:00.820340 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:00.819954    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:29:00.821391 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:00.821366    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m8s7m" event={"ID":"4493ab60-935e-4993-800b-a69eccd1cc16","Type":"ContainerStarted","Data":"7c5d284e52efef4f9922a2c072d770c2904b29e54925d5de720d7b786be81adb"}
Jul 27 19:29:00.836386 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:00.836342    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p2kwp" podStartSLOduration=98.388378414 podStartE2EDuration="1m42.836327512s" totalImagesPullingTime="4.447949098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:29:00.836012993 +0000 UTC m=+157.964376791" watchObservedRunningTime="2026-07-27 19:29:00.836327512 +0000 UTC m=+157.964691308"
Jul 27 19:29:00.859313 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:00.859258    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-m8s7m" podStartSLOduration=98.366366645 podStartE2EDuration="1m42.85923895s" totalImagesPullingTime="4.492872305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:29:00.858516806 +0000 UTC m=+157.986880604" watchObservedRunningTime="2026-07-27 19:29:00.85923895 +0000 UTC m=+157.987602748"
Jul 27 19:29:24.331689 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.331575    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dzkf2"]
Jul 27 19:29:24.333470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.333431    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hhhqg"]
Jul 27 19:29:24.333618 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.333572    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:24.335194 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.335173    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hhhqg"
Jul 27 19:29:24.336034 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.336015    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nht7b\""
Jul 27 19:29:24.336034 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.336032    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 19:29:24.336167 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.336020    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 19:29:24.337493 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.337463    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mdj99\""
Jul 27 19:29:24.337493 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.337486    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 19:29:24.337665 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.337475    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 19:29:24.337744 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.337726    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 19:29:24.346694 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.346670    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dzkf2"]
Jul 27 19:29:24.349424 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.349402    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hhhqg"]
Jul 27 19:29:24.480682 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.480646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:24.480855 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.480692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-tmp-dir\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:24.480855 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.480718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-config-volume\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:24.480855 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.480796    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6c5w\" (UniqueName: \"kubernetes.io/projected/f0c2d6ea-0e98-401a-a5d9-ca95c9fdbef9-kube-api-access-v6c5w\") pod \"ingress-canary-hhhqg\" (UID: \"f0c2d6ea-0e98-401a-a5d9-ca95c9fdbef9\") " pod="openshift-ingress-canary/ingress-canary-hhhqg"
Jul 27 19:29:24.480855 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.480829    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vq4z\" (UniqueName: \"kubernetes.io/projected/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-kube-api-access-7vq4z\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:24.480855 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.480848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0c2d6ea-0e98-401a-a5d9-ca95c9fdbef9-cert\") pod \"ingress-canary-hhhqg\" (UID: \"f0c2d6ea-0e98-401a-a5d9-ca95c9fdbef9\") " pod="openshift-ingress-canary/ingress-canary-hhhqg"
Jul 27 19:29:24.581822 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.581731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-tmp-dir\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:24.581822 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.581768    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-config-volume\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:24.581822 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.581802    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6c5w\" (UniqueName: \"kubernetes.io/projected/f0c2d6ea-0e98-401a-a5d9-ca95c9fdbef9-kube-api-access-v6c5w\") pod \"ingress-canary-hhhqg\" (UID: \"f0c2d6ea-0e98-401a-a5d9-ca95c9fdbef9\") " pod="openshift-ingress-canary/ingress-canary-hhhqg"
Jul 27 19:29:24.582076 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.581928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vq4z\" (UniqueName: \"kubernetes.io/projected/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-kube-api-access-7vq4z\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:24.582076 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.581966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0c2d6ea-0e98-401a-a5d9-ca95c9fdbef9-cert\") pod \"ingress-canary-hhhqg\" (UID: \"f0c2d6ea-0e98-401a-a5d9-ca95c9fdbef9\") " pod="openshift-ingress-canary/ingress-canary-hhhqg"
Jul 27 19:29:24.582076 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.582009    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:24.582194 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:24.582140    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:29:24.582194 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.582177    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-tmp-dir\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:24.582272 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:24.582197    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls podName:963533dc-5ae0-4aa4-8fbe-6dbe15042d3a nodeName:}" failed. No retries permitted until 2026-07-27 19:29:25.082176907 +0000 UTC m=+182.210540690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls") pod "dns-default-dzkf2" (UID: "963533dc-5ae0-4aa4-8fbe-6dbe15042d3a") : secret "dns-default-metrics-tls" not found
Jul 27 19:29:24.582391 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.582372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-config-volume\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:24.584470 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.584454    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0c2d6ea-0e98-401a-a5d9-ca95c9fdbef9-cert\") pod \"ingress-canary-hhhqg\" (UID: \"f0c2d6ea-0e98-401a-a5d9-ca95c9fdbef9\") " pod="openshift-ingress-canary/ingress-canary-hhhqg"
Jul 27 19:29:24.589992 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.589970    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6c5w\" (UniqueName: \"kubernetes.io/projected/f0c2d6ea-0e98-401a-a5d9-ca95c9fdbef9-kube-api-access-v6c5w\") pod \"ingress-canary-hhhqg\" (UID: \"f0c2d6ea-0e98-401a-a5d9-ca95c9fdbef9\") " pod="openshift-ingress-canary/ingress-canary-hhhqg"
Jul 27 19:29:24.590536 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.590516    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vq4z\" (UniqueName: \"kubernetes.io/projected/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-kube-api-access-7vq4z\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:24.648762 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.648726    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hhhqg"
Jul 27 19:29:24.773297 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.773258    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hhhqg"]
Jul 27 19:29:24.776970 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:29:24.776942    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0c2d6ea_0e98_401a_a5d9_ca95c9fdbef9.slice/crio-95dd82a9bff77bc64dc797c105cedb5c82570b9379fe9435f774430f32265456 WatchSource:0}: Error finding container 95dd82a9bff77bc64dc797c105cedb5c82570b9379fe9435f774430f32265456: Status 404 returned error can't find the container with id 95dd82a9bff77bc64dc797c105cedb5c82570b9379fe9435f774430f32265456
Jul 27 19:29:24.877719 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:24.877624    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hhhqg" event={"ID":"f0c2d6ea-0e98-401a-a5d9-ca95c9fdbef9","Type":"ContainerStarted","Data":"95dd82a9bff77bc64dc797c105cedb5c82570b9379fe9435f774430f32265456"}
Jul 27 19:29:25.085194 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:25.085158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:25.085384 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:25.085283    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:29:25.085384 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:25.085352    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls podName:963533dc-5ae0-4aa4-8fbe-6dbe15042d3a nodeName:}" failed. No retries permitted until 2026-07-27 19:29:26.085332518 +0000 UTC m=+183.213696315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls") pod "dns-default-dzkf2" (UID: "963533dc-5ae0-4aa4-8fbe-6dbe15042d3a") : secret "dns-default-metrics-tls" not found
Jul 27 19:29:26.091805 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:26.091771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:26.092196 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:26.091929    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:29:26.092196 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:26.092011    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls podName:963533dc-5ae0-4aa4-8fbe-6dbe15042d3a nodeName:}" failed. No retries permitted until 2026-07-27 19:29:28.091993168 +0000 UTC m=+185.220356948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls") pod "dns-default-dzkf2" (UID: "963533dc-5ae0-4aa4-8fbe-6dbe15042d3a") : secret "dns-default-metrics-tls" not found
Jul 27 19:29:27.885723 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:27.885685    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hhhqg" event={"ID":"f0c2d6ea-0e98-401a-a5d9-ca95c9fdbef9","Type":"ContainerStarted","Data":"67d8259839e164d6e49ba60cd4bb87626005b5ef06b06cf1b1f9c62933a20098"}
Jul 27 19:29:27.900089 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:27.900026    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hhhqg" podStartSLOduration=1.6941221560000002 podStartE2EDuration="3.900013123s" totalImagesPullingTime="2.205890967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:29:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:29:27.899206551 +0000 UTC m=+185.027570348" watchObservedRunningTime="2026-07-27 19:29:27.900013123 +0000 UTC m=+185.028376919"
Jul 27 19:29:28.105737 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:28.105699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:28.105905 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:28.105859    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:29:28.105963 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:28.105927    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls podName:963533dc-5ae0-4aa4-8fbe-6dbe15042d3a nodeName:}" failed. No retries permitted until 2026-07-27 19:29:32.105907958 +0000 UTC m=+189.234271732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls") pod "dns-default-dzkf2" (UID: "963533dc-5ae0-4aa4-8fbe-6dbe15042d3a") : secret "dns-default-metrics-tls" not found
Jul 27 19:29:31.826031 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:31.825996    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p2kwp"
Jul 27 19:29:32.134148 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:32.134040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:32.134296 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:32.134174    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:29:32.134296 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:32.134236    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls podName:963533dc-5ae0-4aa4-8fbe-6dbe15042d3a nodeName:}" failed. No retries permitted until 2026-07-27 19:29:40.134220327 +0000 UTC m=+197.262584101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls") pod "dns-default-dzkf2" (UID: "963533dc-5ae0-4aa4-8fbe-6dbe15042d3a") : secret "dns-default-metrics-tls" not found
Jul 27 19:29:35.295329 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.295296    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7cqw8"]
Jul 27 19:29:35.322548 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.322512    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7cqw8"]
Jul 27 19:29:35.322692 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.322652    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:35.324939 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.324910    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 19:29:35.325333 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.325074    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 19:29:35.325333 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.325201    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 19:29:35.325962 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.325938    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 19:29:35.326098 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.325990    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bpnh5\""
Jul 27 19:29:35.460920 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.460885    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnlgh\" (UniqueName: \"kubernetes.io/projected/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-api-access-dnlgh\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:35.460920 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.460925    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34cc68b2-cc96-4a1a-965e-0bec23b02330-crio-socket\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:35.461201 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.460947    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34cc68b2-cc96-4a1a-965e-0bec23b02330-data-volume\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:35.461201 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.461014    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:35.461201 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.461044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:35.562454 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.562371    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnlgh\" (UniqueName: \"kubernetes.io/projected/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-api-access-dnlgh\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:35.562454 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.562413    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34cc68b2-cc96-4a1a-965e-0bec23b02330-crio-socket\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:35.562454 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.562433    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34cc68b2-cc96-4a1a-965e-0bec23b02330-data-volume\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:35.562454 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.562450    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:35.562776 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.562468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:35.562776 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.562519    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34cc68b2-cc96-4a1a-965e-0bec23b02330-crio-socket\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:35.562776 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:35.562560    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:29:35.562776 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:35.562579    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:29:35.562776 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:35.562638    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls podName:34cc68b2-cc96-4a1a-965e-0bec23b02330 nodeName:}" failed. No retries permitted until 2026-07-27 19:29:36.062619983 +0000 UTC m=+193.190983773 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7cqw8" (UID: "34cc68b2-cc96-4a1a-965e-0bec23b02330") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:29:35.562776 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:35.562656    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm podName:34cc68b2-cc96-4a1a-965e-0bec23b02330 nodeName:}" failed. No retries permitted until 2026-07-27 19:29:36.062647303 +0000 UTC m=+193.191011084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7cqw8" (UID: "34cc68b2-cc96-4a1a-965e-0bec23b02330") : configmap "kube-rbac-proxy" not found
Jul 27 19:29:35.562776 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.562748    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34cc68b2-cc96-4a1a-965e-0bec23b02330-data-volume\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:35.570345 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:35.570322    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnlgh\" (UniqueName: \"kubernetes.io/projected/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-api-access-dnlgh\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:36.066225 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:36.066194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:36.066225 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:36.066231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:36.066477 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:36.066335    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:29:36.066477 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:36.066407    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm podName:34cc68b2-cc96-4a1a-965e-0bec23b02330 nodeName:}" failed. No retries permitted until 2026-07-27 19:29:37.066387233 +0000 UTC m=+194.194751012 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7cqw8" (UID: "34cc68b2-cc96-4a1a-965e-0bec23b02330") : configmap "kube-rbac-proxy" not found
Jul 27 19:29:36.066477 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:36.066341    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:29:36.066477 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:36.066467    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls podName:34cc68b2-cc96-4a1a-965e-0bec23b02330 nodeName:}" failed. No retries permitted until 2026-07-27 19:29:37.066456393 +0000 UTC m=+194.194820167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7cqw8" (UID: "34cc68b2-cc96-4a1a-965e-0bec23b02330") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:29:37.074381 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:37.074327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:37.074381 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:37.074387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:37.074849 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:37.074453    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:29:37.074849 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:37.074510    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:29:37.074849 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:37.074518    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm podName:34cc68b2-cc96-4a1a-965e-0bec23b02330 nodeName:}" failed. No retries permitted until 2026-07-27 19:29:39.074503579 +0000 UTC m=+196.202867357 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7cqw8" (UID: "34cc68b2-cc96-4a1a-965e-0bec23b02330") : configmap "kube-rbac-proxy" not found
Jul 27 19:29:37.074849 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:37.074576    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls podName:34cc68b2-cc96-4a1a-965e-0bec23b02330 nodeName:}" failed. No retries permitted until 2026-07-27 19:29:39.074561307 +0000 UTC m=+196.202925083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7cqw8" (UID: "34cc68b2-cc96-4a1a-965e-0bec23b02330") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:29:37.274430 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:37.274407    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9hjwq_8f664404-7594-4137-8e24-27ff3689a210/dns-node-resolver/0.log"
Jul 27 19:29:37.441911 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:37.441834    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-6rzvp"]
Jul 27 19:29:37.443584 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:37.443568    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6rzvp"
Jul 27 19:29:37.445774 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:37.445753    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kbd8v\""
Jul 27 19:29:37.445984 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:37.445970    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 27 19:29:37.446900 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:37.446884    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 27 19:29:37.452399 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:37.452375    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-6rzvp"]
Jul 27 19:29:37.577432 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:37.577378    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9qrz\" (UniqueName: \"kubernetes.io/projected/d80c125a-4f06-413e-9f36-5c223ff55f80-kube-api-access-b9qrz\") pod \"migrator-6865c9967-6rzvp\" (UID: \"d80c125a-4f06-413e-9f36-5c223ff55f80\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6rzvp"
Jul 27 19:29:37.678065 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:37.678026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9qrz\" (UniqueName: \"kubernetes.io/projected/d80c125a-4f06-413e-9f36-5c223ff55f80-kube-api-access-b9qrz\") pod \"migrator-6865c9967-6rzvp\" (UID: \"d80c125a-4f06-413e-9f36-5c223ff55f80\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6rzvp"
Jul 27 19:29:37.686043 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:37.686011    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9qrz\" (UniqueName: \"kubernetes.io/projected/d80c125a-4f06-413e-9f36-5c223ff55f80-kube-api-access-b9qrz\") pod \"migrator-6865c9967-6rzvp\" (UID: \"d80c125a-4f06-413e-9f36-5c223ff55f80\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6rzvp"
Jul 27 19:29:37.752328 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:37.752243    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6rzvp"
Jul 27 19:29:37.870337 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:37.870304    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-6rzvp"]
Jul 27 19:29:37.873355 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:29:37.873329    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd80c125a_4f06_413e_9f36_5c223ff55f80.slice/crio-2df39888becd8c4ac31e61139cfdb08bef78196dd272442045f3768454f9a50a WatchSource:0}: Error finding container 2df39888becd8c4ac31e61139cfdb08bef78196dd272442045f3768454f9a50a: Status 404 returned error can't find the container with id 2df39888becd8c4ac31e61139cfdb08bef78196dd272442045f3768454f9a50a
Jul 27 19:29:37.910519 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:37.910488    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6rzvp" event={"ID":"d80c125a-4f06-413e-9f36-5c223ff55f80","Type":"ContainerStarted","Data":"2df39888becd8c4ac31e61139cfdb08bef78196dd272442045f3768454f9a50a"}
Jul 27 19:29:38.075363 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:38.075336    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5jr4b_90259da6-ff35-437b-a596-853d2a96bc12/node-ca/0.log"
Jul 27 19:29:39.075663 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:39.075628    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hhhqg_f0c2d6ea-0e98-401a-a5d9-ca95c9fdbef9/serve-healthcheck-canary/0.log"
Jul 27 19:29:39.089977 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:39.089938    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:39.090170 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:39.089989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:39.090170 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:39.090080    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:29:39.090170 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:39.090125    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:29:39.090170 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:39.090163    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm podName:34cc68b2-cc96-4a1a-965e-0bec23b02330 nodeName:}" failed. No retries permitted until 2026-07-27 19:29:43.09014105 +0000 UTC m=+200.218504831 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7cqw8" (UID: "34cc68b2-cc96-4a1a-965e-0bec23b02330") : configmap "kube-rbac-proxy" not found
Jul 27 19:29:39.090332 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:39.090183    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls podName:34cc68b2-cc96-4a1a-965e-0bec23b02330 nodeName:}" failed. No retries permitted until 2026-07-27 19:29:43.090173641 +0000 UTC m=+200.218537415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7cqw8" (UID: "34cc68b2-cc96-4a1a-965e-0bec23b02330") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:29:39.916905 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:39.916870    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6rzvp" event={"ID":"d80c125a-4f06-413e-9f36-5c223ff55f80","Type":"ContainerStarted","Data":"b84b966f867047536fea2191cb0ac7ae7a72d68ec5e527c4151cb54f9db9555f"}
Jul 27 19:29:39.917113 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:39.916921    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6rzvp" event={"ID":"d80c125a-4f06-413e-9f36-5c223ff55f80","Type":"ContainerStarted","Data":"14ff389e8f43272bfd5fd27a7938ac01110a916d6c1283f8eac22e927b76f4db"}
Jul 27 19:29:39.932739 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:39.932690    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6rzvp" podStartSLOduration=1.620861644 podStartE2EDuration="2.932669183s" totalImagesPullingTime="1.311807539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:29:39.931033322 +0000 UTC m=+197.059397120" watchObservedRunningTime="2026-07-27 19:29:39.932669183 +0000 UTC m=+197.061032978"
Jul 27 19:29:40.196424 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:40.196337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:40.196784 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:40.196449    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:29:40.196784 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:40.196498    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls podName:963533dc-5ae0-4aa4-8fbe-6dbe15042d3a nodeName:}" failed. No retries permitted until 2026-07-27 19:29:56.196485595 +0000 UTC m=+213.324849369 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls") pod "dns-default-dzkf2" (UID: "963533dc-5ae0-4aa4-8fbe-6dbe15042d3a") : secret "dns-default-metrics-tls" not found
Jul 27 19:29:43.113922 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:43.113880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:43.113922 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:43.113923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:43.114490 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:43.114015    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:29:43.114490 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:43.114030    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:29:43.114490 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:43.114120    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm podName:34cc68b2-cc96-4a1a-965e-0bec23b02330 nodeName:}" failed. No retries permitted until 2026-07-27 19:29:51.114097281 +0000 UTC m=+208.242461068 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7cqw8" (UID: "34cc68b2-cc96-4a1a-965e-0bec23b02330") : configmap "kube-rbac-proxy" not found
Jul 27 19:29:43.114490 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:43.114141    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls podName:34cc68b2-cc96-4a1a-965e-0bec23b02330 nodeName:}" failed. No retries permitted until 2026-07-27 19:29:51.114132636 +0000 UTC m=+208.242496412 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7cqw8" (UID: "34cc68b2-cc96-4a1a-965e-0bec23b02330") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:29:51.174047 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:51.174012    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:51.174446 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:51.174069    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:51.174446 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:51.174185    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:29:51.174446 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:29:51.174238    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls podName:34cc68b2-cc96-4a1a-965e-0bec23b02330 nodeName:}" failed. No retries permitted until 2026-07-27 19:30:07.17422489 +0000 UTC m=+224.302588664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7cqw8" (UID: "34cc68b2-cc96-4a1a-965e-0bec23b02330") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:29:51.174554 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:51.174500    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34cc68b2-cc96-4a1a-965e-0bec23b02330-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:29:56.210224 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:56.210177    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:56.212641 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:56.212617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/963533dc-5ae0-4aa4-8fbe-6dbe15042d3a-metrics-tls\") pod \"dns-default-dzkf2\" (UID: \"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a\") " pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:56.443922 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:56.443886    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:56.564526 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:56.564492    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dzkf2"]
Jul 27 19:29:56.568560 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:29:56.568530    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod963533dc_5ae0_4aa4_8fbe_6dbe15042d3a.slice/crio-04d81d89d3d488f605b2f2c0e118a3f260882e6c188ccf11bb79a652322cedc8 WatchSource:0}: Error finding container 04d81d89d3d488f605b2f2c0e118a3f260882e6c188ccf11bb79a652322cedc8: Status 404 returned error can't find the container with id 04d81d89d3d488f605b2f2c0e118a3f260882e6c188ccf11bb79a652322cedc8
Jul 27 19:29:56.960416 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:56.960375    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dzkf2" event={"ID":"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a","Type":"ContainerStarted","Data":"04d81d89d3d488f605b2f2c0e118a3f260882e6c188ccf11bb79a652322cedc8"}
Jul 27 19:29:58.503517 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.503425    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f495f497f-b7t2c"]
Jul 27 19:29:58.506452 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.506431    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.509112 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.509086    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 19:29:58.509232 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.509171    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-txhl6\""
Jul 27 19:29:58.509300 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.509287    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 19:29:58.510237 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.510221    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 19:29:58.514069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.514036    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 19:29:58.519811 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.519790    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f495f497f-b7t2c"]
Jul 27 19:29:58.527595 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.527573    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdb068f0-bd71-4791-a9ae-34fda6ee0656-ca-trust-extracted\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.527683 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.527601    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdb068f0-bd71-4791-a9ae-34fda6ee0656-installation-pull-secrets\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.527683 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.527621    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdb068f0-bd71-4791-a9ae-34fda6ee0656-image-registry-private-configuration\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.527683 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.527664    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdb068f0-bd71-4791-a9ae-34fda6ee0656-registry-certificates\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.527833 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.527694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdb068f0-bd71-4791-a9ae-34fda6ee0656-trusted-ca\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.527833 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.527803    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdb068f0-bd71-4791-a9ae-34fda6ee0656-registry-tls\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.527927 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.527835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdb068f0-bd71-4791-a9ae-34fda6ee0656-bound-sa-token\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.527927 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.527867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbxlf\" (UniqueName: \"kubernetes.io/projected/cdb068f0-bd71-4791-a9ae-34fda6ee0656-kube-api-access-kbxlf\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.629161 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.629132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdb068f0-bd71-4791-a9ae-34fda6ee0656-registry-tls\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.629161 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.629162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdb068f0-bd71-4791-a9ae-34fda6ee0656-bound-sa-token\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.629416 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.629178    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbxlf\" (UniqueName: \"kubernetes.io/projected/cdb068f0-bd71-4791-a9ae-34fda6ee0656-kube-api-access-kbxlf\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.629416 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.629232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdb068f0-bd71-4791-a9ae-34fda6ee0656-ca-trust-extracted\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.629416 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.629249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdb068f0-bd71-4791-a9ae-34fda6ee0656-installation-pull-secrets\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.629416 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.629266    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdb068f0-bd71-4791-a9ae-34fda6ee0656-image-registry-private-configuration\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.629416 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.629296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdb068f0-bd71-4791-a9ae-34fda6ee0656-registry-certificates\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.629416 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.629316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdb068f0-bd71-4791-a9ae-34fda6ee0656-trusted-ca\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.630022 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.629993    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdb068f0-bd71-4791-a9ae-34fda6ee0656-ca-trust-extracted\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.630307 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.630287    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdb068f0-bd71-4791-a9ae-34fda6ee0656-trusted-ca\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.630378 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.630351    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdb068f0-bd71-4791-a9ae-34fda6ee0656-registry-certificates\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.631844 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.631822    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdb068f0-bd71-4791-a9ae-34fda6ee0656-image-registry-private-configuration\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.631929 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.631869    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdb068f0-bd71-4791-a9ae-34fda6ee0656-installation-pull-secrets\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.631929 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.631872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdb068f0-bd71-4791-a9ae-34fda6ee0656-registry-tls\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.637175 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.637152    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdb068f0-bd71-4791-a9ae-34fda6ee0656-bound-sa-token\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.637271 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.637213    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbxlf\" (UniqueName: \"kubernetes.io/projected/cdb068f0-bd71-4791-a9ae-34fda6ee0656-kube-api-access-kbxlf\") pod \"image-registry-f495f497f-b7t2c\" (UID: \"cdb068f0-bd71-4791-a9ae-34fda6ee0656\") " pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.815137 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.815108    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:58.941577 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.941541    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f495f497f-b7t2c"]
Jul 27 19:29:58.944523 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:29:58.944489    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdb068f0_bd71_4791_a9ae_34fda6ee0656.slice/crio-3249540cbf4adbe161dfe9fc18aaf8b268da186c33fea2e3e53fef7dbe7fddd1 WatchSource:0}: Error finding container 3249540cbf4adbe161dfe9fc18aaf8b268da186c33fea2e3e53fef7dbe7fddd1: Status 404 returned error can't find the container with id 3249540cbf4adbe161dfe9fc18aaf8b268da186c33fea2e3e53fef7dbe7fddd1
Jul 27 19:29:58.968306 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.968277    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f495f497f-b7t2c" event={"ID":"cdb068f0-bd71-4791-a9ae-34fda6ee0656","Type":"ContainerStarted","Data":"3249540cbf4adbe161dfe9fc18aaf8b268da186c33fea2e3e53fef7dbe7fddd1"}
Jul 27 19:29:58.969868 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.969845    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dzkf2" event={"ID":"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a","Type":"ContainerStarted","Data":"ce190c56af3405ae97d10cb23496b3152a205bc30d0e2bf3a2bba534fa5ca204"}
Jul 27 19:29:58.969986 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.969886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dzkf2" event={"ID":"963533dc-5ae0-4aa4-8fbe-6dbe15042d3a","Type":"ContainerStarted","Data":"609e6fa7d2a45a62b3bc739bb7abccf42b6ccf33ba89e1cfc35bb64234c88e3d"}
Jul 27 19:29:58.969986 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.969977    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:29:58.991648 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:58.991593    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dzkf2" podStartSLOduration=33.45366956 podStartE2EDuration="34.991571411s" totalImagesPullingTime="1.537901851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:29:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:29:58.991310654 +0000 UTC m=+216.119674449" watchObservedRunningTime="2026-07-27 19:29:58.991571411 +0000 UTC m=+216.119935206"
Jul 27 19:29:59.235298 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:59.235218    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs\") pod \"network-metrics-daemon-drqtg\" (UID: \"a635d151-c940-4f0c-bd3c-69e8fdf67942\") " pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:29:59.237623 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:59.237603    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a635d151-c940-4f0c-bd3c-69e8fdf67942-metrics-certs\") pod \"network-metrics-daemon-drqtg\" (UID: \"a635d151-c940-4f0c-bd3c-69e8fdf67942\") " pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:29:59.489430 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:59.489353    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lj4rj\""
Jul 27 19:29:59.497357 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:59.497339    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drqtg"
Jul 27 19:29:59.618768 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:59.618736    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-drqtg"]
Jul 27 19:29:59.620948 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:29:59.620921    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda635d151_c940_4f0c_bd3c_69e8fdf67942.slice/crio-0c2e438151558e7c8d1d54a08661d8a498db8455e208f18514ec9df5d0330e1e WatchSource:0}: Error finding container 0c2e438151558e7c8d1d54a08661d8a498db8455e208f18514ec9df5d0330e1e: Status 404 returned error can't find the container with id 0c2e438151558e7c8d1d54a08661d8a498db8455e208f18514ec9df5d0330e1e
Jul 27 19:29:59.974634 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:59.974604    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f495f497f-b7t2c" event={"ID":"cdb068f0-bd71-4791-a9ae-34fda6ee0656","Type":"ContainerStarted","Data":"3e9b9fb9c221e81a9ad281b796d09ecb6c5c9e926fdc03f3c2cef6b1fc236c59"}
Jul 27 19:29:59.974825 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:59.974669    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:29:59.975729 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:59.975707    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-drqtg" event={"ID":"a635d151-c940-4f0c-bd3c-69e8fdf67942","Type":"ContainerStarted","Data":"0c2e438151558e7c8d1d54a08661d8a498db8455e208f18514ec9df5d0330e1e"}
Jul 27 19:29:59.998122 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:29:59.998017    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f495f497f-b7t2c" podStartSLOduration=1.998000096 podStartE2EDuration="1.998000096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:29:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:29:59.997359688 +0000 UTC m=+217.125723484" watchObservedRunningTime="2026-07-27 19:29:59.998000096 +0000 UTC m=+217.126363891"
Jul 27 19:30:00.795638 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:00.795604    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-rvj29"]
Jul 27 19:30:00.798511 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:00.798493    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-rvj29"
Jul 27 19:30:00.800794 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:00.800776    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 27 19:30:00.800902 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:00.800793    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-txhdq\""
Jul 27 19:30:00.808735 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:00.808709    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-rvj29"]
Jul 27 19:30:00.847806 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:00.847762    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/36983a9d-bbf0-436a-8fe5-cf4449eb48d3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-rvj29\" (UID: \"36983a9d-bbf0-436a-8fe5-cf4449eb48d3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-rvj29"
Jul 27 19:30:00.948994 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:00.948964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/36983a9d-bbf0-436a-8fe5-cf4449eb48d3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-rvj29\" (UID: \"36983a9d-bbf0-436a-8fe5-cf4449eb48d3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-rvj29"
Jul 27 19:30:00.949145 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:30:00.949130    2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 19:30:00.949194 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:30:00.949188    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36983a9d-bbf0-436a-8fe5-cf4449eb48d3-tls-certificates podName:36983a9d-bbf0-436a-8fe5-cf4449eb48d3 nodeName:}" failed. No retries permitted until 2026-07-27 19:30:01.449173732 +0000 UTC m=+218.577537505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/36983a9d-bbf0-436a-8fe5-cf4449eb48d3-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-rvj29" (UID: "36983a9d-bbf0-436a-8fe5-cf4449eb48d3") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 19:30:00.981382 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:00.981335    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-drqtg" event={"ID":"a635d151-c940-4f0c-bd3c-69e8fdf67942","Type":"ContainerStarted","Data":"712106fe89dd1f17579fc95c1e611bea4d5fdec4d8852e4eef6107195bb977be"}
Jul 27 19:30:00.981556 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:00.981402    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-drqtg" event={"ID":"a635d151-c940-4f0c-bd3c-69e8fdf67942","Type":"ContainerStarted","Data":"8ea5a501fe93fe90b1f7620a95ca29731c8eafe8f8e0c1ce9533e869555e9e1b"}
Jul 27 19:30:00.997044 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:00.996996    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-drqtg" podStartSLOduration=162.162820111 podStartE2EDuration="2m42.996982425s" totalImagesPullingTime="834.162314ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:30:00.996405413 +0000 UTC m=+218.124769208" watchObservedRunningTime="2026-07-27 19:30:00.996982425 +0000 UTC m=+218.125346278"
Jul 27 19:30:01.452342 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:01.452307    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/36983a9d-bbf0-436a-8fe5-cf4449eb48d3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-rvj29\" (UID: \"36983a9d-bbf0-436a-8fe5-cf4449eb48d3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-rvj29"
Jul 27 19:30:01.452552 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:30:01.452477    2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 19:30:01.452613 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:30:01.452562    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36983a9d-bbf0-436a-8fe5-cf4449eb48d3-tls-certificates podName:36983a9d-bbf0-436a-8fe5-cf4449eb48d3 nodeName:}" failed. No retries permitted until 2026-07-27 19:30:02.452540705 +0000 UTC m=+219.580904507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/36983a9d-bbf0-436a-8fe5-cf4449eb48d3-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-rvj29" (UID: "36983a9d-bbf0-436a-8fe5-cf4449eb48d3") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 19:30:02.458110 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:02.458038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/36983a9d-bbf0-436a-8fe5-cf4449eb48d3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-rvj29\" (UID: \"36983a9d-bbf0-436a-8fe5-cf4449eb48d3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-rvj29"
Jul 27 19:30:02.460709 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:02.460684    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/36983a9d-bbf0-436a-8fe5-cf4449eb48d3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-rvj29\" (UID: \"36983a9d-bbf0-436a-8fe5-cf4449eb48d3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-rvj29"
Jul 27 19:30:02.606809 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:02.606764    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-rvj29"
Jul 27 19:30:02.725558 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:02.725479    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-rvj29"]
Jul 27 19:30:02.728467 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:30:02.728436    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36983a9d_bbf0_436a_8fe5_cf4449eb48d3.slice/crio-1ae71bcc34a15cce0b824553fb528b24524eadf45ec037f0caaf1db74cd62e36 WatchSource:0}: Error finding container 1ae71bcc34a15cce0b824553fb528b24524eadf45ec037f0caaf1db74cd62e36: Status 404 returned error can't find the container with id 1ae71bcc34a15cce0b824553fb528b24524eadf45ec037f0caaf1db74cd62e36
Jul 27 19:30:02.988398 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:02.988317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-rvj29" event={"ID":"36983a9d-bbf0-436a-8fe5-cf4449eb48d3","Type":"ContainerStarted","Data":"1ae71bcc34a15cce0b824553fb528b24524eadf45ec037f0caaf1db74cd62e36"}
Jul 27 19:30:03.992726 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:03.992685    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-rvj29" event={"ID":"36983a9d-bbf0-436a-8fe5-cf4449eb48d3","Type":"ContainerStarted","Data":"01a8feeadce6ce1a613e7fab5c9932400f0a415b8b7faa97fc796eb1f159fa12"}
Jul 27 19:30:03.993220 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:03.992910    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-rvj29"
Jul 27 19:30:03.997609 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:03.997588    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-rvj29"
Jul 27 19:30:04.007814 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:04.007762    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-rvj29" podStartSLOduration=2.912586176 podStartE2EDuration="4.00774507s" totalImagesPullingTime="1.095158894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:30:04.006712696 +0000 UTC m=+221.135076493" watchObservedRunningTime="2026-07-27 19:30:04.00774507 +0000 UTC m=+221.136108865"
Jul 27 19:30:04.858267 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:04.858230    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-xss9h"]
Jul 27 19:30:04.862321 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:04.862305    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h"
Jul 27 19:30:04.865737 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:04.865695    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 19:30:04.865874 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:04.865763    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 27 19:30:04.865874 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:04.865808    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6c9ls\""
Jul 27 19:30:04.865874 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:04.865770    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 27 19:30:04.866020 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:04.865814    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 19:30:04.866020 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:04.865994    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 19:30:04.871397 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:04.871373    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-xss9h"]
Jul 27 19:30:04.979547 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:04.979515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5e5df61-b8ea-4b5f-b5c0-10547092c7db-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-xss9h\" (UID: \"d5e5df61-b8ea-4b5f-b5c0-10547092c7db\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h"
Jul 27 19:30:04.979738 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:04.979564    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5e5df61-b8ea-4b5f-b5c0-10547092c7db-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-xss9h\" (UID: \"d5e5df61-b8ea-4b5f-b5c0-10547092c7db\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h"
Jul 27 19:30:04.979738 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:04.979587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw25x\" (UniqueName: \"kubernetes.io/projected/d5e5df61-b8ea-4b5f-b5c0-10547092c7db-kube-api-access-pw25x\") pod \"prometheus-operator-84d69f794d-xss9h\" (UID: \"d5e5df61-b8ea-4b5f-b5c0-10547092c7db\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h"
Jul 27 19:30:04.979738 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:04.979632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5e5df61-b8ea-4b5f-b5c0-10547092c7db-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-xss9h\" (UID: \"d5e5df61-b8ea-4b5f-b5c0-10547092c7db\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h"
Jul 27 19:30:05.080308 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:05.080252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5e5df61-b8ea-4b5f-b5c0-10547092c7db-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-xss9h\" (UID: \"d5e5df61-b8ea-4b5f-b5c0-10547092c7db\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h"
Jul 27 19:30:05.080308 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:05.080316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw25x\" (UniqueName: \"kubernetes.io/projected/d5e5df61-b8ea-4b5f-b5c0-10547092c7db-kube-api-access-pw25x\") pod \"prometheus-operator-84d69f794d-xss9h\" (UID: \"d5e5df61-b8ea-4b5f-b5c0-10547092c7db\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h"
Jul 27 19:30:05.080869 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:05.080392    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5e5df61-b8ea-4b5f-b5c0-10547092c7db-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-xss9h\" (UID: \"d5e5df61-b8ea-4b5f-b5c0-10547092c7db\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h"
Jul 27 19:30:05.080869 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:30:05.080401    2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 27 19:30:05.080869 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:05.080421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5e5df61-b8ea-4b5f-b5c0-10547092c7db-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-xss9h\" (UID: \"d5e5df61-b8ea-4b5f-b5c0-10547092c7db\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h"
Jul 27 19:30:05.080869 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:30:05.080487    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e5df61-b8ea-4b5f-b5c0-10547092c7db-prometheus-operator-tls podName:d5e5df61-b8ea-4b5f-b5c0-10547092c7db nodeName:}" failed. No retries permitted until 2026-07-27 19:30:05.580464051 +0000 UTC m=+222.708827864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/d5e5df61-b8ea-4b5f-b5c0-10547092c7db-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-xss9h" (UID: "d5e5df61-b8ea-4b5f-b5c0-10547092c7db") : secret "prometheus-operator-tls" not found
Jul 27 19:30:05.081272 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:05.081197    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5e5df61-b8ea-4b5f-b5c0-10547092c7db-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-xss9h\" (UID: \"d5e5df61-b8ea-4b5f-b5c0-10547092c7db\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h"
Jul 27 19:30:05.082851 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:05.082829    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5e5df61-b8ea-4b5f-b5c0-10547092c7db-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-xss9h\" (UID: \"d5e5df61-b8ea-4b5f-b5c0-10547092c7db\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h"
Jul 27 19:30:05.090376 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:05.090354    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw25x\" (UniqueName: \"kubernetes.io/projected/d5e5df61-b8ea-4b5f-b5c0-10547092c7db-kube-api-access-pw25x\") pod \"prometheus-operator-84d69f794d-xss9h\" (UID: \"d5e5df61-b8ea-4b5f-b5c0-10547092c7db\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h"
Jul 27 19:30:05.585424 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:05.585386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5e5df61-b8ea-4b5f-b5c0-10547092c7db-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-xss9h\" (UID: \"d5e5df61-b8ea-4b5f-b5c0-10547092c7db\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h"
Jul 27 19:30:05.587813 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:05.587784    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5e5df61-b8ea-4b5f-b5c0-10547092c7db-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-xss9h\" (UID: \"d5e5df61-b8ea-4b5f-b5c0-10547092c7db\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h"
Jul 27 19:30:05.771448 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:05.771406    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h"
Jul 27 19:30:05.896542 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:05.896515    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-xss9h"]
Jul 27 19:30:05.901793 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:30:05.901767    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e5df61_b8ea_4b5f_b5c0_10547092c7db.slice/crio-c39ab3d6258bed0f4f861d13e594fd9b028c3a92771fa8eee966cbfa2ab4b786 WatchSource:0}: Error finding container c39ab3d6258bed0f4f861d13e594fd9b028c3a92771fa8eee966cbfa2ab4b786: Status 404 returned error can't find the container with id c39ab3d6258bed0f4f861d13e594fd9b028c3a92771fa8eee966cbfa2ab4b786
Jul 27 19:30:06.001488 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:06.001450    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h" event={"ID":"d5e5df61-b8ea-4b5f-b5c0-10547092c7db","Type":"ContainerStarted","Data":"c39ab3d6258bed0f4f861d13e594fd9b028c3a92771fa8eee966cbfa2ab4b786"}
Jul 27 19:30:07.197826 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:07.197786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:30:07.200404 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:07.200381    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34cc68b2-cc96-4a1a-965e-0bec23b02330-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cqw8\" (UID: \"34cc68b2-cc96-4a1a-965e-0bec23b02330\") " pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:30:07.431459 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:07.431423    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7cqw8"
Jul 27 19:30:07.818168 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:07.818140    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7cqw8"]
Jul 27 19:30:07.822045 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:30:07.822018    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34cc68b2_cc96_4a1a_965e_0bec23b02330.slice/crio-f5fc0daca9d3b39913e111661ebe6b1605bbb2ec11f3f642f3535c6417a9e903 WatchSource:0}: Error finding container f5fc0daca9d3b39913e111661ebe6b1605bbb2ec11f3f642f3535c6417a9e903: Status 404 returned error can't find the container with id f5fc0daca9d3b39913e111661ebe6b1605bbb2ec11f3f642f3535c6417a9e903
Jul 27 19:30:08.011960 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:08.011865    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7cqw8" event={"ID":"34cc68b2-cc96-4a1a-965e-0bec23b02330","Type":"ContainerStarted","Data":"f5fc0daca9d3b39913e111661ebe6b1605bbb2ec11f3f642f3535c6417a9e903"}
Jul 27 19:30:08.013438 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:08.013405    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h" event={"ID":"d5e5df61-b8ea-4b5f-b5c0-10547092c7db","Type":"ContainerStarted","Data":"fe8dd3e500910b2f95401f5b320ec66a34d2e2e0193600d058e5a397fd4bbb9d"}
Jul 27 19:30:08.013551 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:08.013453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h" event={"ID":"d5e5df61-b8ea-4b5f-b5c0-10547092c7db","Type":"ContainerStarted","Data":"236adeafa39ce4be1c30426564802d56f4bf9e107ff96a8fde49bedee7f27c84"}
Jul 27 19:30:08.030804 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:08.030751    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-xss9h" podStartSLOduration=2.19739336 podStartE2EDuration="4.030731483s" totalImagesPullingTime="1.833338123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:30:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:30:08.029736227 +0000 UTC m=+225.158100020" watchObservedRunningTime="2026-07-27 19:30:08.030731483 +0000 UTC m=+225.159095279"
Jul 27 19:30:08.978788 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:08.978758    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dzkf2"
Jul 27 19:30:10.224114 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.224078    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bnfmx"]
Jul 27 19:30:10.248735 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.248563    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.251101 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.251076    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 19:30:10.251248 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.251104    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 19:30:10.251468 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.251451    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 19:30:10.251643 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.251622    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j8v9r\""
Jul 27 19:30:10.322894 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.322860    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-accelerators-collector-config\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.323097 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.322907    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/594976e9-e6d8-4118-95fb-8bbae2d55acc-sys\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.323097 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.322925    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-textfile\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.323097 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.322940    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/594976e9-e6d8-4118-95fb-8bbae2d55acc-metrics-client-ca\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.323097 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.322956    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/594976e9-e6d8-4118-95fb-8bbae2d55acc-root\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.323097 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.323078    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.323296 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.323152    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-wtmp\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.323296 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.323183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dhw7\" (UniqueName: \"kubernetes.io/projected/594976e9-e6d8-4118-95fb-8bbae2d55acc-kube-api-access-5dhw7\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.323296 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.323206    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-tls\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.423956 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.423899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-accelerators-collector-config\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.424163 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.423966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/594976e9-e6d8-4118-95fb-8bbae2d55acc-sys\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.424163 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.423989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-textfile\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.424163 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.424080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/594976e9-e6d8-4118-95fb-8bbae2d55acc-sys\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.424163 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.424107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/594976e9-e6d8-4118-95fb-8bbae2d55acc-metrics-client-ca\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.424163 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.424152    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/594976e9-e6d8-4118-95fb-8bbae2d55acc-root\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.424402 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.424188    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.424402 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.424225    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-wtmp\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.424402 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.424249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dhw7\" (UniqueName: \"kubernetes.io/projected/594976e9-e6d8-4118-95fb-8bbae2d55acc-kube-api-access-5dhw7\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.424402 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.424278    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/594976e9-e6d8-4118-95fb-8bbae2d55acc-root\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.424402 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.424372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-wtmp\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.424402 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.424391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-tls\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.424668 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.424434    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-textfile\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.424668 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:30:10.424560    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 19:30:10.424668 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.424610    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-accelerators-collector-config\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.424668 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:30:10.424624    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-tls podName:594976e9-e6d8-4118-95fb-8bbae2d55acc nodeName:}" failed. No retries permitted until 2026-07-27 19:30:10.924603449 +0000 UTC m=+228.052967222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-tls") pod "node-exporter-bnfmx" (UID: "594976e9-e6d8-4118-95fb-8bbae2d55acc") : secret "node-exporter-tls" not found
Jul 27 19:30:10.424856 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.424681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/594976e9-e6d8-4118-95fb-8bbae2d55acc-metrics-client-ca\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.426912 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.426891    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.432443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.432413    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dhw7\" (UniqueName: \"kubernetes.io/projected/594976e9-e6d8-4118-95fb-8bbae2d55acc-kube-api-access-5dhw7\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.929263 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.929227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-tls\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:10.931979 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:10.931952    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/594976e9-e6d8-4118-95fb-8bbae2d55acc-node-exporter-tls\") pod \"node-exporter-bnfmx\" (UID: \"594976e9-e6d8-4118-95fb-8bbae2d55acc\") " pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:11.159679 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:11.159641    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bnfmx"
Jul 27 19:30:12.735773 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:30:12.735742    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod594976e9_e6d8_4118_95fb_8bbae2d55acc.slice/crio-e256504854ba3749ef4a763dbc204cf7653cb3e9013da385c945b74eb254942c WatchSource:0}: Error finding container e256504854ba3749ef4a763dbc204cf7653cb3e9013da385c945b74eb254942c: Status 404 returned error can't find the container with id e256504854ba3749ef4a763dbc204cf7653cb3e9013da385c945b74eb254942c
Jul 27 19:30:13.032823 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.032790    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7cqw8" event={"ID":"34cc68b2-cc96-4a1a-965e-0bec23b02330","Type":"ContainerStarted","Data":"7a967367c702f7480230fca42dab79e6fb1e1d6a3e7def20d8cec79b0a40d7a6"}
Jul 27 19:30:13.033941 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.033916    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bnfmx" event={"ID":"594976e9-e6d8-4118-95fb-8bbae2d55acc","Type":"ContainerStarted","Data":"e256504854ba3749ef4a763dbc204cf7653cb3e9013da385c945b74eb254942c"}
Jul 27 19:30:13.188459 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.188422    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"]
Jul 27 19:30:13.193102 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.192983    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.195564 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.195539    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 27 19:30:13.195716 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.195698    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 27 19:30:13.195825 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.195809    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 27 19:30:13.195955 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.195904    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 27 19:30:13.195955 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.195927    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4m5n2s6g07ej0\""
Jul 27 19:30:13.195955 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.195906    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 27 19:30:13.196215 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.196040    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zwkhl\""
Jul 27 19:30:13.202723 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.202699    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"]
Jul 27 19:30:13.248862 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.248826    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlmnq\" (UniqueName: \"kubernetes.io/projected/1f3e6471-c7f3-4141-8e73-c2cc89759296-kube-api-access-rlmnq\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.249150 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.248889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-thanos-querier-tls\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.249150 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.248918    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.249150 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.248944    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.249150 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.248985    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.249150 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.249010    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.249150 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.249041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-grpc-tls\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.249150 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.249083    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f3e6471-c7f3-4141-8e73-c2cc89759296-metrics-client-ca\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.350444 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.350359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlmnq\" (UniqueName: \"kubernetes.io/projected/1f3e6471-c7f3-4141-8e73-c2cc89759296-kube-api-access-rlmnq\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.350444 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.350422    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-thanos-querier-tls\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.350672 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.350512    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.350672 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.350554    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.350672 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.350604    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.350672 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.350631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.350672 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.350670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-grpc-tls\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.350917 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.350704    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f3e6471-c7f3-4141-8e73-c2cc89759296-metrics-client-ca\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.351464 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.351436    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f3e6471-c7f3-4141-8e73-c2cc89759296-metrics-client-ca\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.356409 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.356381    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.356863 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.356837    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.357957 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.357932    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-grpc-tls\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.358087 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.358010    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-thanos-querier-tls\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.358524 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.358482    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.358524 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.358512    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f3e6471-c7f3-4141-8e73-c2cc89759296-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.361014 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.360974    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlmnq\" (UniqueName: \"kubernetes.io/projected/1f3e6471-c7f3-4141-8e73-c2cc89759296-kube-api-access-rlmnq\") pod \"thanos-querier-55c95bcd6f-gqv4r\" (UID: \"1f3e6471-c7f3-4141-8e73-c2cc89759296\") " pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.502670 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.502637    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:13.676396 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:13.676359    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"]
Jul 27 19:30:13.840316 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:30:13.840260    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f3e6471_c7f3_4141_8e73_c2cc89759296.slice/crio-a01c829b03bc34c3a67ba7d41f489e7540a556e26d264784f8078c37d86b00ab WatchSource:0}: Error finding container a01c829b03bc34c3a67ba7d41f489e7540a556e26d264784f8078c37d86b00ab: Status 404 returned error can't find the container with id a01c829b03bc34c3a67ba7d41f489e7540a556e26d264784f8078c37d86b00ab
Jul 27 19:30:14.038895 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:14.038859    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r" event={"ID":"1f3e6471-c7f3-4141-8e73-c2cc89759296","Type":"ContainerStarted","Data":"a01c829b03bc34c3a67ba7d41f489e7540a556e26d264784f8078c37d86b00ab"}
Jul 27 19:30:14.040524 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:14.040496    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bnfmx" event={"ID":"594976e9-e6d8-4118-95fb-8bbae2d55acc","Type":"ContainerStarted","Data":"7a28a961a1c6ce863d4b1c2023e8f3cd0bf4472739986635f616f593f2549f99"}
Jul 27 19:30:14.993378 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:14.993256    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-j4msg"]
Jul 27 19:30:14.998575 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:14.998521    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j4msg"
Jul 27 19:30:15.001416 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:15.001204    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 27 19:30:15.001416 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:15.001310    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wkrq9\""
Jul 27 19:30:15.005358 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:15.005295    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-j4msg"]
Jul 27 19:30:15.047623 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:15.047585    2578 generic.go:356] "Generic (PLEG): container finished" podID="594976e9-e6d8-4118-95fb-8bbae2d55acc" containerID="7a28a961a1c6ce863d4b1c2023e8f3cd0bf4472739986635f616f593f2549f99" exitCode=0
Jul 27 19:30:15.047858 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:15.047675    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bnfmx" event={"ID":"594976e9-e6d8-4118-95fb-8bbae2d55acc","Type":"ContainerDied","Data":"7a28a961a1c6ce863d4b1c2023e8f3cd0bf4472739986635f616f593f2549f99"}
Jul 27 19:30:15.066594 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:15.066543    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9rtg\" (UniqueName: \"kubernetes.io/projected/a444eefb-5d50-42fc-acd1-4b8b9abbfd03-kube-api-access-c9rtg\") pod \"monitoring-plugin-68b7fc9574-j4msg\" (UID: \"a444eefb-5d50-42fc-acd1-4b8b9abbfd03\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j4msg"
Jul 27 19:30:15.066766 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:15.066640    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a444eefb-5d50-42fc-acd1-4b8b9abbfd03-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-j4msg\" (UID: \"a444eefb-5d50-42fc-acd1-4b8b9abbfd03\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j4msg"
Jul 27 19:30:15.167831 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:15.167792    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9rtg\" (UniqueName: \"kubernetes.io/projected/a444eefb-5d50-42fc-acd1-4b8b9abbfd03-kube-api-access-c9rtg\") pod \"monitoring-plugin-68b7fc9574-j4msg\" (UID: \"a444eefb-5d50-42fc-acd1-4b8b9abbfd03\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j4msg"
Jul 27 19:30:15.168038 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:15.167914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a444eefb-5d50-42fc-acd1-4b8b9abbfd03-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-j4msg\" (UID: \"a444eefb-5d50-42fc-acd1-4b8b9abbfd03\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j4msg"
Jul 27 19:30:15.170619 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:15.170595    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a444eefb-5d50-42fc-acd1-4b8b9abbfd03-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-j4msg\" (UID: \"a444eefb-5d50-42fc-acd1-4b8b9abbfd03\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j4msg"
Jul 27 19:30:15.193990 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:15.193952    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9rtg\" (UniqueName: \"kubernetes.io/projected/a444eefb-5d50-42fc-acd1-4b8b9abbfd03-kube-api-access-c9rtg\") pod \"monitoring-plugin-68b7fc9574-j4msg\" (UID: \"a444eefb-5d50-42fc-acd1-4b8b9abbfd03\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j4msg"
Jul 27 19:30:15.312198 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:15.312163    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j4msg"
Jul 27 19:30:16.393680 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.393628    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:30:16.400161 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.400132    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.404385 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.404294    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 27 19:30:16.404534 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.404385    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 27 19:30:16.404534 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.404410    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 27 19:30:16.404664 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.404546    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 27 19:30:16.404664 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.404621    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 27 19:30:16.404774 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.404680    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4fkpr8onhrqbk\""
Jul 27 19:30:16.404874 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.404854    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 27 19:30:16.406033 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.405854    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 27 19:30:16.406158 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.406078    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 27 19:30:16.407388 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.407367    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 27 19:30:16.408184 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.408161    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 19:30:16.408670 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.408653    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 27 19:30:16.409414 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.409384    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 27 19:30:16.419762 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.417621    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 27 19:30:16.420915 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.420891    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5dddl\""
Jul 27 19:30:16.421900 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.421880    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 27 19:30:16.423018 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.422993    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:30:16.425849 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.425832    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 27 19:30:16.480349 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480297    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.480349 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480353    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b99e054d-fec5-4848-bf11-482390277a41-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.480624 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480430    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.480624 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480465    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b99e054d-fec5-4848-bf11-482390277a41-config-out\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.480624 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480489    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.480624 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-config\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.480624 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480531    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.480624 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480547    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.480624 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.480624 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-web-config\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.480624 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.481036 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.481036 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.481036 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480707    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.481036 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480753    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.481036 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480783    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.481036 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480822    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.481036 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.481036 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rps2p\" (UniqueName: \"kubernetes.io/projected/b99e054d-fec5-4848-bf11-482390277a41-kube-api-access-rps2p\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.481036 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.480921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582139 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582034    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582139 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582366 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582155    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b99e054d-fec5-4848-bf11-482390277a41-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582366 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582366 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582221    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b99e054d-fec5-4848-bf11-482390277a41-config-out\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582366 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582366 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-config\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582366 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582305    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582366 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582330    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582366 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582357    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582752 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-web-config\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582752 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582406    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582752 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582752 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582454    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582752 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582752 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582512    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582752 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582544    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582752 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582752 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582591    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.582752 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.582622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rps2p\" (UniqueName: \"kubernetes.io/projected/b99e054d-fec5-4848-bf11-482390277a41-kube-api-access-rps2p\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.584225 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.584195    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.585326 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.585296    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b99e054d-fec5-4848-bf11-482390277a41-config-out\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.586201 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.585515    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.586201 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.585687    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.586201 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.585983    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.586201 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.586001    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.586458 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.586207    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.588987 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.586701    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.588987 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.587087    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.588987 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.587666    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.588987 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.588651    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.588987 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.588944    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.589477 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.589451    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.590417 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.590377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.590514 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.590442    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-config\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.590629 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.590607    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b99e054d-fec5-4848-bf11-482390277a41-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.592329 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.592187    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.592329 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.592295    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-web-config\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.593194 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.593119    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rps2p\" (UniqueName: \"kubernetes.io/projected/b99e054d-fec5-4848-bf11-482390277a41-kube-api-access-rps2p\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.593392 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.593370    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:16.723018 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:16.722972    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:17.233645 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:17.233557    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-j4msg"]
Jul 27 19:30:17.277020 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:17.276998    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:30:17.280853 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:30:17.280831    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb99e054d_fec5_4848_bf11_482390277a41.slice/crio-205cc7b25c0bc24bbbf5c96a37d09b1fcf505f40c2d4d33b14f715e7f67d5f89 WatchSource:0}: Error finding container 205cc7b25c0bc24bbbf5c96a37d09b1fcf505f40c2d4d33b14f715e7f67d5f89: Status 404 returned error can't find the container with id 205cc7b25c0bc24bbbf5c96a37d09b1fcf505f40c2d4d33b14f715e7f67d5f89
Jul 27 19:30:18.062814 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:18.062775    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r" event={"ID":"1f3e6471-c7f3-4141-8e73-c2cc89759296","Type":"ContainerStarted","Data":"e3d90c7b44f5464ddc920df1d5ab91dbb6bf9a9d4e557093b13a8aad97a9341b"}
Jul 27 19:30:18.063343 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:18.062889    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r" event={"ID":"1f3e6471-c7f3-4141-8e73-c2cc89759296","Type":"ContainerStarted","Data":"c702825ea9a74457029d03b3a315f9acd088a907b03d2ebc472bc128b24b4add"}
Jul 27 19:30:18.063343 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:18.062932    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r" event={"ID":"1f3e6471-c7f3-4141-8e73-c2cc89759296","Type":"ContainerStarted","Data":"60f500584c55fa8f03699d2b30e4fda2e59d223ef0b7e058e1a9e9a39da18553"}
Jul 27 19:30:18.064468 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:18.064433    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e054d-fec5-4848-bf11-482390277a41","Type":"ContainerStarted","Data":"205cc7b25c0bc24bbbf5c96a37d09b1fcf505f40c2d4d33b14f715e7f67d5f89"}
Jul 27 19:30:18.067324 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:18.067220    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7cqw8" event={"ID":"34cc68b2-cc96-4a1a-965e-0bec23b02330","Type":"ContainerStarted","Data":"ea3f72c865e77f27028eee5fa0cced7faa62fa71e19f3c303480f3440086e665"}
Jul 27 19:30:18.070492 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:18.070464    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bnfmx" event={"ID":"594976e9-e6d8-4118-95fb-8bbae2d55acc","Type":"ContainerStarted","Data":"1e01bf8e21e4c77d719eb23524854acc8803324f60c3efe1de997097017415fe"}
Jul 27 19:30:18.070598 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:18.070517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bnfmx" event={"ID":"594976e9-e6d8-4118-95fb-8bbae2d55acc","Type":"ContainerStarted","Data":"202d8974ebc3addb19bb894801db749951be0a079685a9c3b66a87e9830c170f"}
Jul 27 19:30:18.072983 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:18.072956    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j4msg" event={"ID":"a444eefb-5d50-42fc-acd1-4b8b9abbfd03","Type":"ContainerStarted","Data":"7b50cce943865b34d50f2dc78a726d8041d7e4ab40f4c20c22cbbb0bca341692"}
Jul 27 19:30:18.093706 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:18.093159    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bnfmx" podStartSLOduration=6.859723413 podStartE2EDuration="8.093140519s" totalImagesPullingTime="1.15197609s" totalInitContainerRuntime="81.441016ms" isStatefulPod=true podCreationTimestamp="2026-07-27 19:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:30:18.091395411 +0000 UTC m=+235.219759232" watchObservedRunningTime="2026-07-27 19:30:18.093140519 +0000 UTC m=+235.221504318"
Jul 27 19:30:20.088147 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:20.088099    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j4msg" event={"ID":"a444eefb-5d50-42fc-acd1-4b8b9abbfd03","Type":"ContainerStarted","Data":"61fe4f22041ba86fe98b58ef3d80e65b4be4e5ff4c70df27244976cb346f2f94"}
Jul 27 19:30:20.088669 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:20.088206    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j4msg"
Jul 27 19:30:20.092134 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:20.092105    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r" event={"ID":"1f3e6471-c7f3-4141-8e73-c2cc89759296","Type":"ContainerStarted","Data":"3b0488952446e3160473adafde80c29c76516268b9833b59fa1ae10361adedb4"}
Jul 27 19:30:20.092331 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:20.092186    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r" event={"ID":"1f3e6471-c7f3-4141-8e73-c2cc89759296","Type":"ContainerStarted","Data":"b11da17582d90b7dfb2472b00a521c89e51aee4a9a7cabd768dcae0e1ecf7126"}
Jul 27 19:30:20.092331 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:20.092226    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r" event={"ID":"1f3e6471-c7f3-4141-8e73-c2cc89759296","Type":"ContainerStarted","Data":"19e0c1eb06f01a6e1781b756dbd9f158d7895ff1759ae9dac822c5d5b1a6efcc"}
Jul 27 19:30:20.092331 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:20.092284    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:20.094336 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:20.094290    2578 generic.go:356] "Generic (PLEG): container finished" podID="b99e054d-fec5-4848-bf11-482390277a41" containerID="a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27" exitCode=0
Jul 27 19:30:20.094478 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:20.094364    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e054d-fec5-4848-bf11-482390277a41","Type":"ContainerDied","Data":"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27"}
Jul 27 19:30:20.094563 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:20.094512    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j4msg"
Jul 27 19:30:20.105880 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:20.105811    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j4msg" podStartSLOduration=4.15857125 podStartE2EDuration="6.105789648s" totalImagesPullingTime="1.947218398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:30:20.105129237 +0000 UTC m=+237.233493033" watchObservedRunningTime="2026-07-27 19:30:20.105789648 +0000 UTC m=+237.234153430"
Jul 27 19:30:20.126991 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:20.126929    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r" podStartSLOduration=1.980368365 podStartE2EDuration="7.12690941s" totalImagesPullingTime="5.146541045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:30:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:30:20.12554607 +0000 UTC m=+237.253909877" watchObservedRunningTime="2026-07-27 19:30:20.12690941 +0000 UTC m=+237.255273206"
Jul 27 19:30:20.985827 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:20.985801    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f495f497f-b7t2c"
Jul 27 19:30:22.110186 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:22.110144    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7cqw8" event={"ID":"34cc68b2-cc96-4a1a-965e-0bec23b02330","Type":"ContainerStarted","Data":"310aa2c3b116f97520118d6d5df129fb427599d4216e61baa4048772b7e1bdf7"}
Jul 27 19:30:22.128145 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:22.128087    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7cqw8" podStartSLOduration=33.802979686 podStartE2EDuration="47.128048396s" totalImagesPullingTime="13.32506871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:29:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:30:22.12689617 +0000 UTC m=+239.255259965" watchObservedRunningTime="2026-07-27 19:30:22.128048396 +0000 UTC m=+239.256412195"
Jul 27 19:30:24.121376 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:24.121346    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e054d-fec5-4848-bf11-482390277a41","Type":"ContainerStarted","Data":"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e"}
Jul 27 19:30:25.128458 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:25.128422    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e054d-fec5-4848-bf11-482390277a41","Type":"ContainerStarted","Data":"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8"}
Jul 27 19:30:25.128806 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:25.128494    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e054d-fec5-4848-bf11-482390277a41","Type":"ContainerStarted","Data":"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b"}
Jul 27 19:30:25.128806 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:25.128524    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e054d-fec5-4848-bf11-482390277a41","Type":"ContainerStarted","Data":"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1"}
Jul 27 19:30:25.128806 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:25.128553    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e054d-fec5-4848-bf11-482390277a41","Type":"ContainerStarted","Data":"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3"}
Jul 27 19:30:25.128806 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:25.128580    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e054d-fec5-4848-bf11-482390277a41","Type":"ContainerStarted","Data":"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490"}
Jul 27 19:30:25.157835 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:25.157781    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.3249068250000002 podStartE2EDuration="9.157764158s" totalImagesPullingTime="5.810254163s" totalInitContainerRuntime="22.60317ms" isStatefulPod=false podCreationTimestamp="2026-07-27 19:30:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:30:25.155440614 +0000 UTC m=+242.283804409" watchObservedRunningTime="2026-07-27 19:30:25.157764158 +0000 UTC m=+242.286127954"
Jul 27 19:30:26.104466 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:26.104433    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-55c95bcd6f-gqv4r"
Jul 27 19:30:26.723503 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:26.723473    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:30:42.358677 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:42.358636    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-j4msg_a444eefb-5d50-42fc-acd1-4b8b9abbfd03/monitoring-plugin/0.log"
Jul 27 19:30:43.758505 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:43.758476    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bnfmx_594976e9-e6d8-4118-95fb-8bbae2d55acc/init-textfile/0.log"
Jul 27 19:30:43.959886 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:43.959812    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bnfmx_594976e9-e6d8-4118-95fb-8bbae2d55acc/node-exporter/0.log"
Jul 27 19:30:44.159606 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:44.159577    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bnfmx_594976e9-e6d8-4118-95fb-8bbae2d55acc/kube-rbac-proxy/0.log"
Jul 27 19:30:44.959184 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:44.959157    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b99e054d-fec5-4848-bf11-482390277a41/init-config-reloader/0.log"
Jul 27 19:30:45.160365 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:45.160340    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b99e054d-fec5-4848-bf11-482390277a41/prometheus/0.log"
Jul 27 19:30:45.358777 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:45.358752    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b99e054d-fec5-4848-bf11-482390277a41/config-reloader/0.log"
Jul 27 19:30:45.558618 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:45.558588    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b99e054d-fec5-4848-bf11-482390277a41/thanos-sidecar/0.log"
Jul 27 19:30:45.758721 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:45.758640    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b99e054d-fec5-4848-bf11-482390277a41/kube-rbac-proxy-web/0.log"
Jul 27 19:30:45.959728 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:45.959696    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b99e054d-fec5-4848-bf11-482390277a41/kube-rbac-proxy/0.log"
Jul 27 19:30:46.158990 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:46.158961    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b99e054d-fec5-4848-bf11-482390277a41/kube-rbac-proxy-thanos/0.log"
Jul 27 19:30:46.359594 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:46.359564    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-xss9h_d5e5df61-b8ea-4b5f-b5c0-10547092c7db/prometheus-operator/0.log"
Jul 27 19:30:46.559222 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:46.559193    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-xss9h_d5e5df61-b8ea-4b5f-b5c0-10547092c7db/kube-rbac-proxy/0.log"
Jul 27 19:30:46.759030 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:46.758991    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-rvj29_36983a9d-bbf0-436a-8fe5-cf4449eb48d3/prometheus-operator-admission-webhook/0.log"
Jul 27 19:30:47.559547 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:47.559515    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c95bcd6f-gqv4r_1f3e6471-c7f3-4141-8e73-c2cc89759296/thanos-query/0.log"
Jul 27 19:30:47.758496 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:47.758468    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c95bcd6f-gqv4r_1f3e6471-c7f3-4141-8e73-c2cc89759296/kube-rbac-proxy-web/0.log"
Jul 27 19:30:47.959138 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:47.959026    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c95bcd6f-gqv4r_1f3e6471-c7f3-4141-8e73-c2cc89759296/kube-rbac-proxy/0.log"
Jul 27 19:30:48.158586 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:48.158556    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c95bcd6f-gqv4r_1f3e6471-c7f3-4141-8e73-c2cc89759296/prom-label-proxy/0.log"
Jul 27 19:30:48.358852 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:48.358822    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c95bcd6f-gqv4r_1f3e6471-c7f3-4141-8e73-c2cc89759296/kube-rbac-proxy-rules/0.log"
Jul 27 19:30:48.558366 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:30:48.558332    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c95bcd6f-gqv4r_1f3e6471-c7f3-4141-8e73-c2cc89759296/kube-rbac-proxy-metrics/0.log"
Jul 27 19:31:16.723205 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:16.723174    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:16.742096 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:16.742069    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:17.342168 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:17.342139    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:23.244362 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:23.244333    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 19:31:34.761158 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:34.761116    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:31:34.761657 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:34.761511    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="kube-rbac-proxy" containerID="cri-o://136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b" gracePeriod=600
Jul 27 19:31:34.761657 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:34.761545    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="kube-rbac-proxy-web" containerID="cri-o://d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1" gracePeriod=600
Jul 27 19:31:34.761657 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:34.761538    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="thanos-sidecar" containerID="cri-o://a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3" gracePeriod=600
Jul 27 19:31:34.761657 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:34.761582    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="config-reloader" containerID="cri-o://0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490" gracePeriod=600
Jul 27 19:31:34.761657 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:34.761507    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="prometheus" containerID="cri-o://1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e" gracePeriod=600
Jul 27 19:31:34.761657 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:34.761648    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8" gracePeriod=600
Jul 27 19:31:35.027093 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.026562    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.135094 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135042    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-kube-rbac-proxy\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135285 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135104    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-trusted-ca-bundle\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135285 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135123    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b99e054d-fec5-4848-bf11-482390277a41-tls-assets\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135285 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135140    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-grpc-tls\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135285 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135166    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-kubelet-serving-ca-bundle\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135285 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135197    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-db\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135285 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135217    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-metrics-client-ca\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135285 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135242    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135285 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135268    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-web-config\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135688 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135290    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-tls\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135688 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135318    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-config\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135688 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135349    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-0\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135688 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135379    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-2\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135688 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135412    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b99e054d-fec5-4848-bf11-482390277a41-config-out\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135688 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135436    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-thanos-prometheus-http-client-file\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135688 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135466    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-1\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135688 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135503    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-metrics-client-certs\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135688 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135513    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:31:35.135688 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135556    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rps2p\" (UniqueName: \"kubernetes.io/projected/b99e054d-fec5-4848-bf11-482390277a41-kube-api-access-rps2p\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135688 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135595    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.135688 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135598    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:31:35.135688 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135628    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-serving-certs-ca-bundle\") pod \"b99e054d-fec5-4848-bf11-482390277a41\" (UID: \"b99e054d-fec5-4848-bf11-482390277a41\") "
Jul 27 19:31:35.136406 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135842    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.136406 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.135857    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.136406 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.136165    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:31:35.136406 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.136334    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:31:35.137444 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.136675    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:31:35.137444 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.137158    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:31:35.138495 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.138212    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:31:35.138495 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.138370    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:31:35.138964 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.138897    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:31:35.139245 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.139201    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:31:35.139333 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.139251    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b99e054d-fec5-4848-bf11-482390277a41-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:31:35.139571 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.139542    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b99e054d-fec5-4848-bf11-482390277a41-kube-api-access-rps2p" (OuterVolumeSpecName: "kube-api-access-rps2p") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "kube-api-access-rps2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:31:35.139932 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.139894    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:31:35.140443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.140411    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:31:35.140528 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.140464    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:31:35.140823 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.140798    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:31:35.140972 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.140954    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:31:35.141126 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.141109    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-config" (OuterVolumeSpecName: "config") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:31:35.141219 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.141198    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b99e054d-fec5-4848-bf11-482390277a41-config-out" (OuterVolumeSpecName: "config-out") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:31:35.150575 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.150553    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-web-config" (OuterVolumeSpecName: "web-config") pod "b99e054d-fec5-4848-bf11-482390277a41" (UID: "b99e054d-fec5-4848-bf11-482390277a41"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:31:35.236364 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236327    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.236364 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236359    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.236571 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236371    2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-kube-rbac-proxy\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.236571 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236395    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b99e054d-fec5-4848-bf11-482390277a41-tls-assets\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.236571 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236404    2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-grpc-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.236571 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236412    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-db\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.236571 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236420    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-configmap-metrics-client-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.236571 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236429    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.236571 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236456    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-web-config\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.236571 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236464    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.236571 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236472    2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-config\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.236571 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236481    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.236571 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236490    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.236571 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236499    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b99e054d-fec5-4848-bf11-482390277a41-config-out\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.236571 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236507    2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.236571 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236516    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b99e054d-fec5-4848-bf11-482390277a41-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.236571 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236524    2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b99e054d-fec5-4848-bf11-482390277a41-secret-metrics-client-certs\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.236571 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.236532    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rps2p\" (UniqueName: \"kubernetes.io/projected/b99e054d-fec5-4848-bf11-482390277a41-kube-api-access-rps2p\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:31:35.389963 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.389932    2578 generic.go:356] "Generic (PLEG): container finished" podID="b99e054d-fec5-4848-bf11-482390277a41" containerID="1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8" exitCode=0
Jul 27 19:31:35.389963 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.389959    2578 generic.go:356] "Generic (PLEG): container finished" podID="b99e054d-fec5-4848-bf11-482390277a41" containerID="136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b" exitCode=0
Jul 27 19:31:35.390176 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.389969    2578 generic.go:356] "Generic (PLEG): container finished" podID="b99e054d-fec5-4848-bf11-482390277a41" containerID="d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1" exitCode=0
Jul 27 19:31:35.390176 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.389975    2578 generic.go:356] "Generic (PLEG): container finished" podID="b99e054d-fec5-4848-bf11-482390277a41" containerID="a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3" exitCode=0
Jul 27 19:31:35.390176 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.389981    2578 generic.go:356] "Generic (PLEG): container finished" podID="b99e054d-fec5-4848-bf11-482390277a41" containerID="0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490" exitCode=0
Jul 27 19:31:35.390176 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.389986    2578 generic.go:356] "Generic (PLEG): container finished" podID="b99e054d-fec5-4848-bf11-482390277a41" containerID="1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e" exitCode=0
Jul 27 19:31:35.390176 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.389977    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e054d-fec5-4848-bf11-482390277a41","Type":"ContainerDied","Data":"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8"}
Jul 27 19:31:35.390176 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.390008    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.390176 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.390097    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e054d-fec5-4848-bf11-482390277a41","Type":"ContainerDied","Data":"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b"}
Jul 27 19:31:35.390176 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.390158    2578 scope.go:117] "RemoveContainer" containerID="1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8"
Jul 27 19:31:35.390176 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.390154    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e054d-fec5-4848-bf11-482390277a41","Type":"ContainerDied","Data":"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1"}
Jul 27 19:31:35.390566 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.390209    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e054d-fec5-4848-bf11-482390277a41","Type":"ContainerDied","Data":"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3"}
Jul 27 19:31:35.390566 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.390255    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e054d-fec5-4848-bf11-482390277a41","Type":"ContainerDied","Data":"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490"}
Jul 27 19:31:35.390566 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.390300    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e054d-fec5-4848-bf11-482390277a41","Type":"ContainerDied","Data":"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e"}
Jul 27 19:31:35.390566 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.390342    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b99e054d-fec5-4848-bf11-482390277a41","Type":"ContainerDied","Data":"205cc7b25c0bc24bbbf5c96a37d09b1fcf505f40c2d4d33b14f715e7f67d5f89"}
Jul 27 19:31:35.397803 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.397783    2578 scope.go:117] "RemoveContainer" containerID="136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b"
Jul 27 19:31:35.404551 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.404534    2578 scope.go:117] "RemoveContainer" containerID="d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1"
Jul 27 19:31:35.410488 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.410465    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:31:35.411826 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.411810    2578 scope.go:117] "RemoveContainer" containerID="a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3"
Jul 27 19:31:35.414944 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.414920    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:31:35.420177 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.420156    2578 scope.go:117] "RemoveContainer" containerID="0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490"
Jul 27 19:31:35.439943 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.439846    2578 scope.go:117] "RemoveContainer" containerID="1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e"
Jul 27 19:31:35.441606 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.441588    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:31:35.441901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.441885    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="config-reloader"
Jul 27 19:31:35.441976 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.441904    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="config-reloader"
Jul 27 19:31:35.441976 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.441916    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="kube-rbac-proxy-thanos"
Jul 27 19:31:35.441976 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.441924    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="kube-rbac-proxy-thanos"
Jul 27 19:31:35.441976 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.441941    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="init-config-reloader"
Jul 27 19:31:35.441976 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.441951    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="init-config-reloader"
Jul 27 19:31:35.441976 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.441962    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="thanos-sidecar"
Jul 27 19:31:35.441976 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.441970    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="thanos-sidecar"
Jul 27 19:31:35.442361 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.441983    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="prometheus"
Jul 27 19:31:35.442361 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.441991    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="prometheus"
Jul 27 19:31:35.442361 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.442000    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="kube-rbac-proxy-web"
Jul 27 19:31:35.442361 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.442008    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="kube-rbac-proxy-web"
Jul 27 19:31:35.442361 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.442032    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="kube-rbac-proxy"
Jul 27 19:31:35.442361 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.442040    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="kube-rbac-proxy"
Jul 27 19:31:35.442361 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.442135    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="config-reloader"
Jul 27 19:31:35.442361 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.442147    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="kube-rbac-proxy"
Jul 27 19:31:35.442361 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.442156    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="kube-rbac-proxy-thanos"
Jul 27 19:31:35.442361 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.442167    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="prometheus"
Jul 27 19:31:35.442361 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.442175    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="thanos-sidecar"
Jul 27 19:31:35.442361 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.442185    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b99e054d-fec5-4848-bf11-482390277a41" containerName="kube-rbac-proxy-web"
Jul 27 19:31:35.446888 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.446860    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.448364 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.448334    2578 scope.go:117] "RemoveContainer" containerID="a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27"
Jul 27 19:31:35.449355 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.449272    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 27 19:31:35.449450 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.449368    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 27 19:31:35.449450 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.449369    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5dddl\""
Jul 27 19:31:35.449450 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.449395    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 27 19:31:35.449689 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.449675    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 27 19:31:35.449772 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.449731    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 27 19:31:35.449861 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.449833    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 27 19:31:35.449923 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.449879    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 27 19:31:35.449923 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.449883    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 19:31:35.450165 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.449947    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 27 19:31:35.450165 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.449954    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 27 19:31:35.450342 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.450267    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 27 19:31:35.450414 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.450363    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 27 19:31:35.450414 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.450428    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 27 19:31:35.450582 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.450536    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4fkpr8onhrqbk\""
Jul 27 19:31:35.453174 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.453154    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 27 19:31:35.456122 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.455927    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 27 19:31:35.457403 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.457381    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:31:35.458507 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.458490    2578 scope.go:117] "RemoveContainer" containerID="1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8"
Jul 27 19:31:35.458810 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:31:35.458789    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8\": container with ID starting with 1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8 not found: ID does not exist" containerID="1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8"
Jul 27 19:31:35.458886 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.458821    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8"} err="failed to get container status \"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8\": rpc error: code = NotFound desc = could not find container \"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8\": container with ID starting with 1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8 not found: ID does not exist"
Jul 27 19:31:35.458886 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.458853    2578 scope.go:117] "RemoveContainer" containerID="136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b"
Jul 27 19:31:35.459181 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:31:35.459161    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b\": container with ID starting with 136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b not found: ID does not exist" containerID="136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b"
Jul 27 19:31:35.459268 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.459189    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b"} err="failed to get container status \"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b\": rpc error: code = NotFound desc = could not find container \"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b\": container with ID starting with 136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b not found: ID does not exist"
Jul 27 19:31:35.459268 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.459213    2578 scope.go:117] "RemoveContainer" containerID="d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1"
Jul 27 19:31:35.459527 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:31:35.459498    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1\": container with ID starting with d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1 not found: ID does not exist" containerID="d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1"
Jul 27 19:31:35.459610 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.459532    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1"} err="failed to get container status \"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1\": rpc error: code = NotFound desc = could not find container \"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1\": container with ID starting with d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1 not found: ID does not exist"
Jul 27 19:31:35.459610 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.459553    2578 scope.go:117] "RemoveContainer" containerID="a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3"
Jul 27 19:31:35.459860 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:31:35.459787    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3\": container with ID starting with a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3 not found: ID does not exist" containerID="a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3"
Jul 27 19:31:35.459860 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.459812    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3"} err="failed to get container status \"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3\": rpc error: code = NotFound desc = could not find container \"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3\": container with ID starting with a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3 not found: ID does not exist"
Jul 27 19:31:35.459860 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.459830    2578 scope.go:117] "RemoveContainer" containerID="0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490"
Jul 27 19:31:35.461803 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:31:35.460273    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490\": container with ID starting with 0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490 not found: ID does not exist" containerID="0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490"
Jul 27 19:31:35.461803 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.460299    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490"} err="failed to get container status \"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490\": rpc error: code = NotFound desc = could not find container \"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490\": container with ID starting with 0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490 not found: ID does not exist"
Jul 27 19:31:35.461803 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.460317    2578 scope.go:117] "RemoveContainer" containerID="1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e"
Jul 27 19:31:35.461803 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:31:35.460549    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e\": container with ID starting with 1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e not found: ID does not exist" containerID="1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e"
Jul 27 19:31:35.461803 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.460570    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e"} err="failed to get container status \"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e\": rpc error: code = NotFound desc = could not find container \"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e\": container with ID starting with 1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e not found: ID does not exist"
Jul 27 19:31:35.461803 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.460586    2578 scope.go:117] "RemoveContainer" containerID="a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27"
Jul 27 19:31:35.461803 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:31:35.460795    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27\": container with ID starting with a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27 not found: ID does not exist" containerID="a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27"
Jul 27 19:31:35.461803 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.460815    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27"} err="failed to get container status \"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27\": rpc error: code = NotFound desc = could not find container \"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27\": container with ID starting with a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27 not found: ID does not exist"
Jul 27 19:31:35.461803 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.460831    2578 scope.go:117] "RemoveContainer" containerID="1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8"
Jul 27 19:31:35.461803 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.461030    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8"} err="failed to get container status \"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8\": rpc error: code = NotFound desc = could not find container \"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8\": container with ID starting with 1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8 not found: ID does not exist"
Jul 27 19:31:35.461803 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.461048    2578 scope.go:117] "RemoveContainer" containerID="136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b"
Jul 27 19:31:35.461803 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.461271    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b"} err="failed to get container status \"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b\": rpc error: code = NotFound desc = could not find container \"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b\": container with ID starting with 136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b not found: ID does not exist"
Jul 27 19:31:35.461803 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.461291    2578 scope.go:117] "RemoveContainer" containerID="d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1"
Jul 27 19:31:35.461803 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.461531    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1"} err="failed to get container status \"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1\": rpc error: code = NotFound desc = could not find container \"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1\": container with ID starting with d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1 not found: ID does not exist"
Jul 27 19:31:35.461803 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.461550    2578 scope.go:117] "RemoveContainer" containerID="a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3"
Jul 27 19:31:35.461803 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.461735    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3"} err="failed to get container status \"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3\": rpc error: code = NotFound desc = could not find container \"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3\": container with ID starting with a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3 not found: ID does not exist"
Jul 27 19:31:35.461803 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.461753    2578 scope.go:117] "RemoveContainer" containerID="0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490"
Jul 27 19:31:35.462717 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.461954    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490"} err="failed to get container status \"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490\": rpc error: code = NotFound desc = could not find container \"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490\": container with ID starting with 0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490 not found: ID does not exist"
Jul 27 19:31:35.462717 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.461972    2578 scope.go:117] "RemoveContainer" containerID="1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e"
Jul 27 19:31:35.462717 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.462178    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e"} err="failed to get container status \"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e\": rpc error: code = NotFound desc = could not find container \"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e\": container with ID starting with 1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e not found: ID does not exist"
Jul 27 19:31:35.462717 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.462192    2578 scope.go:117] "RemoveContainer" containerID="a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27"
Jul 27 19:31:35.462717 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.462428    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27"} err="failed to get container status \"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27\": rpc error: code = NotFound desc = could not find container \"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27\": container with ID starting with a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27 not found: ID does not exist"
Jul 27 19:31:35.462717 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.462448    2578 scope.go:117] "RemoveContainer" containerID="1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8"
Jul 27 19:31:35.462717 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.462674    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8"} err="failed to get container status \"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8\": rpc error: code = NotFound desc = could not find container \"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8\": container with ID starting with 1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8 not found: ID does not exist"
Jul 27 19:31:35.462717 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.462697    2578 scope.go:117] "RemoveContainer" containerID="136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b"
Jul 27 19:31:35.463133 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.462930    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b"} err="failed to get container status \"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b\": rpc error: code = NotFound desc = could not find container \"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b\": container with ID starting with 136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b not found: ID does not exist"
Jul 27 19:31:35.463133 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.462945    2578 scope.go:117] "RemoveContainer" containerID="d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1"
Jul 27 19:31:35.463301 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.463165    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1"} err="failed to get container status \"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1\": rpc error: code = NotFound desc = could not find container \"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1\": container with ID starting with d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1 not found: ID does not exist"
Jul 27 19:31:35.463301 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.463178    2578 scope.go:117] "RemoveContainer" containerID="a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3"
Jul 27 19:31:35.463409 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.463360    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3"} err="failed to get container status \"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3\": rpc error: code = NotFound desc = could not find container \"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3\": container with ID starting with a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3 not found: ID does not exist"
Jul 27 19:31:35.463409 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.463376    2578 scope.go:117] "RemoveContainer" containerID="0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490"
Jul 27 19:31:35.463547 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.463528    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490"} err="failed to get container status \"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490\": rpc error: code = NotFound desc = could not find container \"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490\": container with ID starting with 0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490 not found: ID does not exist"
Jul 27 19:31:35.463547 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.463544    2578 scope.go:117] "RemoveContainer" containerID="1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e"
Jul 27 19:31:35.463730 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.463709    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e"} err="failed to get container status \"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e\": rpc error: code = NotFound desc = could not find container \"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e\": container with ID starting with 1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e not found: ID does not exist"
Jul 27 19:31:35.463793 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.463730    2578 scope.go:117] "RemoveContainer" containerID="a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27"
Jul 27 19:31:35.463959 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.463943    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27"} err="failed to get container status \"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27\": rpc error: code = NotFound desc = could not find container \"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27\": container with ID starting with a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27 not found: ID does not exist"
Jul 27 19:31:35.463959 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.463958    2578 scope.go:117] "RemoveContainer" containerID="1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8"
Jul 27 19:31:35.464215 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.464195    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8"} err="failed to get container status \"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8\": rpc error: code = NotFound desc = could not find container \"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8\": container with ID starting with 1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8 not found: ID does not exist"
Jul 27 19:31:35.464215 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.464215    2578 scope.go:117] "RemoveContainer" containerID="136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b"
Jul 27 19:31:35.464414 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.464396    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b"} err="failed to get container status \"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b\": rpc error: code = NotFound desc = could not find container \"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b\": container with ID starting with 136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b not found: ID does not exist"
Jul 27 19:31:35.464482 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.464413    2578 scope.go:117] "RemoveContainer" containerID="d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1"
Jul 27 19:31:35.464633 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.464616    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1"} err="failed to get container status \"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1\": rpc error: code = NotFound desc = could not find container \"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1\": container with ID starting with d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1 not found: ID does not exist"
Jul 27 19:31:35.464723 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.464633    2578 scope.go:117] "RemoveContainer" containerID="a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3"
Jul 27 19:31:35.464850 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.464830    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3"} err="failed to get container status \"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3\": rpc error: code = NotFound desc = could not find container \"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3\": container with ID starting with a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3 not found: ID does not exist"
Jul 27 19:31:35.464850 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.464850    2578 scope.go:117] "RemoveContainer" containerID="0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490"
Jul 27 19:31:35.465078 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.465037    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490"} err="failed to get container status \"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490\": rpc error: code = NotFound desc = could not find container \"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490\": container with ID starting with 0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490 not found: ID does not exist"
Jul 27 19:31:35.465078 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.465070    2578 scope.go:117] "RemoveContainer" containerID="1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e"
Jul 27 19:31:35.465292 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.465274    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e"} err="failed to get container status \"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e\": rpc error: code = NotFound desc = could not find container \"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e\": container with ID starting with 1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e not found: ID does not exist"
Jul 27 19:31:35.465368 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.465292    2578 scope.go:117] "RemoveContainer" containerID="a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27"
Jul 27 19:31:35.465486 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.465465    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27"} err="failed to get container status \"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27\": rpc error: code = NotFound desc = could not find container \"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27\": container with ID starting with a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27 not found: ID does not exist"
Jul 27 19:31:35.465547 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.465487    2578 scope.go:117] "RemoveContainer" containerID="1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8"
Jul 27 19:31:35.465692 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.465670    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8"} err="failed to get container status \"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8\": rpc error: code = NotFound desc = could not find container \"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8\": container with ID starting with 1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8 not found: ID does not exist"
Jul 27 19:31:35.465692 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.465688    2578 scope.go:117] "RemoveContainer" containerID="136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b"
Jul 27 19:31:35.465904 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.465874    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b"} err="failed to get container status \"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b\": rpc error: code = NotFound desc = could not find container \"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b\": container with ID starting with 136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b not found: ID does not exist"
Jul 27 19:31:35.465904 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.465896    2578 scope.go:117] "RemoveContainer" containerID="d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1"
Jul 27 19:31:35.466141 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.466122    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1"} err="failed to get container status \"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1\": rpc error: code = NotFound desc = could not find container \"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1\": container with ID starting with d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1 not found: ID does not exist"
Jul 27 19:31:35.466195 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.466142    2578 scope.go:117] "RemoveContainer" containerID="a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3"
Jul 27 19:31:35.466381 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.466363    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3"} err="failed to get container status \"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3\": rpc error: code = NotFound desc = could not find container \"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3\": container with ID starting with a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3 not found: ID does not exist"
Jul 27 19:31:35.466429 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.466382    2578 scope.go:117] "RemoveContainer" containerID="0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490"
Jul 27 19:31:35.466586 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.466568    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490"} err="failed to get container status \"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490\": rpc error: code = NotFound desc = could not find container \"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490\": container with ID starting with 0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490 not found: ID does not exist"
Jul 27 19:31:35.466642 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.466587    2578 scope.go:117] "RemoveContainer" containerID="1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e"
Jul 27 19:31:35.466811 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.466788    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e"} err="failed to get container status \"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e\": rpc error: code = NotFound desc = could not find container \"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e\": container with ID starting with 1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e not found: ID does not exist"
Jul 27 19:31:35.466811 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.466810    2578 scope.go:117] "RemoveContainer" containerID="a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27"
Jul 27 19:31:35.467081 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.467039    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27"} err="failed to get container status \"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27\": rpc error: code = NotFound desc = could not find container \"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27\": container with ID starting with a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27 not found: ID does not exist"
Jul 27 19:31:35.467138 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.467084    2578 scope.go:117] "RemoveContainer" containerID="1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8"
Jul 27 19:31:35.467304 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.467285    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8"} err="failed to get container status \"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8\": rpc error: code = NotFound desc = could not find container \"1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8\": container with ID starting with 1c08b54d52a17fffa61808827e727d73da2168a1b934b02997b467f5066536a8 not found: ID does not exist"
Jul 27 19:31:35.467304 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.467302    2578 scope.go:117] "RemoveContainer" containerID="136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b"
Jul 27 19:31:35.467502 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.467489    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b"} err="failed to get container status \"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b\": rpc error: code = NotFound desc = could not find container \"136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b\": container with ID starting with 136bf5976eea221fdad52f1244099c0836fc2b9a2d4128c0d59bb4d20e4f556b not found: ID does not exist"
Jul 27 19:31:35.467502 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.467502    2578 scope.go:117] "RemoveContainer" containerID="d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1"
Jul 27 19:31:35.467713 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.467700    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1"} err="failed to get container status \"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1\": rpc error: code = NotFound desc = could not find container \"d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1\": container with ID starting with d4717ce978a6265eb8a94a651a5b0fd8578933d148760702090dc42945c1d2b1 not found: ID does not exist"
Jul 27 19:31:35.467713 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.467714    2578 scope.go:117] "RemoveContainer" containerID="a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3"
Jul 27 19:31:35.467882 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.467858    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3"} err="failed to get container status \"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3\": rpc error: code = NotFound desc = could not find container \"a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3\": container with ID starting with a7918aef47d2fc79b36d2a3dd4f7116a64bc8adf299de0dd2a40eb4bac66bfc3 not found: ID does not exist"
Jul 27 19:31:35.467882 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.467880    2578 scope.go:117] "RemoveContainer" containerID="0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490"
Jul 27 19:31:35.468096 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.468081    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490"} err="failed to get container status \"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490\": rpc error: code = NotFound desc = could not find container \"0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490\": container with ID starting with 0a5854100998645959514e56d46cf0c6a7f809c6ceb579c7efd2ed7ae2b85490 not found: ID does not exist"
Jul 27 19:31:35.468096 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.468095    2578 scope.go:117] "RemoveContainer" containerID="1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e"
Jul 27 19:31:35.468256 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.468242    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e"} err="failed to get container status \"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e\": rpc error: code = NotFound desc = could not find container \"1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e\": container with ID starting with 1fdcb1c4579ca6448be77b9b5b7bc8e7c178050b1ddd09b4a7e382d6d460f78e not found: ID does not exist"
Jul 27 19:31:35.468300 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.468255    2578 scope.go:117] "RemoveContainer" containerID="a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27"
Jul 27 19:31:35.468413 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.468400    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27"} err="failed to get container status \"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27\": rpc error: code = NotFound desc = could not find container \"a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27\": container with ID starting with a2c0bd2b8e6971807044c8c9deb093f5acc02d8b427525135c0e1a0033075f27 not found: ID does not exist"
Jul 27 19:31:35.541553 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.541553 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.541758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541578    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpp88\" (UniqueName: \"kubernetes.io/projected/0bdd7d2a-00f3-4510-a374-d902d1a896e2-kube-api-access-bpp88\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.541758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541634    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.541758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541684    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.541758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541701    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.541758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541716    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.541758 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541738    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.541948 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.541948 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.541948 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.541948 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.541948 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541886    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0bdd7d2a-00f3-4510-a374-d902d1a896e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.541948 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0bdd7d2a-00f3-4510-a374-d902d1a896e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.541948 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541917    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.541948 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.542213 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541958    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0bdd7d2a-00f3-4510-a374-d902d1a896e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.542213 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.542213 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.541988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-config\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.542213 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.542003    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643144 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643049    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643144 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643144 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643382 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643382 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643198    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0bdd7d2a-00f3-4510-a374-d902d1a896e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643382 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0bdd7d2a-00f3-4510-a374-d902d1a896e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643382 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643382 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643382 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0bdd7d2a-00f3-4510-a374-d902d1a896e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643382 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643382 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-config\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643382 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643850 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643416    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643850 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643850 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpp88\" (UniqueName: \"kubernetes.io/projected/0bdd7d2a-00f3-4510-a374-d902d1a896e2-kube-api-access-bpp88\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643850 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643504    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643850 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643549    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643850 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643850 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643600    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.643850 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.643635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.644266 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.644245    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.644419 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.644349    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0bdd7d2a-00f3-4510-a374-d902d1a896e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.644419 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.644350    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.644973 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.644883    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.647702 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.646850    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.647702 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.647305    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.647702 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.647659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.647927 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.647714    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.647927 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.647890    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-config\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.648085 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.648027    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.648544 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.648490    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.648544 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.648511    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.648544 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.648530    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.648778 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.648731    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0bdd7d2a-00f3-4510-a374-d902d1a896e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.648826 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.648810    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0bdd7d2a-00f3-4510-a374-d902d1a896e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.649128 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.649112    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.649320 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.649298    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0bdd7d2a-00f3-4510-a374-d902d1a896e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.649457 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.649441    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.649608 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.649591    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0bdd7d2a-00f3-4510-a374-d902d1a896e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.652267 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.652246    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpp88\" (UniqueName: \"kubernetes.io/projected/0bdd7d2a-00f3-4510-a374-d902d1a896e2-kube-api-access-bpp88\") pod \"prometheus-k8s-0\" (UID: \"0bdd7d2a-00f3-4510-a374-d902d1a896e2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.758772 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.758733    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:31:35.894872 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:35.894798    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:31:35.898021 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:31:35.897996    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bdd7d2a_00f3_4510_a374_d902d1a896e2.slice/crio-53f9adaf34ca9720777681b0ea40d78ddb6df569b4af2c3d0b9f02a91372001a WatchSource:0}: Error finding container 53f9adaf34ca9720777681b0ea40d78ddb6df569b4af2c3d0b9f02a91372001a: Status 404 returned error can't find the container with id 53f9adaf34ca9720777681b0ea40d78ddb6df569b4af2c3d0b9f02a91372001a
Jul 27 19:31:36.395654 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:36.395621    2578 generic.go:356] "Generic (PLEG): container finished" podID="0bdd7d2a-00f3-4510-a374-d902d1a896e2" containerID="47d4bd3147d78f5275db848cae677b26cdf338ab1fe23a03e649b9b9d375c956" exitCode=0
Jul 27 19:31:36.395861 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:36.395709    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bdd7d2a-00f3-4510-a374-d902d1a896e2","Type":"ContainerDied","Data":"47d4bd3147d78f5275db848cae677b26cdf338ab1fe23a03e649b9b9d375c956"}
Jul 27 19:31:36.395861 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:36.395797    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bdd7d2a-00f3-4510-a374-d902d1a896e2","Type":"ContainerStarted","Data":"53f9adaf34ca9720777681b0ea40d78ddb6df569b4af2c3d0b9f02a91372001a"}
Jul 27 19:31:37.382466 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:37.382431    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b99e054d-fec5-4848-bf11-482390277a41" path="/var/lib/kubelet/pods/b99e054d-fec5-4848-bf11-482390277a41/volumes"
Jul 27 19:31:37.405222 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:37.405188    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bdd7d2a-00f3-4510-a374-d902d1a896e2","Type":"ContainerStarted","Data":"106717441a667db5aa825e289eaf30165b5e709bdfe0a22b7685a1b553c7e402"}
Jul 27 19:31:37.405412 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:37.405252    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bdd7d2a-00f3-4510-a374-d902d1a896e2","Type":"ContainerStarted","Data":"9fd9899b02e21652d1c39f3e668e099e41511396c6c31dca0517a7f44fb67888"}
Jul 27 19:31:37.405412 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:37.405279    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bdd7d2a-00f3-4510-a374-d902d1a896e2","Type":"ContainerStarted","Data":"5982bd7132ee0033d171ac3f1f9041174f85db167ccf0a42f33267a377818f79"}
Jul 27 19:31:37.405412 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:37.405302    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bdd7d2a-00f3-4510-a374-d902d1a896e2","Type":"ContainerStarted","Data":"189067a21aba6a4328343a0694b601fae09232de6836114be8ec237c0c7e0e0d"}
Jul 27 19:31:37.405412 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:37.405325    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bdd7d2a-00f3-4510-a374-d902d1a896e2","Type":"ContainerStarted","Data":"b52578932ac10ff43fbe09d8355df0778c1d0e321c8ab89549c90fdf01c455b3"}
Jul 27 19:31:37.405412 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:37.405348    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0bdd7d2a-00f3-4510-a374-d902d1a896e2","Type":"ContainerStarted","Data":"46c80ec482ab005c5fe653138a6326c0db833548725b016b61147136e78c69ce"}
Jul 27 19:31:37.433025 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:37.432961    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.413373025 podStartE2EDuration="2.432941404s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.568379ms" isStatefulPod=false podCreationTimestamp="2026-07-27 19:31:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:31:37.432204446 +0000 UTC m=+314.560568246" watchObservedRunningTime="2026-07-27 19:31:37.432941404 +0000 UTC m=+314.561305201"
Jul 27 19:31:40.758960 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:31:40.758921    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:32:35.759074 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:32:35.759024    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:32:35.774801 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:32:35.774778    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:32:36.632186 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:32:36.632155    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:33:13.265715 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:13.265672    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mqnpr"]
Jul 27 19:33:13.268963 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:13.268946    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mqnpr"
Jul 27 19:33:13.272656 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:13.272629    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-x4dpm\""
Jul 27 19:33:13.273658 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:13.273635    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 19:33:13.273658 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:13.273655    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:33:13.286255 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:13.286231    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mqnpr"]
Jul 27 19:33:13.325863 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:13.325823    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqgn9\" (UniqueName: \"kubernetes.io/projected/a0d34c7d-b446-4c6c-90d5-3502de2c0ab6-kube-api-access-gqgn9\") pod \"openshift-lws-operator-fd8ccff4c-mqnpr\" (UID: \"a0d34c7d-b446-4c6c-90d5-3502de2c0ab6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mqnpr"
Jul 27 19:33:13.326073 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:13.325883    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0d34c7d-b446-4c6c-90d5-3502de2c0ab6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mqnpr\" (UID: \"a0d34c7d-b446-4c6c-90d5-3502de2c0ab6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mqnpr"
Jul 27 19:33:13.427490 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:13.427448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0d34c7d-b446-4c6c-90d5-3502de2c0ab6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mqnpr\" (UID: \"a0d34c7d-b446-4c6c-90d5-3502de2c0ab6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mqnpr"
Jul 27 19:33:13.427701 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:13.427566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqgn9\" (UniqueName: \"kubernetes.io/projected/a0d34c7d-b446-4c6c-90d5-3502de2c0ab6-kube-api-access-gqgn9\") pod \"openshift-lws-operator-fd8ccff4c-mqnpr\" (UID: \"a0d34c7d-b446-4c6c-90d5-3502de2c0ab6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mqnpr"
Jul 27 19:33:13.428402 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:13.428376    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0d34c7d-b446-4c6c-90d5-3502de2c0ab6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mqnpr\" (UID: \"a0d34c7d-b446-4c6c-90d5-3502de2c0ab6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mqnpr"
Jul 27 19:33:13.435940 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:13.435917    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqgn9\" (UniqueName: \"kubernetes.io/projected/a0d34c7d-b446-4c6c-90d5-3502de2c0ab6-kube-api-access-gqgn9\") pod \"openshift-lws-operator-fd8ccff4c-mqnpr\" (UID: \"a0d34c7d-b446-4c6c-90d5-3502de2c0ab6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mqnpr"
Jul 27 19:33:13.597249 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:13.597197    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mqnpr"
Jul 27 19:33:13.727764 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:13.727738    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mqnpr"]
Jul 27 19:33:13.730400 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:33:13.730365    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0d34c7d_b446_4c6c_90d5_3502de2c0ab6.slice/crio-867e2a515d222d67de4438f151e797e33ceb58dad320c3ee6d2ae8eead6ff49c WatchSource:0}: Error finding container 867e2a515d222d67de4438f151e797e33ceb58dad320c3ee6d2ae8eead6ff49c: Status 404 returned error can't find the container with id 867e2a515d222d67de4438f151e797e33ceb58dad320c3ee6d2ae8eead6ff49c
Jul 27 19:33:13.731849 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:13.731832    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:33:13.756876 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:13.756839    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mqnpr" event={"ID":"a0d34c7d-b446-4c6c-90d5-3502de2c0ab6","Type":"ContainerStarted","Data":"867e2a515d222d67de4438f151e797e33ceb58dad320c3ee6d2ae8eead6ff49c"}
Jul 27 19:33:16.771784 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:16.771748    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mqnpr" event={"ID":"a0d34c7d-b446-4c6c-90d5-3502de2c0ab6","Type":"ContainerStarted","Data":"9a5a2594a8c555e7295cc8940960bfd215c7cac3e0f3074c1314814267e4ea1b"}
Jul 27 19:33:16.788985 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:16.788933    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mqnpr" podStartSLOduration=1.458108872 podStartE2EDuration="3.788917418s" totalImagesPullingTime="2.330808546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:16.788477385 +0000 UTC m=+413.916841181" watchObservedRunningTime="2026-07-27 19:33:16.788917418 +0000 UTC m=+413.917281213"
Jul 27 19:33:34.069895 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.069856    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"]
Jul 27 19:33:34.075620 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.075597    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"
Jul 27 19:33:34.079082 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.079029    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 19:33:34.079241 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.079083    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ckjgb\""
Jul 27 19:33:34.079241 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.079138    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 19:33:34.079241 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.079178    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 19:33:34.083567 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.083543    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"]
Jul 27 19:33:34.199216 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.199173    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d466da4f-694e-4458-9e35-55f2ba44beb0-manager-config\") pod \"lws-controller-manager-86d698cc8c-7zwbc\" (UID: \"d466da4f-694e-4458-9e35-55f2ba44beb0\") " pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"
Jul 27 19:33:34.199216 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.199212    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d466da4f-694e-4458-9e35-55f2ba44beb0-metrics-cert\") pod \"lws-controller-manager-86d698cc8c-7zwbc\" (UID: \"d466da4f-694e-4458-9e35-55f2ba44beb0\") " pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"
Jul 27 19:33:34.199446 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.199240    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d466da4f-694e-4458-9e35-55f2ba44beb0-cert\") pod \"lws-controller-manager-86d698cc8c-7zwbc\" (UID: \"d466da4f-694e-4458-9e35-55f2ba44beb0\") " pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"
Jul 27 19:33:34.199446 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.199262    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5km8\" (UniqueName: \"kubernetes.io/projected/d466da4f-694e-4458-9e35-55f2ba44beb0-kube-api-access-r5km8\") pod \"lws-controller-manager-86d698cc8c-7zwbc\" (UID: \"d466da4f-694e-4458-9e35-55f2ba44beb0\") " pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"
Jul 27 19:33:34.300374 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.300330    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d466da4f-694e-4458-9e35-55f2ba44beb0-manager-config\") pod \"lws-controller-manager-86d698cc8c-7zwbc\" (UID: \"d466da4f-694e-4458-9e35-55f2ba44beb0\") " pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"
Jul 27 19:33:34.300374 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.300378    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d466da4f-694e-4458-9e35-55f2ba44beb0-metrics-cert\") pod \"lws-controller-manager-86d698cc8c-7zwbc\" (UID: \"d466da4f-694e-4458-9e35-55f2ba44beb0\") " pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"
Jul 27 19:33:34.300638 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.300506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d466da4f-694e-4458-9e35-55f2ba44beb0-cert\") pod \"lws-controller-manager-86d698cc8c-7zwbc\" (UID: \"d466da4f-694e-4458-9e35-55f2ba44beb0\") " pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"
Jul 27 19:33:34.300638 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.300546    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5km8\" (UniqueName: \"kubernetes.io/projected/d466da4f-694e-4458-9e35-55f2ba44beb0-kube-api-access-r5km8\") pod \"lws-controller-manager-86d698cc8c-7zwbc\" (UID: \"d466da4f-694e-4458-9e35-55f2ba44beb0\") " pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"
Jul 27 19:33:34.301031 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.301006    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d466da4f-694e-4458-9e35-55f2ba44beb0-manager-config\") pod \"lws-controller-manager-86d698cc8c-7zwbc\" (UID: \"d466da4f-694e-4458-9e35-55f2ba44beb0\") " pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"
Jul 27 19:33:34.302934 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.302917    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d466da4f-694e-4458-9e35-55f2ba44beb0-cert\") pod \"lws-controller-manager-86d698cc8c-7zwbc\" (UID: \"d466da4f-694e-4458-9e35-55f2ba44beb0\") " pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"
Jul 27 19:33:34.303097 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.303080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d466da4f-694e-4458-9e35-55f2ba44beb0-metrics-cert\") pod \"lws-controller-manager-86d698cc8c-7zwbc\" (UID: \"d466da4f-694e-4458-9e35-55f2ba44beb0\") " pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"
Jul 27 19:33:34.316097 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.316046    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5km8\" (UniqueName: \"kubernetes.io/projected/d466da4f-694e-4458-9e35-55f2ba44beb0-kube-api-access-r5km8\") pod \"lws-controller-manager-86d698cc8c-7zwbc\" (UID: \"d466da4f-694e-4458-9e35-55f2ba44beb0\") " pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"
Jul 27 19:33:34.385932 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.385829    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"
Jul 27 19:33:34.522115 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.521961    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"]
Jul 27 19:33:34.524749 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:33:34.524725    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd466da4f_694e_4458_9e35_55f2ba44beb0.slice/crio-bb3d0ebdca571a3dc72096bb459ade24dbd65a728b5392a1a08560431e826213 WatchSource:0}: Error finding container bb3d0ebdca571a3dc72096bb459ade24dbd65a728b5392a1a08560431e826213: Status 404 returned error can't find the container with id bb3d0ebdca571a3dc72096bb459ade24dbd65a728b5392a1a08560431e826213
Jul 27 19:33:34.837425 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:34.837387    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc" event={"ID":"d466da4f-694e-4458-9e35-55f2ba44beb0","Type":"ContainerStarted","Data":"bb3d0ebdca571a3dc72096bb459ade24dbd65a728b5392a1a08560431e826213"}
Jul 27 19:33:37.222644 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.222547    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"]
Jul 27 19:33:37.226216 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.226193    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:37.229333 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.229310    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 19:33:37.229462 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.229363    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 19:33:37.229462 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.229385    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 19:33:37.229590 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.229473    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-grzqz\""
Jul 27 19:33:37.229789 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.229768    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 19:33:37.246546 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.246525    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"]
Jul 27 19:33:37.327452 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.327414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/041583f0-545e-47f7-b7c1-e885851f4aed-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz\" (UID: \"041583f0-545e-47f7-b7c1-e885851f4aed\") " pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:37.327661 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.327481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/041583f0-545e-47f7-b7c1-e885851f4aed-manifests\") pod \"opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz\" (UID: \"041583f0-545e-47f7-b7c1-e885851f4aed\") " pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:37.327661 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.327537    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdp8d\" (UniqueName: \"kubernetes.io/projected/041583f0-545e-47f7-b7c1-e885851f4aed-kube-api-access-fdp8d\") pod \"opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz\" (UID: \"041583f0-545e-47f7-b7c1-e885851f4aed\") " pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:37.327661 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.327574    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/041583f0-545e-47f7-b7c1-e885851f4aed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz\" (UID: \"041583f0-545e-47f7-b7c1-e885851f4aed\") " pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:37.327661 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.327597    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/041583f0-545e-47f7-b7c1-e885851f4aed-tmp\") pod \"opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz\" (UID: \"041583f0-545e-47f7-b7c1-e885851f4aed\") " pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:37.429048 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.429010    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/041583f0-545e-47f7-b7c1-e885851f4aed-manifests\") pod \"opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz\" (UID: \"041583f0-545e-47f7-b7c1-e885851f4aed\") " pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:37.429234 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.429077    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdp8d\" (UniqueName: \"kubernetes.io/projected/041583f0-545e-47f7-b7c1-e885851f4aed-kube-api-access-fdp8d\") pod \"opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz\" (UID: \"041583f0-545e-47f7-b7c1-e885851f4aed\") " pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:37.429234 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.429117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/041583f0-545e-47f7-b7c1-e885851f4aed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz\" (UID: \"041583f0-545e-47f7-b7c1-e885851f4aed\") " pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:37.429234 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.429140    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/041583f0-545e-47f7-b7c1-e885851f4aed-tmp\") pod \"opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz\" (UID: \"041583f0-545e-47f7-b7c1-e885851f4aed\") " pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:37.429234 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.429201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/041583f0-545e-47f7-b7c1-e885851f4aed-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz\" (UID: \"041583f0-545e-47f7-b7c1-e885851f4aed\") " pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:37.429447 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.429408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/041583f0-545e-47f7-b7c1-e885851f4aed-manifests\") pod \"opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz\" (UID: \"041583f0-545e-47f7-b7c1-e885851f4aed\") " pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:37.431737 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.431694    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/041583f0-545e-47f7-b7c1-e885851f4aed-tmp\") pod \"opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz\" (UID: \"041583f0-545e-47f7-b7c1-e885851f4aed\") " pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:37.431861 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.431743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/041583f0-545e-47f7-b7c1-e885851f4aed-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz\" (UID: \"041583f0-545e-47f7-b7c1-e885851f4aed\") " pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:37.431901 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.431862    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/041583f0-545e-47f7-b7c1-e885851f4aed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz\" (UID: \"041583f0-545e-47f7-b7c1-e885851f4aed\") " pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:37.438974 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.438944    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdp8d\" (UniqueName: \"kubernetes.io/projected/041583f0-545e-47f7-b7c1-e885851f4aed-kube-api-access-fdp8d\") pod \"opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz\" (UID: \"041583f0-545e-47f7-b7c1-e885851f4aed\") " pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:37.536250 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.536212    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:37.687421 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.687341    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"]
Jul 27 19:33:37.690262 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:33:37.690235    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041583f0_545e_47f7_b7c1_e885851f4aed.slice/crio-0b239c84651aebaa1b9929926db4d13f6cef370140d829c2b0a35c48181ff95c WatchSource:0}: Error finding container 0b239c84651aebaa1b9929926db4d13f6cef370140d829c2b0a35c48181ff95c: Status 404 returned error can't find the container with id 0b239c84651aebaa1b9929926db4d13f6cef370140d829c2b0a35c48181ff95c
Jul 27 19:33:37.853610 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.853502    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc" event={"ID":"d466da4f-694e-4458-9e35-55f2ba44beb0","Type":"ContainerStarted","Data":"d4dda41848e235b76872c8300f8d9a79e3589ae7409d8825eaafdf6607009839"}
Jul 27 19:33:37.853610 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.853575    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"
Jul 27 19:33:37.854787 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.854764    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz" event={"ID":"041583f0-545e-47f7-b7c1-e885851f4aed","Type":"ContainerStarted","Data":"0b239c84651aebaa1b9929926db4d13f6cef370140d829c2b0a35c48181ff95c"}
Jul 27 19:33:37.872959 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:37.872907    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc" podStartSLOduration=1.438045857 podStartE2EDuration="3.872891131s" totalImagesPullingTime="2.434845274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:37.871405092 +0000 UTC m=+434.999768888" watchObservedRunningTime="2026-07-27 19:33:37.872891131 +0000 UTC m=+435.001254927"
Jul 27 19:33:40.870774 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:40.870731    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz" event={"ID":"041583f0-545e-47f7-b7c1-e885851f4aed","Type":"ContainerStarted","Data":"1f93008307870c5a9b3112df59d88e5f6fc5f7e8c0a68636f1a28b5c21841aab"}
Jul 27 19:33:41.876204 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:41.876112    2578 generic.go:356] "Generic (PLEG): container finished" podID="041583f0-545e-47f7-b7c1-e885851f4aed" containerID="1f93008307870c5a9b3112df59d88e5f6fc5f7e8c0a68636f1a28b5c21841aab" exitCode=0
Jul 27 19:33:41.876204 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:41.876152    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz" event={"ID":"041583f0-545e-47f7-b7c1-e885851f4aed","Type":"ContainerDied","Data":"1f93008307870c5a9b3112df59d88e5f6fc5f7e8c0a68636f1a28b5c21841aab"}
Jul 27 19:33:42.882151 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:42.882121    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz" event={"ID":"041583f0-545e-47f7-b7c1-e885851f4aed","Type":"ContainerStarted","Data":"7643697abc92bc2f027aadf3af599583ece698b0a492a0fb2d437580af2a6069"}
Jul 27 19:33:42.882579 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:42.882263    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:33:42.903174 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:42.903127    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz" podStartSLOduration=1.7330933370000001 podStartE2EDuration="5.903110277s" totalImagesPullingTime="3.162830202s" totalInitContainerRuntime="1.007186738s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:42.902868524 +0000 UTC m=+440.031232321" watchObservedRunningTime="2026-07-27 19:33:42.903110277 +0000 UTC m=+440.031474072"
Jul 27 19:33:48.862914 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:48.862833    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-86d698cc8c-7zwbc"
Jul 27 19:33:53.889832 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:33:53.889799    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz"
Jul 27 19:34:06.087094 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.087044    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"]
Jul 27 19:34:06.092070 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.092043    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.108005 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.107985    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 19:34:06.108153 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.108119    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 19:34:06.108224 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.108203    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 19:34:06.108283 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.108240    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-z4rqr\""
Jul 27 19:34:06.151755 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.151724    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"]
Jul 27 19:34:06.165270 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.165241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.165438 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.165278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2lhd\" (UniqueName: \"kubernetes.io/projected/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-kube-api-access-j2lhd\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.165438 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.165304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.165438 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.165323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.165438 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.165379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.165589 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.165519    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.165589 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.165578    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.165661 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.165624    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.165695 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.165669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.266348 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.266306    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.266534 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.266358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.266534 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.266389    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.266534 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.266407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.266534 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.266431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.266534 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.266448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2lhd\" (UniqueName: \"kubernetes.io/projected/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-kube-api-access-j2lhd\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.266534 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.266473    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.266534 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.266490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.266534 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.266524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.267027 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.266768    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.267027 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.266788    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.267027 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.266897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.267027 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.266959    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.267355 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.267333    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.268905 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.268883    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.268960 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.268940    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.275500 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.275476    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2lhd\" (UniqueName: \"kubernetes.io/projected/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-kube-api-access-j2lhd\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.276402 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.276383    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4aafb2c-fd20-4885-a53e-9d59ec2dbc91-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c58mpl\" (UID: \"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.403700 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.403591    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:06.541812 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.541779    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"]
Jul 27 19:34:06.546151 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:34:06.546122    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4aafb2c_fd20_4885_a53e_9d59ec2dbc91.slice/crio-5c71d9d73f79181a5538a95623efd66b8a9e7c12746b6b6c8b96a4aa58991cc8 WatchSource:0}: Error finding container 5c71d9d73f79181a5538a95623efd66b8a9e7c12746b6b6c8b96a4aa58991cc8: Status 404 returned error can't find the container with id 5c71d9d73f79181a5538a95623efd66b8a9e7c12746b6b6c8b96a4aa58991cc8
Jul 27 19:34:06.980990 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:06.980955    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl" event={"ID":"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91","Type":"ContainerStarted","Data":"5c71d9d73f79181a5538a95623efd66b8a9e7c12746b6b6c8b96a4aa58991cc8"}
Jul 27 19:34:08.808851 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.808812    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"]
Jul 27 19:34:08.813313 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.813290    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.816126 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.815921    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 19:34:08.816126 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.815921    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 19:34:08.816126 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.815956    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 19:34:08.816126 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.816007    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ln5c8\""
Jul 27 19:34:08.824776 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.824751    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"]
Jul 27 19:34:08.889930 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.889894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvsng\" (UniqueName: \"kubernetes.io/projected/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-kube-api-access-xvsng\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.889930 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.889935    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.890217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.889977    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.890217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.890078    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.890217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.890153    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.890217 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.890189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.890395 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.890305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.990806 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.990775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.990806 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.990817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.991098 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.990862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.991098 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.990893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvsng\" (UniqueName: \"kubernetes.io/projected/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-kube-api-access-xvsng\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.991098 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.990917    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.991098 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.990989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.991098 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.991042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.991681 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.991608    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.994188 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.994138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.994313 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.994295    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.994371 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.994336    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:08.994627 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:08.994605    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:09.002786 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:09.002733    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvsng\" (UniqueName: \"kubernetes.io/projected/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-kube-api-access-xvsng\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:09.003422 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:09.003377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mp89s\" (UID: \"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:09.126518 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:09.126433    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:09.185201 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:09.185162    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:34:09.185281 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:09.185240    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:34:09.185281 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:09.185272    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:34:09.292264 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:09.292237    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"]
Jul 27 19:34:09.293984 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:34:09.293951    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf5c1ef_4da1_4f6b_8fe1_6530ba9f5f47.slice/crio-3aa98793de0f81b9c892678598fc81f4c8fcb6d8f70bedeb429f318a6e761917 WatchSource:0}: Error finding container 3aa98793de0f81b9c892678598fc81f4c8fcb6d8f70bedeb429f318a6e761917: Status 404 returned error can't find the container with id 3aa98793de0f81b9c892678598fc81f4c8fcb6d8f70bedeb429f318a6e761917
Jul 27 19:34:10.001452 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:10.001418    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl" event={"ID":"f4aafb2c-fd20-4885-a53e-9d59ec2dbc91","Type":"ContainerStarted","Data":"4b7db3e1a7707c343357bd2ab5f35e7bba16d94b232381d8863faef5e61a8d5e"}
Jul 27 19:34:10.003337 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:10.003304    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s" event={"ID":"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47","Type":"ContainerStarted","Data":"3aa98793de0f81b9c892678598fc81f4c8fcb6d8f70bedeb429f318a6e761917"}
Jul 27 19:34:10.039537 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:10.039478    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl" podStartSLOduration=1.402784122 podStartE2EDuration="4.039461937s" totalImagesPullingTime="2.636677815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:10.037616527 +0000 UTC m=+467.165980327" watchObservedRunningTime="2026-07-27 19:34:10.039461937 +0000 UTC m=+467.167825733"
Jul 27 19:34:10.403862 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:10.403830    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:10.409354 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:10.409326    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:11.007959 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:11.007923    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:11.009116 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:11.009092    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c58mpl"
Jul 27 19:34:12.035109 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:12.035072    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:34:12.035404 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:12.035145    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:34:13.019377 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:13.019333    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s" event={"ID":"3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47","Type":"ContainerStarted","Data":"2e98ebb3bf9c64b9c5ad6dc0ef66a3dab840731e42a219e6d3bab3ebf90be948"}
Jul 27 19:34:13.019739 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:13.019719    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:13.021496 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:13.021475    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s"
Jul 27 19:34:13.057106 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:34:13.057025    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mp89s" podStartSLOduration=2.3184775269999998 podStartE2EDuration="5.057005197s" totalImagesPullingTime="2.73852767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:13.055822324 +0000 UTC m=+470.184186124" watchObservedRunningTime="2026-07-27 19:34:13.057005197 +0000 UTC m=+470.185368996"
Jul 27 19:36:33.756527 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:33.756492    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:36:33.759873 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:33.759857    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-c84hg"
Jul 27 19:36:33.762438 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:33.762409    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 19:36:33.762438 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:33.762415    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 19:36:33.762613 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:33.762459    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-d5plc\""
Jul 27 19:36:33.763409 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:33.763393    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 19:36:33.768231 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:33.768207    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:36:33.780084 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:33.780032    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:36:33.863379 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:33.863343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tlnh\" (UniqueName: \"kubernetes.io/projected/e90712a2-b471-44e0-b347-91de18834100-kube-api-access-2tlnh\") pod \"limitador-limitador-54d6d988d5-c84hg\" (UID: \"e90712a2-b471-44e0-b347-91de18834100\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c84hg"
Jul 27 19:36:33.863558 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:33.863393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e90712a2-b471-44e0-b347-91de18834100-config-file\") pod \"limitador-limitador-54d6d988d5-c84hg\" (UID: \"e90712a2-b471-44e0-b347-91de18834100\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c84hg"
Jul 27 19:36:33.964593 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:33.964557    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tlnh\" (UniqueName: \"kubernetes.io/projected/e90712a2-b471-44e0-b347-91de18834100-kube-api-access-2tlnh\") pod \"limitador-limitador-54d6d988d5-c84hg\" (UID: \"e90712a2-b471-44e0-b347-91de18834100\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c84hg"
Jul 27 19:36:33.964770 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:33.964616    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e90712a2-b471-44e0-b347-91de18834100-config-file\") pod \"limitador-limitador-54d6d988d5-c84hg\" (UID: \"e90712a2-b471-44e0-b347-91de18834100\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c84hg"
Jul 27 19:36:33.965302 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:33.965275    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e90712a2-b471-44e0-b347-91de18834100-config-file\") pod \"limitador-limitador-54d6d988d5-c84hg\" (UID: \"e90712a2-b471-44e0-b347-91de18834100\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c84hg"
Jul 27 19:36:33.973542 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:33.973518    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tlnh\" (UniqueName: \"kubernetes.io/projected/e90712a2-b471-44e0-b347-91de18834100-kube-api-access-2tlnh\") pod \"limitador-limitador-54d6d988d5-c84hg\" (UID: \"e90712a2-b471-44e0-b347-91de18834100\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c84hg"
Jul 27 19:36:34.070230 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:34.070189    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-c84hg"
Jul 27 19:36:34.198574 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:34.198551    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:36:34.200817 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:36:34.200790    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode90712a2_b471_44e0_b347_91de18834100.slice/crio-9ea29803307dd52d04aeebd554c65882610123da580a994b98b0de17eb044a01 WatchSource:0}: Error finding container 9ea29803307dd52d04aeebd554c65882610123da580a994b98b0de17eb044a01: Status 404 returned error can't find the container with id 9ea29803307dd52d04aeebd554c65882610123da580a994b98b0de17eb044a01
Jul 27 19:36:34.631021 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:34.630988    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-c84hg" event={"ID":"e90712a2-b471-44e0-b347-91de18834100","Type":"ContainerStarted","Data":"9ea29803307dd52d04aeebd554c65882610123da580a994b98b0de17eb044a01"}
Jul 27 19:36:37.645921 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:37.645884    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-c84hg" event={"ID":"e90712a2-b471-44e0-b347-91de18834100","Type":"ContainerStarted","Data":"030b203d193ed3009c4613d7f7f6b7fcb30d740ea4fecb42892243826d6fb155"}
Jul 27 19:36:37.646349 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:37.646029    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-c84hg"
Jul 27 19:36:37.662248 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:37.662199    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-c84hg" podStartSLOduration=2.169146321 podStartE2EDuration="4.662182329s" totalImagesPullingTime="2.493036008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:36:37.660864418 +0000 UTC m=+614.789228214" watchObservedRunningTime="2026-07-27 19:36:37.662182329 +0000 UTC m=+614.790546125"
Jul 27 19:36:48.651851 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:36:48.651775    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-c84hg"
Jul 27 19:37:52.278232 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:37:52.278195    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:38:30.871530 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:30.871489    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:38:39.075181 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:39.075141    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:38:46.417172 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.417141    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"]
Jul 27 19:38:46.420575 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.420554    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.423158 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.423134    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zc62b\""
Jul 27 19:38:46.424378 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.424355    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 19:38:46.424378 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.424365    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 27 19:38:46.424561 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.424387    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 19:38:46.429115 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.429097    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"]
Jul 27 19:38:46.541024 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.540999    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm4dj\" (UniqueName: \"kubernetes.io/projected/8fb13281-5105-4025-a107-cbec9d821391-kube-api-access-pm4dj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.541145 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.541044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fb13281-5105-4025-a107-cbec9d821391-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.541145 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.541109    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fb13281-5105-4025-a107-cbec9d821391-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.541222 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.541161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fb13281-5105-4025-a107-cbec9d821391-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.541222 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.541185    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fb13281-5105-4025-a107-cbec9d821391-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.541222 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.541210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fb13281-5105-4025-a107-cbec9d821391-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.642523 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.642501    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fb13281-5105-4025-a107-cbec9d821391-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.642655 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.642538    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fb13281-5105-4025-a107-cbec9d821391-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.642655 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.642558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fb13281-5105-4025-a107-cbec9d821391-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.642655 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.642580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fb13281-5105-4025-a107-cbec9d821391-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.642655 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.642619    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm4dj\" (UniqueName: \"kubernetes.io/projected/8fb13281-5105-4025-a107-cbec9d821391-kube-api-access-pm4dj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.642822 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.642665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fb13281-5105-4025-a107-cbec9d821391-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.642998 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.642971    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fb13281-5105-4025-a107-cbec9d821391-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.643135 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.643007    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fb13281-5105-4025-a107-cbec9d821391-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.643135 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.643110    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fb13281-5105-4025-a107-cbec9d821391-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.644792 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.644769    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fb13281-5105-4025-a107-cbec9d821391-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.645088 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.645047    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fb13281-5105-4025-a107-cbec9d821391-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.651244 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.651226    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm4dj\" (UniqueName: \"kubernetes.io/projected/8fb13281-5105-4025-a107-cbec9d821391-kube-api-access-pm4dj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mkcgm\" (UID: \"8fb13281-5105-4025-a107-cbec9d821391\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.733433 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.733376    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:46.859321 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.859297    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"]
Jul 27 19:38:46.862099 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:38:46.862071    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fb13281_5105_4025_a107_cbec9d821391.slice/crio-1f758f0275c3dc2b02c51a112d46b1607b9ac50cfa00507f1a64813c48c3ba93 WatchSource:0}: Error finding container 1f758f0275c3dc2b02c51a112d46b1607b9ac50cfa00507f1a64813c48c3ba93: Status 404 returned error can't find the container with id 1f758f0275c3dc2b02c51a112d46b1607b9ac50cfa00507f1a64813c48c3ba93
Jul 27 19:38:46.863774 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:46.863758    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:38:47.212535 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:47.212499    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm" event={"ID":"8fb13281-5105-4025-a107-cbec9d821391","Type":"ContainerStarted","Data":"1f758f0275c3dc2b02c51a112d46b1607b9ac50cfa00507f1a64813c48c3ba93"}
Jul 27 19:38:47.478875 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:47.478792    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:38:48.218951 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:48.218864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm" event={"ID":"8fb13281-5105-4025-a107-cbec9d821391","Type":"ContainerStarted","Data":"1713ae8456a3f2a59ff0a769b71bfbe11e1f15f00240c5fd25a73ef63a94495c"}
Jul 27 19:38:48.236780 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:48.236716    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm" podStartSLOduration=1.249452841 podStartE2EDuration="2.236698563s" totalImagesPullingTime="987.245722ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:38:48.234899107 +0000 UTC m=+745.363262907" watchObservedRunningTime="2026-07-27 19:38:48.236698563 +0000 UTC m=+745.365062359"
Jul 27 19:38:55.681728 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:55.681685    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:38:56.733820 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:56.733784    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:56.734207 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:56.733847    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:56.746230 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:56.746207    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:38:57.272771 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:38:57.272747    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mkcgm"
Jul 27 19:39:04.173308 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:39:04.173270    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:39:16.773037 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:39:16.773002    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:40:33.180016 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:40:33.179976    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:40:43.577774 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:40:43.577733    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:40:54.077122 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:40:54.077074    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:42:33.683910 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:42:33.683877    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:42:45.072577 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:42:45.072499    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:43:19.584941 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:43:19.584903    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:43:27.382340 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:43:27.382307    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:43:36.675507 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:43:36.675464    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:43:43.368309 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:43:43.368269    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:43:54.874978 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:43:54.874938    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:44:05.074101 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:44:05.074050    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:44:16.734296 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:44:16.734220    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:44:27.473409 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:44:27.473379    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:44:48.576911 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:44:48.576871    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:44:57.876541 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:44:57.876496    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:45:00.148945 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:00.148916    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753025-9t9nd"]
Jul 27 19:45:00.152101 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:00.152084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-9t9nd"
Jul 27 19:45:00.154660 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:00.154643    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-875sf\""
Jul 27 19:45:00.161014 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:00.160999    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-9t9nd"
Jul 27 19:45:00.166222 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:00.166187    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753025-9t9nd"]
Jul 27 19:45:00.351188 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:00.350997    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753025-9t9nd"]
Jul 27 19:45:00.354141 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:45:00.354112    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd90b24b_3a32_4277_9690_a51b20a24dbf.slice/crio-8bf7ab01015892fb22db45a1aaaf802f0002ded648f56e57f3e1b31c06b60885 WatchSource:0}: Error finding container 8bf7ab01015892fb22db45a1aaaf802f0002ded648f56e57f3e1b31c06b60885: Status 404 returned error can't find the container with id 8bf7ab01015892fb22db45a1aaaf802f0002ded648f56e57f3e1b31c06b60885
Jul 27 19:45:00.356458 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:00.356441    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:45:00.868121 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:00.868069    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-9t9nd" event={"ID":"fd90b24b-3a32-4277-9690-a51b20a24dbf","Type":"ContainerStarted","Data":"8bf7ab01015892fb22db45a1aaaf802f0002ded648f56e57f3e1b31c06b60885"}
Jul 27 19:45:03.886635 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:03.886605    2578 generic.go:356] "Generic (PLEG): container finished" podID="fd90b24b-3a32-4277-9690-a51b20a24dbf" containerID="12bdaf989cc51aa675ba130de828a8eca2767eaa003afac43cf461fc516c2098" exitCode=0
Jul 27 19:45:03.887069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:03.886645    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-9t9nd" event={"ID":"fd90b24b-3a32-4277-9690-a51b20a24dbf","Type":"ContainerDied","Data":"12bdaf989cc51aa675ba130de828a8eca2767eaa003afac43cf461fc516c2098"}
Jul 27 19:45:05.016355 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:05.016331    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-9t9nd"
Jul 27 19:45:05.896100 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:05.896076    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-9t9nd"
Jul 27 19:45:05.896100 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:05.896089    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-9t9nd" event={"ID":"fd90b24b-3a32-4277-9690-a51b20a24dbf","Type":"ContainerDied","Data":"8bf7ab01015892fb22db45a1aaaf802f0002ded648f56e57f3e1b31c06b60885"}
Jul 27 19:45:05.896306 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:05.896132    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bf7ab01015892fb22db45a1aaaf802f0002ded648f56e57f3e1b31c06b60885"
Jul 27 19:45:20.479286 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:20.479248    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:45:31.274649 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:31.274617    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:45:47.687014 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:47.686924    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:45:56.884703 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:45:56.884666    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:46:07.085289 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:46:07.085251    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:46:16.966589 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:46:16.966555    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:46:27.069707 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:46:27.069674    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:48:14.675603 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:48:14.675566    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:48:23.972455 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:48:23.972423    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:48:36.886753 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:48:36.886719    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:48:50.586768 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:48:50.586686    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:49:00.587213 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:49:00.587178    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:49:10.270976 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:49:10.270932    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:49:18.473048 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:49:18.473011    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:49:29.387041 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:49:29.387010    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:49:41.271544 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:49:41.271513    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:49:49.975208 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:49:49.975175    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:50:00.777528 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:50:00.777495    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:50:21.483497 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:50:21.483412    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:50:30.973522 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:50:30.973486    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:50:53.475542 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:50:53.475508    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:51:13.374382 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:51:13.374343    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:51:44.176859 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:51:44.176774    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:51:58.077994 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:51:58.077962    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:52:04.779849 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:52:04.779821    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:52:20.977883 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:52:20.977851    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:52:31.580922 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:52:31.580884    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:52:41.274840 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:52:41.274808    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:52:49.078929 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:52:49.078891    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:52:58.581956 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:52:58.581922    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:53:08.171515 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:53:08.171475    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:53:21.281955 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:53:21.281920    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:53:30.374959 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:53:30.374925    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:53:40.670934 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:53:40.670901    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:53:53.176856 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:53:53.176815    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:54:02.367258 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:54:02.367220    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:54:12.478751 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:54:12.478717    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:54:25.189833 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:54:25.189797    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:54:37.077761 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:54:37.077718    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:54:48.680106 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:54:48.680033    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:54:59.383227 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:54:59.383198    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:55:10.678456 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:10.678422    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:55:20.920603 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:20.920562    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"]
Jul 27 19:55:20.920980 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:20.920920    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd90b24b-3a32-4277-9690-a51b20a24dbf" containerName="cleanup"
Jul 27 19:55:20.920980 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:20.920931    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd90b24b-3a32-4277-9690-a51b20a24dbf" containerName="cleanup"
Jul 27 19:55:20.921089 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:20.920993    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd90b24b-3a32-4277-9690-a51b20a24dbf" containerName="cleanup"
Jul 27 19:55:20.924136 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:20.924121    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:20.926614 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:20.926595    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-aad6c451-openshift-default-dockercfg-4dkpk\""
Jul 27 19:55:20.943686 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:20.943653    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"]
Jul 27 19:55:21.013884 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.013857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-credential-socket\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.014096 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.013892    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-workload-certs\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.014096 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.013926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2kc6\" (UniqueName: \"kubernetes.io/projected/79464d07-4627-4122-b6ed-e9c992065ed7-kube-api-access-t2kc6\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.014096 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.014000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79464d07-4627-4122-b6ed-e9c992065ed7-istio-token\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.014265 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.014120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-workload-socket\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.014265 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.014162    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-istio-envoy\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.014265 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.014190    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79464d07-4627-4122-b6ed-e9c992065ed7-istiod-ca-cert\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.014381 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.014261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-istio-data\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.014381 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.014296    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79464d07-4627-4122-b6ed-e9c992065ed7-istio-podinfo\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.084980 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.084947    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:55:21.115512 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.115480    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-workload-socket\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.115644 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.115525    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-istio-envoy\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.115644 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.115543    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79464d07-4627-4122-b6ed-e9c992065ed7-istiod-ca-cert\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.115729 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.115661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-istio-data\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.115729 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.115717    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79464d07-4627-4122-b6ed-e9c992065ed7-istio-podinfo\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.115834 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.115754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-credential-socket\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.115834 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.115792    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-workload-certs\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.115939 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.115836    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2kc6\" (UniqueName: \"kubernetes.io/projected/79464d07-4627-4122-b6ed-e9c992065ed7-kube-api-access-t2kc6\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.115939 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.115864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79464d07-4627-4122-b6ed-e9c992065ed7-istio-token\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.116080 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.116007    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-workload-socket\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.116174 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.116143    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-istio-data\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.116484 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.116462    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79464d07-4627-4122-b6ed-e9c992065ed7-istiod-ca-cert\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.116606 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.116588    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-credential-socket\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.116663 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.116616    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-workload-certs\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.118359 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.118337    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-istio-envoy\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.118647 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.118625    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79464d07-4627-4122-b6ed-e9c992065ed7-istio-podinfo\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.123938 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.123914    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79464d07-4627-4122-b6ed-e9c992065ed7-istio-token\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.124291 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.124273    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2kc6\" (UniqueName: \"kubernetes.io/projected/79464d07-4627-4122-b6ed-e9c992065ed7-kube-api-access-t2kc6\") pod \"e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") " pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.234564 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.234496    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:21.369348 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.369319    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"]
Jul 27 19:55:21.371921 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:55:21.371891    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79464d07_4627_4122_b6ed_e9c992065ed7.slice/crio-a88130e42b6376bc4cf58c34b658e177a157fb59f1529c4cf61ef94734d6e335 WatchSource:0}: Error finding container a88130e42b6376bc4cf58c34b658e177a157fb59f1529c4cf61ef94734d6e335: Status 404 returned error can't find the container with id a88130e42b6376bc4cf58c34b658e177a157fb59f1529c4cf61ef94734d6e335
Jul 27 19:55:21.374500 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.374475    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:55:21.374565 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.374534    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:55:21.374565 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.374560    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:55:21.518237 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.518159    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm" event={"ID":"79464d07-4627-4122-b6ed-e9c992065ed7","Type":"ContainerStarted","Data":"ce0240904f9e3909ded0aea5a984609de1cc4d12c87a6d80658c2187d56daaa1"}
Jul 27 19:55:21.518237 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.518214    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm" event={"ID":"79464d07-4627-4122-b6ed-e9c992065ed7","Type":"ContainerStarted","Data":"a88130e42b6376bc4cf58c34b658e177a157fb59f1529c4cf61ef94734d6e335"}
Jul 27 19:55:21.557471 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:21.557397    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm" podStartSLOduration=1.557375253 podStartE2EDuration="1.557375253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:55:21.553910175 +0000 UTC m=+1738.682274010" watchObservedRunningTime="2026-07-27 19:55:21.557375253 +0000 UTC m=+1738.685739049"
Jul 27 19:55:22.235265 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:22.235230    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:22.240497 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:22.240471    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:22.522807 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:22.522718    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:22.523751 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:22.523733    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:22.986131 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:22.986099    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"]
Jul 27 19:55:22.989468 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:22.989446    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"
Jul 27 19:55:22.992319 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:22.992297    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-86dhg\""
Jul 27 19:55:22.992319 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:22.992307    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-aad6c451-serving-cert\""
Jul 27 19:55:22.992518 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:22.992301    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:55:22.993359 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:22.993344    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:55:22.999094 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:22.999075    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"]
Jul 27 19:55:23.035925 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:23.035898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcqfb\" (UniqueName: \"kubernetes.io/projected/d2b06671-6a31-44a4-8ab0-03f7724c1525-kube-api-access-mcqfb\") pod \"maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4\" (UID: \"d2b06671-6a31-44a4-8ab0-03f7724c1525\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"
Jul 27 19:55:23.036047 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:23.035937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2b06671-6a31-44a4-8ab0-03f7724c1525-maas-api-tls\") pod \"maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4\" (UID: \"d2b06671-6a31-44a4-8ab0-03f7724c1525\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"
Jul 27 19:55:23.036118 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:23.036095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b06671-6a31-44a4-8ab0-03f7724c1525-openshift-service-ca\") pod \"maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4\" (UID: \"d2b06671-6a31-44a4-8ab0-03f7724c1525\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"
Jul 27 19:55:23.137351 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:23.137258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b06671-6a31-44a4-8ab0-03f7724c1525-openshift-service-ca\") pod \"maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4\" (UID: \"d2b06671-6a31-44a4-8ab0-03f7724c1525\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"
Jul 27 19:55:23.137494 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:23.137405    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcqfb\" (UniqueName: \"kubernetes.io/projected/d2b06671-6a31-44a4-8ab0-03f7724c1525-kube-api-access-mcqfb\") pod \"maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4\" (UID: \"d2b06671-6a31-44a4-8ab0-03f7724c1525\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"
Jul 27 19:55:23.137494 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:23.137445    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2b06671-6a31-44a4-8ab0-03f7724c1525-maas-api-tls\") pod \"maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4\" (UID: \"d2b06671-6a31-44a4-8ab0-03f7724c1525\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"
Jul 27 19:55:23.137602 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:55:23.137589    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-serving-cert: secret "maas-api-e2e-ait-aad6c451-serving-cert" not found
Jul 27 19:55:23.137656 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:55:23.137648    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2b06671-6a31-44a4-8ab0-03f7724c1525-maas-api-tls podName:d2b06671-6a31-44a4-8ab0-03f7724c1525 nodeName:}" failed. No retries permitted until 2026-07-27 19:55:23.637629378 +0000 UTC m=+1740.765993154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d2b06671-6a31-44a4-8ab0-03f7724c1525-maas-api-tls") pod "maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4" (UID: "d2b06671-6a31-44a4-8ab0-03f7724c1525") : secret "maas-api-e2e-ait-aad6c451-serving-cert" not found
Jul 27 19:55:23.137970 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:23.137946    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b06671-6a31-44a4-8ab0-03f7724c1525-openshift-service-ca\") pod \"maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4\" (UID: \"d2b06671-6a31-44a4-8ab0-03f7724c1525\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"
Jul 27 19:55:23.146285 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:23.146265    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcqfb\" (UniqueName: \"kubernetes.io/projected/d2b06671-6a31-44a4-8ab0-03f7724c1525-kube-api-access-mcqfb\") pod \"maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4\" (UID: \"d2b06671-6a31-44a4-8ab0-03f7724c1525\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"
Jul 27 19:55:23.641530 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:23.641500    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2b06671-6a31-44a4-8ab0-03f7724c1525-maas-api-tls\") pod \"maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4\" (UID: \"d2b06671-6a31-44a4-8ab0-03f7724c1525\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"
Jul 27 19:55:23.641970 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:55:23.641642    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-serving-cert: secret "maas-api-e2e-ait-aad6c451-serving-cert" not found
Jul 27 19:55:23.641970 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:55:23.641719    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2b06671-6a31-44a4-8ab0-03f7724c1525-maas-api-tls podName:d2b06671-6a31-44a4-8ab0-03f7724c1525 nodeName:}" failed. No retries permitted until 2026-07-27 19:55:24.641699328 +0000 UTC m=+1741.770063104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d2b06671-6a31-44a4-8ab0-03f7724c1525-maas-api-tls") pod "maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4" (UID: "d2b06671-6a31-44a4-8ab0-03f7724c1525") : secret "maas-api-e2e-ait-aad6c451-serving-cert" not found
Jul 27 19:55:24.652414 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:24.652380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2b06671-6a31-44a4-8ab0-03f7724c1525-maas-api-tls\") pod \"maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4\" (UID: \"d2b06671-6a31-44a4-8ab0-03f7724c1525\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"
Jul 27 19:55:24.654905 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:24.654881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2b06671-6a31-44a4-8ab0-03f7724c1525-maas-api-tls\") pod \"maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4\" (UID: \"d2b06671-6a31-44a4-8ab0-03f7724c1525\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"
Jul 27 19:55:24.804671 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:24.804639    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-86dhg\""
Jul 27 19:55:24.812591 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:24.812568    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"
Jul 27 19:55:24.943110 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:24.943085    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"]
Jul 27 19:55:24.944900 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:55:24.944870    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b06671_6a31_44a4_8ab0_03f7724c1525.slice/crio-eaaaa96bb9e337bad312748bca7ff422aae3e2a62502cb935e3786527b0dbfa2 WatchSource:0}: Error finding container eaaaa96bb9e337bad312748bca7ff422aae3e2a62502cb935e3786527b0dbfa2: Status 404 returned error can't find the container with id eaaaa96bb9e337bad312748bca7ff422aae3e2a62502cb935e3786527b0dbfa2
Jul 27 19:55:24.946484 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:24.946465    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:55:25.537873 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:25.537836    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4" event={"ID":"d2b06671-6a31-44a4-8ab0-03f7724c1525","Type":"ContainerStarted","Data":"eaaaa96bb9e337bad312748bca7ff422aae3e2a62502cb935e3786527b0dbfa2"}
Jul 27 19:55:27.548167 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:27.548128    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4" event={"ID":"d2b06671-6a31-44a4-8ab0-03f7724c1525","Type":"ContainerStarted","Data":"99ce85a923ff275f6eae6cd7c5ed6521ed14d92e9b102ef905ef9a009a411cc1"}
Jul 27 19:55:27.548587 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:27.548292    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"
Jul 27 19:55:27.566034 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:27.565986    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4" podStartSLOduration=3.154218791 podStartE2EDuration="5.565972941s" totalImagesPullingTime="2.41175415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:55:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:55:27.564314428 +0000 UTC m=+1744.692678223" watchObservedRunningTime="2026-07-27 19:55:27.565972941 +0000 UTC m=+1744.694336790"
Jul 27 19:55:31.880308 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:31.880266    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:55:33.558894 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:33.558866    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"
Jul 27 19:55:34.582484 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:34.582453    2578 generic.go:356] "Generic (PLEG): container finished" podID="79464d07-4627-4122-b6ed-e9c992065ed7" containerID="ce0240904f9e3909ded0aea5a984609de1cc4d12c87a6d80658c2187d56daaa1" exitCode=0
Jul 27 19:55:34.582934 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:34.582538    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm" event={"ID":"79464d07-4627-4122-b6ed-e9c992065ed7","Type":"ContainerDied","Data":"ce0240904f9e3909ded0aea5a984609de1cc4d12c87a6d80658c2187d56daaa1"}
Jul 27 19:55:34.582934 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:34.582926    2578 scope.go:117] "RemoveContainer" containerID="ce0240904f9e3909ded0aea5a984609de1cc4d12c87a6d80658c2187d56daaa1"
Jul 27 19:55:34.583872 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:34.583847    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:55:34.583923 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:34.583912    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:55:34.583961 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:34.583943    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:55:35.591609 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:35.591563    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm" event={"ID":"79464d07-4627-4122-b6ed-e9c992065ed7","Type":"ContainerStarted","Data":"2c28ffb0ccc37fed003379cc1f27808451ebb8830f3e150a3b855ca468fa3028"}
Jul 27 19:55:36.235310 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:36.235277    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:36.236486 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:36.236450    2578 patch_prober.go:28] interesting pod/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 27 19:55:36.236612 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:36.236512    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm" podUID="79464d07-4627-4122-b6ed-e9c992065ed7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 27 19:55:37.235885 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:37.235846    2578 patch_prober.go:28] interesting pod/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 27 19:55:37.236292 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:37.235926    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm" podUID="79464d07-4627-4122-b6ed-e9c992065ed7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 27 19:55:37.522896 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:37.522806    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:38.234968 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:38.234935    2578 patch_prober.go:28] interesting pod/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 27 19:55:38.235165 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:38.234991    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm" podUID="79464d07-4627-4122-b6ed-e9c992065ed7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 27 19:55:39.235863 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:39.235826    2578 patch_prober.go:28] interesting pod/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 27 19:55:39.236277 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:39.235914    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm" podUID="79464d07-4627-4122-b6ed-e9c992065ed7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 27 19:55:40.239275 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:40.239245    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:40.240082 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:40.240047    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:55:48.434107 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:48.434072    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c"]
Jul 27 19:55:48.442584 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:48.442554    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c"
Jul 27 19:55:48.444315 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:48.444287    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c"]
Jul 27 19:55:48.444997 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:48.444974    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-875sf\""
Jul 27 19:55:48.593934 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:48.593908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3ac6216-40c9-44ed-ae5c-401f8ca72677-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c\" (UID: \"d3ac6216-40c9-44ed-ae5c-401f8ca72677\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c"
Jul 27 19:55:48.694940 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:48.694879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3ac6216-40c9-44ed-ae5c-401f8ca72677-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c\" (UID: \"d3ac6216-40c9-44ed-ae5c-401f8ca72677\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c"
Jul 27 19:55:48.695492 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:48.695475    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3ac6216-40c9-44ed-ae5c-401f8ca72677-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c\" (UID: \"d3ac6216-40c9-44ed-ae5c-401f8ca72677\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c"
Jul 27 19:55:48.753912 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:48.753894    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c"
Jul 27 19:55:48.883489 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:48.883464    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c"]
Jul 27 19:55:48.885192 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:55:48.885166    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ac6216_40c9_44ed_ae5c_401f8ca72677.slice/crio-34318cb536293071baa2e1f1fdccd1580ce3b3efde6f5b7008cb3e3e637b070c WatchSource:0}: Error finding container 34318cb536293071baa2e1f1fdccd1580ce3b3efde6f5b7008cb3e3e637b070c: Status 404 returned error can't find the container with id 34318cb536293071baa2e1f1fdccd1580ce3b3efde6f5b7008cb3e3e637b070c
Jul 27 19:55:49.655331 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:49.655298    2578 generic.go:356] "Generic (PLEG): container finished" podID="d3ac6216-40c9-44ed-ae5c-401f8ca72677" containerID="d5fefb7ef347119be12d3ab8f4ac19cd31fc3ca6733becfb8b0e8452ebf0e4c3" exitCode=0
Jul 27 19:55:49.655694 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:49.655350    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c" event={"ID":"d3ac6216-40c9-44ed-ae5c-401f8ca72677","Type":"ContainerDied","Data":"d5fefb7ef347119be12d3ab8f4ac19cd31fc3ca6733becfb8b0e8452ebf0e4c3"}
Jul 27 19:55:49.655694 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:49.655406    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c" event={"ID":"d3ac6216-40c9-44ed-ae5c-401f8ca72677","Type":"ContainerStarted","Data":"34318cb536293071baa2e1f1fdccd1580ce3b3efde6f5b7008cb3e3e637b070c"}
Jul 27 19:55:50.789425 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:50.789403    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c"
Jul 27 19:55:50.913347 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:50.913278    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3ac6216-40c9-44ed-ae5c-401f8ca72677-maas-api-service-ca\") pod \"d3ac6216-40c9-44ed-ae5c-401f8ca72677\" (UID: \"d3ac6216-40c9-44ed-ae5c-401f8ca72677\") "
Jul 27 19:55:50.913629 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:50.913606    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ac6216-40c9-44ed-ae5c-401f8ca72677-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d3ac6216-40c9-44ed-ae5c-401f8ca72677" (UID: "d3ac6216-40c9-44ed-ae5c-401f8ca72677"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:55:51.014130 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:51.014102    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3ac6216-40c9-44ed-ae5c-401f8ca72677-maas-api-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:55:51.665872 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:51.665793    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c"
Jul 27 19:55:51.665872 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:51.665831    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c" event={"ID":"d3ac6216-40c9-44ed-ae5c-401f8ca72677","Type":"ContainerDied","Data":"34318cb536293071baa2e1f1fdccd1580ce3b3efde6f5b7008cb3e3e637b070c"}
Jul 27 19:55:51.666109 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:51.665875    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34318cb536293071baa2e1f1fdccd1580ce3b3efde6f5b7008cb3e3e637b070c"
Jul 27 19:55:58.853454 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:58.853422    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"]
Jul 27 19:55:58.853839 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:58.853645    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4" podUID="d2b06671-6a31-44a4-8ab0-03f7724c1525" containerName="maas-api" containerID="cri-o://99ce85a923ff275f6eae6cd7c5ed6521ed14d92e9b102ef905ef9a009a411cc1" gracePeriod=30
Jul 27 19:55:59.035090 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.035036    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c"]
Jul 27 19:55:59.037481 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.037452    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aad6c451-fmq8c"]
Jul 27 19:55:59.106097 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.106013    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"
Jul 27 19:55:59.157374 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.157342    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"]
Jul 27 19:55:59.157629 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.157582    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm" podUID="79464d07-4627-4122-b6ed-e9c992065ed7" containerName="istio-proxy" containerID="cri-o://2c28ffb0ccc37fed003379cc1f27808451ebb8830f3e150a3b855ca468fa3028" gracePeriod=30
Jul 27 19:55:59.182562 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.182539    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcqfb\" (UniqueName: \"kubernetes.io/projected/d2b06671-6a31-44a4-8ab0-03f7724c1525-kube-api-access-mcqfb\") pod \"d2b06671-6a31-44a4-8ab0-03f7724c1525\" (UID: \"d2b06671-6a31-44a4-8ab0-03f7724c1525\") "
Jul 27 19:55:59.182688 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.182571    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2b06671-6a31-44a4-8ab0-03f7724c1525-maas-api-tls\") pod \"d2b06671-6a31-44a4-8ab0-03f7724c1525\" (UID: \"d2b06671-6a31-44a4-8ab0-03f7724c1525\") "
Jul 27 19:55:59.182688 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.182633    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b06671-6a31-44a4-8ab0-03f7724c1525-openshift-service-ca\") pod \"d2b06671-6a31-44a4-8ab0-03f7724c1525\" (UID: \"d2b06671-6a31-44a4-8ab0-03f7724c1525\") "
Jul 27 19:55:59.183010 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.182988    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b06671-6a31-44a4-8ab0-03f7724c1525-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d2b06671-6a31-44a4-8ab0-03f7724c1525" (UID: "d2b06671-6a31-44a4-8ab0-03f7724c1525"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:55:59.184815 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.184798    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2b06671-6a31-44a4-8ab0-03f7724c1525-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d2b06671-6a31-44a4-8ab0-03f7724c1525" (UID: "d2b06671-6a31-44a4-8ab0-03f7724c1525"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:55:59.184892 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.184860    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2b06671-6a31-44a4-8ab0-03f7724c1525-kube-api-access-mcqfb" (OuterVolumeSpecName: "kube-api-access-mcqfb") pod "d2b06671-6a31-44a4-8ab0-03f7724c1525" (UID: "d2b06671-6a31-44a4-8ab0-03f7724c1525"). InnerVolumeSpecName "kube-api-access-mcqfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:55:59.283521 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.283490    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcqfb\" (UniqueName: \"kubernetes.io/projected/d2b06671-6a31-44a4-8ab0-03f7724c1525-kube-api-access-mcqfb\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:55:59.283521 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.283516    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2b06671-6a31-44a4-8ab0-03f7724c1525-maas-api-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:55:59.283521 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.283526    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b06671-6a31-44a4-8ab0-03f7724c1525-openshift-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:55:59.382520 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.382449    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3ac6216-40c9-44ed-ae5c-401f8ca72677" path="/var/lib/kubelet/pods/d3ac6216-40c9-44ed-ae5c-401f8ca72677/volumes"
Jul 27 19:55:59.702333 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.702247    2578 generic.go:356] "Generic (PLEG): container finished" podID="d2b06671-6a31-44a4-8ab0-03f7724c1525" containerID="99ce85a923ff275f6eae6cd7c5ed6521ed14d92e9b102ef905ef9a009a411cc1" exitCode=0
Jul 27 19:55:59.702333 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.702300    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4" event={"ID":"d2b06671-6a31-44a4-8ab0-03f7724c1525","Type":"ContainerDied","Data":"99ce85a923ff275f6eae6cd7c5ed6521ed14d92e9b102ef905ef9a009a411cc1"}
Jul 27 19:55:59.702545 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.702339    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4" event={"ID":"d2b06671-6a31-44a4-8ab0-03f7724c1525","Type":"ContainerDied","Data":"eaaaa96bb9e337bad312748bca7ff422aae3e2a62502cb935e3786527b0dbfa2"}
Jul 27 19:55:59.702545 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.702361    2578 scope.go:117] "RemoveContainer" containerID="99ce85a923ff275f6eae6cd7c5ed6521ed14d92e9b102ef905ef9a009a411cc1"
Jul 27 19:55:59.702545 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.702304    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"
Jul 27 19:55:59.712960 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.712942    2578 scope.go:117] "RemoveContainer" containerID="99ce85a923ff275f6eae6cd7c5ed6521ed14d92e9b102ef905ef9a009a411cc1"
Jul 27 19:55:59.713245 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:55:59.713222    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99ce85a923ff275f6eae6cd7c5ed6521ed14d92e9b102ef905ef9a009a411cc1\": container with ID starting with 99ce85a923ff275f6eae6cd7c5ed6521ed14d92e9b102ef905ef9a009a411cc1 not found: ID does not exist" containerID="99ce85a923ff275f6eae6cd7c5ed6521ed14d92e9b102ef905ef9a009a411cc1"
Jul 27 19:55:59.713363 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.713250    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99ce85a923ff275f6eae6cd7c5ed6521ed14d92e9b102ef905ef9a009a411cc1"} err="failed to get container status \"99ce85a923ff275f6eae6cd7c5ed6521ed14d92e9b102ef905ef9a009a411cc1\": rpc error: code = NotFound desc = could not find container \"99ce85a923ff275f6eae6cd7c5ed6521ed14d92e9b102ef905ef9a009a411cc1\": container with ID starting with 99ce85a923ff275f6eae6cd7c5ed6521ed14d92e9b102ef905ef9a009a411cc1 not found: ID does not exist"
Jul 27 19:55:59.717475 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.717456    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"]
Jul 27 19:55:59.721792 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:55:59.721773    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aad6c451-764bfd9986-hh8r4"]
Jul 27 19:56:01.382865 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:01.382835    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2b06671-6a31-44a4-8ab0-03f7724c1525" path="/var/lib/kubelet/pods/d2b06671-6a31-44a4-8ab0-03f7724c1525/volumes"
Jul 27 19:56:02.605130 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.605099    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"]
Jul 27 19:56:02.605542 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.605439    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ac6216-40c9-44ed-ae5c-401f8ca72677" containerName="revoke-keys"
Jul 27 19:56:02.605542 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.605454    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ac6216-40c9-44ed-ae5c-401f8ca72677" containerName="revoke-keys"
Jul 27 19:56:02.605542 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.605468    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2b06671-6a31-44a4-8ab0-03f7724c1525" containerName="maas-api"
Jul 27 19:56:02.605542 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.605473    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2b06671-6a31-44a4-8ab0-03f7724c1525" containerName="maas-api"
Jul 27 19:56:02.605542 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.605528    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2b06671-6a31-44a4-8ab0-03f7724c1525" containerName="maas-api"
Jul 27 19:56:02.605542 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.605540    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ac6216-40c9-44ed-ae5c-401f8ca72677" containerName="revoke-keys"
Jul 27 19:56:02.609622 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.609602    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"
Jul 27 19:56:02.612125 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.612104    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:56:02.613185 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.613146    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-86dhg\""
Jul 27 19:56:02.613185 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.613166    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-f82daff9-serving-cert\""
Jul 27 19:56:02.613185 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.613178    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:56:02.619077 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.618999    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"]
Jul 27 19:56:02.713935 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.713907    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72c15d62-f6e9-4ab7-88c8-cab602cfb017-maas-api-tls\") pod \"maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278\" (UID: \"72c15d62-f6e9-4ab7-88c8-cab602cfb017\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"
Jul 27 19:56:02.714178 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.713965    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6dpp\" (UniqueName: \"kubernetes.io/projected/72c15d62-f6e9-4ab7-88c8-cab602cfb017-kube-api-access-j6dpp\") pod \"maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278\" (UID: \"72c15d62-f6e9-4ab7-88c8-cab602cfb017\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"
Jul 27 19:56:02.714178 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.714137    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72c15d62-f6e9-4ab7-88c8-cab602cfb017-openshift-service-ca\") pod \"maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278\" (UID: \"72c15d62-f6e9-4ab7-88c8-cab602cfb017\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"
Jul 27 19:56:02.814620 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.814575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72c15d62-f6e9-4ab7-88c8-cab602cfb017-maas-api-tls\") pod \"maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278\" (UID: \"72c15d62-f6e9-4ab7-88c8-cab602cfb017\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"
Jul 27 19:56:02.814806 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.814650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6dpp\" (UniqueName: \"kubernetes.io/projected/72c15d62-f6e9-4ab7-88c8-cab602cfb017-kube-api-access-j6dpp\") pod \"maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278\" (UID: \"72c15d62-f6e9-4ab7-88c8-cab602cfb017\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"
Jul 27 19:56:02.814806 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.814741    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72c15d62-f6e9-4ab7-88c8-cab602cfb017-openshift-service-ca\") pod \"maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278\" (UID: \"72c15d62-f6e9-4ab7-88c8-cab602cfb017\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"
Jul 27 19:56:02.815419 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.815401    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72c15d62-f6e9-4ab7-88c8-cab602cfb017-openshift-service-ca\") pod \"maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278\" (UID: \"72c15d62-f6e9-4ab7-88c8-cab602cfb017\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"
Jul 27 19:56:02.817269 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.817253    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72c15d62-f6e9-4ab7-88c8-cab602cfb017-maas-api-tls\") pod \"maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278\" (UID: \"72c15d62-f6e9-4ab7-88c8-cab602cfb017\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"
Jul 27 19:56:02.822626 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.822597    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6dpp\" (UniqueName: \"kubernetes.io/projected/72c15d62-f6e9-4ab7-88c8-cab602cfb017-kube-api-access-j6dpp\") pod \"maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278\" (UID: \"72c15d62-f6e9-4ab7-88c8-cab602cfb017\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"
Jul 27 19:56:02.921497 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:02.921404    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"
Jul 27 19:56:03.058378 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:03.058345    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"]
Jul 27 19:56:03.060923 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:56:03.060898    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c15d62_f6e9_4ab7_88c8_cab602cfb017.slice/crio-ebb3c02e9d134f06ece2ddf2a2aaa2744f0b0ef6acae217cb72532102de760f0 WatchSource:0}: Error finding container ebb3c02e9d134f06ece2ddf2a2aaa2744f0b0ef6acae217cb72532102de760f0: Status 404 returned error can't find the container with id ebb3c02e9d134f06ece2ddf2a2aaa2744f0b0ef6acae217cb72532102de760f0
Jul 27 19:56:03.293186 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:03.293155    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:56:03.721761 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:03.721672    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278" event={"ID":"72c15d62-f6e9-4ab7-88c8-cab602cfb017","Type":"ContainerStarted","Data":"ebb3c02e9d134f06ece2ddf2a2aaa2744f0b0ef6acae217cb72532102de760f0"}
Jul 27 19:56:04.394902 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.394877    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:56:04.428399 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.428335    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-credential-socket\") pod \"79464d07-4627-4122-b6ed-e9c992065ed7\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") "
Jul 27 19:56:04.428399 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.428378    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-workload-certs\") pod \"79464d07-4627-4122-b6ed-e9c992065ed7\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") "
Jul 27 19:56:04.428580 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.428416    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-istio-envoy\") pod \"79464d07-4627-4122-b6ed-e9c992065ed7\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") "
Jul 27 19:56:04.428580 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.428468    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79464d07-4627-4122-b6ed-e9c992065ed7-istio-token\") pod \"79464d07-4627-4122-b6ed-e9c992065ed7\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") "
Jul 27 19:56:04.428580 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.428492    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-workload-socket\") pod \"79464d07-4627-4122-b6ed-e9c992065ed7\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") "
Jul 27 19:56:04.428580 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.428514    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79464d07-4627-4122-b6ed-e9c992065ed7-istio-podinfo\") pod \"79464d07-4627-4122-b6ed-e9c992065ed7\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") "
Jul 27 19:56:04.428580 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.428541    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2kc6\" (UniqueName: \"kubernetes.io/projected/79464d07-4627-4122-b6ed-e9c992065ed7-kube-api-access-t2kc6\") pod \"79464d07-4627-4122-b6ed-e9c992065ed7\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") "
Jul 27 19:56:04.428580 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.428567    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79464d07-4627-4122-b6ed-e9c992065ed7-istiod-ca-cert\") pod \"79464d07-4627-4122-b6ed-e9c992065ed7\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") "
Jul 27 19:56:04.428888 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.428633    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "79464d07-4627-4122-b6ed-e9c992065ed7" (UID: "79464d07-4627-4122-b6ed-e9c992065ed7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:56:04.428888 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.428646    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-istio-data\") pod \"79464d07-4627-4122-b6ed-e9c992065ed7\" (UID: \"79464d07-4627-4122-b6ed-e9c992065ed7\") "
Jul 27 19:56:04.428888 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.428677    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "79464d07-4627-4122-b6ed-e9c992065ed7" (UID: "79464d07-4627-4122-b6ed-e9c992065ed7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:56:04.429085 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.429025    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "79464d07-4627-4122-b6ed-e9c992065ed7" (UID: "79464d07-4627-4122-b6ed-e9c992065ed7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:56:04.429153 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.429082    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79464d07-4627-4122-b6ed-e9c992065ed7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "79464d07-4627-4122-b6ed-e9c992065ed7" (UID: "79464d07-4627-4122-b6ed-e9c992065ed7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:04.429208 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.429179    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-credential-socket\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:56:04.429208 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.429200    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-workload-certs\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:56:04.429311 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.429215    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-workload-socket\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:56:04.429311 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.429228    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79464d07-4627-4122-b6ed-e9c992065ed7-istiod-ca-cert\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:56:04.429454 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.429434    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-istio-data" (OuterVolumeSpecName: "istio-data") pod "79464d07-4627-4122-b6ed-e9c992065ed7" (UID: "79464d07-4627-4122-b6ed-e9c992065ed7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:56:04.431652 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.431621    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79464d07-4627-4122-b6ed-e9c992065ed7-istio-token" (OuterVolumeSpecName: "istio-token") pod "79464d07-4627-4122-b6ed-e9c992065ed7" (UID: "79464d07-4627-4122-b6ed-e9c992065ed7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:04.431652 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.431621    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79464d07-4627-4122-b6ed-e9c992065ed7-kube-api-access-t2kc6" (OuterVolumeSpecName: "kube-api-access-t2kc6") pod "79464d07-4627-4122-b6ed-e9c992065ed7" (UID: "79464d07-4627-4122-b6ed-e9c992065ed7"). InnerVolumeSpecName "kube-api-access-t2kc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:04.431781 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.431664    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "79464d07-4627-4122-b6ed-e9c992065ed7" (UID: "79464d07-4627-4122-b6ed-e9c992065ed7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:56:04.431781 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.431754    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/79464d07-4627-4122-b6ed-e9c992065ed7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "79464d07-4627-4122-b6ed-e9c992065ed7" (UID: "79464d07-4627-4122-b6ed-e9c992065ed7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:56:04.530366 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.530341    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-istio-envoy\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:56:04.530366 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.530363    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79464d07-4627-4122-b6ed-e9c992065ed7-istio-token\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:56:04.530488 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.530371    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79464d07-4627-4122-b6ed-e9c992065ed7-istio-podinfo\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:56:04.530488 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.530382    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2kc6\" (UniqueName: \"kubernetes.io/projected/79464d07-4627-4122-b6ed-e9c992065ed7-kube-api-access-t2kc6\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:56:04.530488 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.530390    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79464d07-4627-4122-b6ed-e9c992065ed7-istio-data\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:56:04.728307 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.728237    2578 generic.go:356] "Generic (PLEG): container finished" podID="79464d07-4627-4122-b6ed-e9c992065ed7" containerID="2c28ffb0ccc37fed003379cc1f27808451ebb8830f3e150a3b855ca468fa3028" exitCode=0
Jul 27 19:56:04.728307 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.728272    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm" event={"ID":"79464d07-4627-4122-b6ed-e9c992065ed7","Type":"ContainerDied","Data":"2c28ffb0ccc37fed003379cc1f27808451ebb8830f3e150a3b855ca468fa3028"}
Jul 27 19:56:04.728762 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.728288    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"
Jul 27 19:56:04.728762 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.728339    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm" event={"ID":"79464d07-4627-4122-b6ed-e9c992065ed7","Type":"ContainerDied","Data":"a88130e42b6376bc4cf58c34b658e177a157fb59f1529c4cf61ef94734d6e335"}
Jul 27 19:56:04.728762 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.728372    2578 scope.go:117] "RemoveContainer" containerID="2c28ffb0ccc37fed003379cc1f27808451ebb8830f3e150a3b855ca468fa3028"
Jul 27 19:56:04.730020 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.729992    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278" event={"ID":"72c15d62-f6e9-4ab7-88c8-cab602cfb017","Type":"ContainerStarted","Data":"2a68f814eb1421b014937a4f6324fb31f14459b6518233b8597fe58b93bf4f21"}
Jul 27 19:56:04.730165 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.730147    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"
Jul 27 19:56:04.737159 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.737140    2578 scope.go:117] "RemoveContainer" containerID="ce0240904f9e3909ded0aea5a984609de1cc4d12c87a6d80658c2187d56daaa1"
Jul 27 19:56:04.744589 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.744575    2578 scope.go:117] "RemoveContainer" containerID="2c28ffb0ccc37fed003379cc1f27808451ebb8830f3e150a3b855ca468fa3028"
Jul 27 19:56:04.744828 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:56:04.744806    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c28ffb0ccc37fed003379cc1f27808451ebb8830f3e150a3b855ca468fa3028\": container with ID starting with 2c28ffb0ccc37fed003379cc1f27808451ebb8830f3e150a3b855ca468fa3028 not found: ID does not exist" containerID="2c28ffb0ccc37fed003379cc1f27808451ebb8830f3e150a3b855ca468fa3028"
Jul 27 19:56:04.744891 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.744836    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c28ffb0ccc37fed003379cc1f27808451ebb8830f3e150a3b855ca468fa3028"} err="failed to get container status \"2c28ffb0ccc37fed003379cc1f27808451ebb8830f3e150a3b855ca468fa3028\": rpc error: code = NotFound desc = could not find container \"2c28ffb0ccc37fed003379cc1f27808451ebb8830f3e150a3b855ca468fa3028\": container with ID starting with 2c28ffb0ccc37fed003379cc1f27808451ebb8830f3e150a3b855ca468fa3028 not found: ID does not exist"
Jul 27 19:56:04.744891 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.744853    2578 scope.go:117] "RemoveContainer" containerID="ce0240904f9e3909ded0aea5a984609de1cc4d12c87a6d80658c2187d56daaa1"
Jul 27 19:56:04.745120 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:56:04.745096    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce0240904f9e3909ded0aea5a984609de1cc4d12c87a6d80658c2187d56daaa1\": container with ID starting with ce0240904f9e3909ded0aea5a984609de1cc4d12c87a6d80658c2187d56daaa1 not found: ID does not exist" containerID="ce0240904f9e3909ded0aea5a984609de1cc4d12c87a6d80658c2187d56daaa1"
Jul 27 19:56:04.745172 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.745130    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce0240904f9e3909ded0aea5a984609de1cc4d12c87a6d80658c2187d56daaa1"} err="failed to get container status \"ce0240904f9e3909ded0aea5a984609de1cc4d12c87a6d80658c2187d56daaa1\": rpc error: code = NotFound desc = could not find container \"ce0240904f9e3909ded0aea5a984609de1cc4d12c87a6d80658c2187d56daaa1\": container with ID starting with ce0240904f9e3909ded0aea5a984609de1cc4d12c87a6d80658c2187d56daaa1 not found: ID does not exist"
Jul 27 19:56:04.748371 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.748335    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278" podStartSLOduration=2.071125025 podStartE2EDuration="2.748323118s" totalImagesPullingTime="677.198093ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:56:04.747642312 +0000 UTC m=+1781.876006111" watchObservedRunningTime="2026-07-27 19:56:04.748323118 +0000 UTC m=+1781.876686913"
Jul 27 19:56:04.761155 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.761130    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"]
Jul 27 19:56:04.766360 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:04.766338    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-aad6c451-openshift-default-5949dc7c54-cpmmm"]
Jul 27 19:56:05.382785 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:05.382755    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79464d07-4627-4122-b6ed-e9c992065ed7" path="/var/lib/kubelet/pods/79464d07-4627-4122-b6ed-e9c992065ed7/volumes"
Jul 27 19:56:10.740684 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:10.740657    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"
Jul 27 19:56:13.968938 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:13.968864    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:56:27.481774 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:27.481740    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94"]
Jul 27 19:56:27.482156 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:27.482087    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79464d07-4627-4122-b6ed-e9c992065ed7" containerName="istio-proxy"
Jul 27 19:56:27.482156 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:27.482099    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="79464d07-4627-4122-b6ed-e9c992065ed7" containerName="istio-proxy"
Jul 27 19:56:27.482156 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:27.482114    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79464d07-4627-4122-b6ed-e9c992065ed7" containerName="istio-proxy"
Jul 27 19:56:27.482156 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:27.482120    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="79464d07-4627-4122-b6ed-e9c992065ed7" containerName="istio-proxy"
Jul 27 19:56:27.482285 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:27.482172    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="79464d07-4627-4122-b6ed-e9c992065ed7" containerName="istio-proxy"
Jul 27 19:56:27.485001 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:27.484984    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94"
Jul 27 19:56:27.487273 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:27.487251    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-875sf\""
Jul 27 19:56:27.492789 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:27.492765    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94"]
Jul 27 19:56:27.616426 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:27.616386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77b24785-91d4-4529-a8d3-acb4a3fed045-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94\" (UID: \"77b24785-91d4-4529-a8d3-acb4a3fed045\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94"
Jul 27 19:56:27.717159 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:27.717120    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77b24785-91d4-4529-a8d3-acb4a3fed045-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94\" (UID: \"77b24785-91d4-4529-a8d3-acb4a3fed045\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94"
Jul 27 19:56:27.717718 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:27.717696    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77b24785-91d4-4529-a8d3-acb4a3fed045-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94\" (UID: \"77b24785-91d4-4529-a8d3-acb4a3fed045\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94"
Jul 27 19:56:27.796968 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:27.796932    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94"
Jul 27 19:56:27.922008 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:27.921845    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94"]
Jul 27 19:56:27.924142 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:56:27.924116    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b24785_91d4_4529_a8d3_acb4a3fed045.slice/crio-4f64d72eeff9606b220a410cdb032fa2b9252901e92b4d94ea74e953a61b3243 WatchSource:0}: Error finding container 4f64d72eeff9606b220a410cdb032fa2b9252901e92b4d94ea74e953a61b3243: Status 404 returned error can't find the container with id 4f64d72eeff9606b220a410cdb032fa2b9252901e92b4d94ea74e953a61b3243
Jul 27 19:56:28.838838 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:28.838796    2578 generic.go:356] "Generic (PLEG): container finished" podID="77b24785-91d4-4529-a8d3-acb4a3fed045" containerID="69da9489e1a82236bc576e3c6e4dc7b060f63fbfb0ec0a7f8349ad81d1d549ad" exitCode=0
Jul 27 19:56:28.839269 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:28.838857    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94" event={"ID":"77b24785-91d4-4529-a8d3-acb4a3fed045","Type":"ContainerDied","Data":"69da9489e1a82236bc576e3c6e4dc7b060f63fbfb0ec0a7f8349ad81d1d549ad"}
Jul 27 19:56:28.839269 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:28.838912    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94" event={"ID":"77b24785-91d4-4529-a8d3-acb4a3fed045","Type":"ContainerStarted","Data":"4f64d72eeff9606b220a410cdb032fa2b9252901e92b4d94ea74e953a61b3243"}
Jul 27 19:56:29.972874 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:29.972843    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94"
Jul 27 19:56:30.036429 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:30.036403    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77b24785-91d4-4529-a8d3-acb4a3fed045-maas-api-service-ca\") pod \"77b24785-91d4-4529-a8d3-acb4a3fed045\" (UID: \"77b24785-91d4-4529-a8d3-acb4a3fed045\") "
Jul 27 19:56:30.036770 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:30.036748    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77b24785-91d4-4529-a8d3-acb4a3fed045-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "77b24785-91d4-4529-a8d3-acb4a3fed045" (UID: "77b24785-91d4-4529-a8d3-acb4a3fed045"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:30.137649 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:30.137558    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77b24785-91d4-4529-a8d3-acb4a3fed045-maas-api-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:56:30.848417 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:30.848385    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94"
Jul 27 19:56:30.848584 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:30.848386    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94" event={"ID":"77b24785-91d4-4529-a8d3-acb4a3fed045","Type":"ContainerDied","Data":"4f64d72eeff9606b220a410cdb032fa2b9252901e92b4d94ea74e953a61b3243"}
Jul 27 19:56:30.848584 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:30.848507    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f64d72eeff9606b220a410cdb032fa2b9252901e92b4d94ea74e953a61b3243"
Jul 27 19:56:37.888846 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:37.888810    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"]
Jul 27 19:56:37.889413 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:37.889079    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278" podUID="72c15d62-f6e9-4ab7-88c8-cab602cfb017" containerName="maas-api" containerID="cri-o://2a68f814eb1421b014937a4f6324fb31f14459b6518233b8597fe58b93bf4f21" gracePeriod=30
Jul 27 19:56:38.069776 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.069740    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94"]
Jul 27 19:56:38.072959 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.072936    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f82daff9-wwt94"]
Jul 27 19:56:38.143395 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.143337    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"
Jul 27 19:56:38.307823 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.307789    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72c15d62-f6e9-4ab7-88c8-cab602cfb017-openshift-service-ca\") pod \"72c15d62-f6e9-4ab7-88c8-cab602cfb017\" (UID: \"72c15d62-f6e9-4ab7-88c8-cab602cfb017\") "
Jul 27 19:56:38.307984 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.307890    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6dpp\" (UniqueName: \"kubernetes.io/projected/72c15d62-f6e9-4ab7-88c8-cab602cfb017-kube-api-access-j6dpp\") pod \"72c15d62-f6e9-4ab7-88c8-cab602cfb017\" (UID: \"72c15d62-f6e9-4ab7-88c8-cab602cfb017\") "
Jul 27 19:56:38.307984 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.307941    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72c15d62-f6e9-4ab7-88c8-cab602cfb017-maas-api-tls\") pod \"72c15d62-f6e9-4ab7-88c8-cab602cfb017\" (UID: \"72c15d62-f6e9-4ab7-88c8-cab602cfb017\") "
Jul 27 19:56:38.308225 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.308200    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72c15d62-f6e9-4ab7-88c8-cab602cfb017-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "72c15d62-f6e9-4ab7-88c8-cab602cfb017" (UID: "72c15d62-f6e9-4ab7-88c8-cab602cfb017"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:38.310245 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.310219    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72c15d62-f6e9-4ab7-88c8-cab602cfb017-kube-api-access-j6dpp" (OuterVolumeSpecName: "kube-api-access-j6dpp") pod "72c15d62-f6e9-4ab7-88c8-cab602cfb017" (UID: "72c15d62-f6e9-4ab7-88c8-cab602cfb017"). InnerVolumeSpecName "kube-api-access-j6dpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:38.310375 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.310355    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72c15d62-f6e9-4ab7-88c8-cab602cfb017-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "72c15d62-f6e9-4ab7-88c8-cab602cfb017" (UID: "72c15d62-f6e9-4ab7-88c8-cab602cfb017"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:56:38.409323 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.409258    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72c15d62-f6e9-4ab7-88c8-cab602cfb017-maas-api-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:56:38.409323 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.409289    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72c15d62-f6e9-4ab7-88c8-cab602cfb017-openshift-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:56:38.409323 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.409299    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6dpp\" (UniqueName: \"kubernetes.io/projected/72c15d62-f6e9-4ab7-88c8-cab602cfb017-kube-api-access-j6dpp\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:56:38.886039 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.886007    2578 generic.go:356] "Generic (PLEG): container finished" podID="72c15d62-f6e9-4ab7-88c8-cab602cfb017" containerID="2a68f814eb1421b014937a4f6324fb31f14459b6518233b8597fe58b93bf4f21" exitCode=0
Jul 27 19:56:38.886206 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.886050    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"
Jul 27 19:56:38.886206 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.886100    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278" event={"ID":"72c15d62-f6e9-4ab7-88c8-cab602cfb017","Type":"ContainerDied","Data":"2a68f814eb1421b014937a4f6324fb31f14459b6518233b8597fe58b93bf4f21"}
Jul 27 19:56:38.886206 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.886152    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278" event={"ID":"72c15d62-f6e9-4ab7-88c8-cab602cfb017","Type":"ContainerDied","Data":"ebb3c02e9d134f06ece2ddf2a2aaa2744f0b0ef6acae217cb72532102de760f0"}
Jul 27 19:56:38.886206 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.886172    2578 scope.go:117] "RemoveContainer" containerID="2a68f814eb1421b014937a4f6324fb31f14459b6518233b8597fe58b93bf4f21"
Jul 27 19:56:38.895135 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.894872    2578 scope.go:117] "RemoveContainer" containerID="2a68f814eb1421b014937a4f6324fb31f14459b6518233b8597fe58b93bf4f21"
Jul 27 19:56:38.895378 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:56:38.895146    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a68f814eb1421b014937a4f6324fb31f14459b6518233b8597fe58b93bf4f21\": container with ID starting with 2a68f814eb1421b014937a4f6324fb31f14459b6518233b8597fe58b93bf4f21 not found: ID does not exist" containerID="2a68f814eb1421b014937a4f6324fb31f14459b6518233b8597fe58b93bf4f21"
Jul 27 19:56:38.895378 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.895170    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a68f814eb1421b014937a4f6324fb31f14459b6518233b8597fe58b93bf4f21"} err="failed to get container status \"2a68f814eb1421b014937a4f6324fb31f14459b6518233b8597fe58b93bf4f21\": rpc error: code = NotFound desc = could not find container \"2a68f814eb1421b014937a4f6324fb31f14459b6518233b8597fe58b93bf4f21\": container with ID starting with 2a68f814eb1421b014937a4f6324fb31f14459b6518233b8597fe58b93bf4f21 not found: ID does not exist"
Jul 27 19:56:38.909012 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.908988    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"]
Jul 27 19:56:38.915896 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.915873    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f82daff9-6cbb4559d8-m8278"]
Jul 27 19:56:38.937109 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.937089    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"]
Jul 27 19:56:38.937395 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.937384    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72c15d62-f6e9-4ab7-88c8-cab602cfb017" containerName="maas-api"
Jul 27 19:56:38.937443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.937397    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="72c15d62-f6e9-4ab7-88c8-cab602cfb017" containerName="maas-api"
Jul 27 19:56:38.937443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.937413    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77b24785-91d4-4529-a8d3-acb4a3fed045" containerName="revoke-keys"
Jul 27 19:56:38.937443 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.937419    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="77b24785-91d4-4529-a8d3-acb4a3fed045" containerName="revoke-keys"
Jul 27 19:56:38.937537 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.937477    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="77b24785-91d4-4529-a8d3-acb4a3fed045" containerName="revoke-keys"
Jul 27 19:56:38.937537 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.937486    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="72c15d62-f6e9-4ab7-88c8-cab602cfb017" containerName="maas-api"
Jul 27 19:56:38.937537 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.937494    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="79464d07-4627-4122-b6ed-e9c992065ed7" containerName="istio-proxy"
Jul 27 19:56:38.941688 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.941675    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:38.943997 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.943981    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6e159107-openshift-default-dockercfg-9h88w\""
Jul 27 19:56:38.953704 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:38.953680    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"]
Jul 27 19:56:39.013887 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.013862    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/155536fa-c04c-44d6-83bd-4c6f80d33856-istiod-ca-cert\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.014005 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.013901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-workload-certs\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.014005 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.013923    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-token\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.014123 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.014000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-data\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.014123 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.014025    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6cvc\" (UniqueName: \"kubernetes.io/projected/155536fa-c04c-44d6-83bd-4c6f80d33856-kube-api-access-s6cvc\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.014123 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.014068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-workload-socket\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.014123 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.014091    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-credential-socket\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.014278 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.014130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-envoy\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.014278 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.014147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-podinfo\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.115010 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.114981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/155536fa-c04c-44d6-83bd-4c6f80d33856-istiod-ca-cert\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.115171 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.115023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-workload-certs\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.115171 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.115050    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-token\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.115171 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.115112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-data\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.115171 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.115137    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6cvc\" (UniqueName: \"kubernetes.io/projected/155536fa-c04c-44d6-83bd-4c6f80d33856-kube-api-access-s6cvc\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.115171 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.115171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-workload-socket\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.115504 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.115297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-credential-socket\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.115504 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.115353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-envoy\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.115504 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.115379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-podinfo\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.115504 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.115471    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-workload-certs\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.115665 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.115524    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-data\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.115665 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.115638    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-credential-socket\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.115665 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.115640    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-workload-socket\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.115774 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.115750    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/155536fa-c04c-44d6-83bd-4c6f80d33856-istiod-ca-cert\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.117745 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.117727    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-envoy\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.117970 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.117951    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-podinfo\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.123427 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.123405    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-token\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.123902 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.123881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6cvc\" (UniqueName: \"kubernetes.io/projected/155536fa-c04c-44d6-83bd-4c6f80d33856-kube-api-access-s6cvc\") pod \"e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") " pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.251955 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.251897    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:39.383963 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.383930    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72c15d62-f6e9-4ab7-88c8-cab602cfb017" path="/var/lib/kubelet/pods/72c15d62-f6e9-4ab7-88c8-cab602cfb017/volumes"
Jul 27 19:56:39.384391 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.384370    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77b24785-91d4-4529-a8d3-acb4a3fed045" path="/var/lib/kubelet/pods/77b24785-91d4-4529-a8d3-acb4a3fed045/volumes"
Jul 27 19:56:39.384666 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.384648    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"]
Jul 27 19:56:39.385021 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:56:39.384998    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod155536fa_c04c_44d6_83bd_4c6f80d33856.slice/crio-0b175b2399f5054e2926819cea8f4413f0a7a025c5a5151e4dee3eddf5670fe1 WatchSource:0}: Error finding container 0b175b2399f5054e2926819cea8f4413f0a7a025c5a5151e4dee3eddf5670fe1: Status 404 returned error can't find the container with id 0b175b2399f5054e2926819cea8f4413f0a7a025c5a5151e4dee3eddf5670fe1
Jul 27 19:56:39.387431 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.387403    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:56:39.387524 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.387482    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:56:39.387590 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.387574    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:56:39.892531 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.892493    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5" event={"ID":"155536fa-c04c-44d6-83bd-4c6f80d33856","Type":"ContainerStarted","Data":"9d72fbe91f2534be10b42db142427b77953b2f41b495c4985a1c1975c57ae0ad"}
Jul 27 19:56:39.892733 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.892557    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5" event={"ID":"155536fa-c04c-44d6-83bd-4c6f80d33856","Type":"ContainerStarted","Data":"0b175b2399f5054e2926819cea8f4413f0a7a025c5a5151e4dee3eddf5670fe1"}
Jul 27 19:56:39.912597 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:39.912541    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5" podStartSLOduration=1.912525901 podStartE2EDuration="1.912525901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:56:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:56:39.910899321 +0000 UTC m=+1817.039263117" watchObservedRunningTime="2026-07-27 19:56:39.912525901 +0000 UTC m=+1817.040889708"
Jul 27 19:56:40.252880 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:40.252799    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:40.257554 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:40.257526    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:40.897724 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:40.897695    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:40.898680 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:40.898662    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:41.348807 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.348773    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"]
Jul 27 19:56:41.352211 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.352189    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"
Jul 27 19:56:41.354592 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.354570    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:56:41.354730 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.354614    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-86dhg\""
Jul 27 19:56:41.354730 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.354629    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:56:41.354730 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.354581    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6e159107-serving-cert\""
Jul 27 19:56:41.363561 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.363539    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"]
Jul 27 19:56:41.435984 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.435959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-maas-api-tls\") pod \"maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg\" (UID: \"e7e192cd-0ede-49f9-b93c-cdeb046c27f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"
Jul 27 19:56:41.436120 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.435999    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-openshift-service-ca\") pod \"maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg\" (UID: \"e7e192cd-0ede-49f9-b93c-cdeb046c27f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"
Jul 27 19:56:41.436120 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.436029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-592pv\" (UniqueName: \"kubernetes.io/projected/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-kube-api-access-592pv\") pod \"maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg\" (UID: \"e7e192cd-0ede-49f9-b93c-cdeb046c27f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"
Jul 27 19:56:41.537520 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.537492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-592pv\" (UniqueName: \"kubernetes.io/projected/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-kube-api-access-592pv\") pod \"maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg\" (UID: \"e7e192cd-0ede-49f9-b93c-cdeb046c27f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"
Jul 27 19:56:41.537695 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.537600    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-maas-api-tls\") pod \"maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg\" (UID: \"e7e192cd-0ede-49f9-b93c-cdeb046c27f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"
Jul 27 19:56:41.537695 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.537648    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-openshift-service-ca\") pod \"maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg\" (UID: \"e7e192cd-0ede-49f9-b93c-cdeb046c27f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"
Jul 27 19:56:41.538333 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.538291    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-openshift-service-ca\") pod \"maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg\" (UID: \"e7e192cd-0ede-49f9-b93c-cdeb046c27f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"
Jul 27 19:56:41.540313 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.540288    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-maas-api-tls\") pod \"maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg\" (UID: \"e7e192cd-0ede-49f9-b93c-cdeb046c27f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"
Jul 27 19:56:41.546681 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.546659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-592pv\" (UniqueName: \"kubernetes.io/projected/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-kube-api-access-592pv\") pod \"maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg\" (UID: \"e7e192cd-0ede-49f9-b93c-cdeb046c27f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"
Jul 27 19:56:41.664072 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.663992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"
Jul 27 19:56:41.789475 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.789441    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"]
Jul 27 19:56:41.792152 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:56:41.792122    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e192cd_0ede_49f9_b93c_cdeb046c27f3.slice/crio-7bb77c436d398de1b52b930be70beb5cb1f548e1605f207c3fe4d6cd1ab24700 WatchSource:0}: Error finding container 7bb77c436d398de1b52b930be70beb5cb1f548e1605f207c3fe4d6cd1ab24700: Status 404 returned error can't find the container with id 7bb77c436d398de1b52b930be70beb5cb1f548e1605f207c3fe4d6cd1ab24700
Jul 27 19:56:41.904896 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.904870    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg" event={"ID":"e7e192cd-0ede-49f9-b93c-cdeb046c27f3","Type":"ContainerStarted","Data":"7bb77c436d398de1b52b930be70beb5cb1f548e1605f207c3fe4d6cd1ab24700"}
Jul 27 19:56:41.979634 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:41.979560    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:56:42.911362 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:42.911324    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg" event={"ID":"e7e192cd-0ede-49f9-b93c-cdeb046c27f3","Type":"ContainerStarted","Data":"fc3027509f4cfdb0dd5a35948c7be8fbc5492d5943c8f3b2e270658d6f12c6d0"}
Jul 27 19:56:42.911735 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:42.911423    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"
Jul 27 19:56:42.928922 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:42.928873    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg" podStartSLOduration=1.304565104 podStartE2EDuration="1.928861134s" totalImagesPullingTime="624.29603ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:56:42.928182885 +0000 UTC m=+1820.056546686" watchObservedRunningTime="2026-07-27 19:56:42.928861134 +0000 UTC m=+1820.057224924"
Jul 27 19:56:48.921251 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:48.921217    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"
Jul 27 19:56:52.079702 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:52.079663    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:56:55.899408 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:55.899308    2578 patch_prober.go:28] interesting pod/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 27 19:56:55.899408 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:55.899368    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5" podUID="155536fa-c04c-44d6-83bd-4c6f80d33856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 27 19:56:55.974888 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:55.974859    2578 generic.go:356] "Generic (PLEG): container finished" podID="155536fa-c04c-44d6-83bd-4c6f80d33856" containerID="9d72fbe91f2534be10b42db142427b77953b2f41b495c4985a1c1975c57ae0ad" exitCode=0
Jul 27 19:56:55.975023 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:55.974937    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5" event={"ID":"155536fa-c04c-44d6-83bd-4c6f80d33856","Type":"ContainerDied","Data":"9d72fbe91f2534be10b42db142427b77953b2f41b495c4985a1c1975c57ae0ad"}
Jul 27 19:56:55.975360 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:55.975344    2578 scope.go:117] "RemoveContainer" containerID="9d72fbe91f2534be10b42db142427b77953b2f41b495c4985a1c1975c57ae0ad"
Jul 27 19:56:55.976323 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:55.976299    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:56:55.976383 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:55.976364    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:56:55.976419 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:55.976397    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:56:56.981365 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:56.981332    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5" event={"ID":"155536fa-c04c-44d6-83bd-4c6f80d33856","Type":"ContainerStarted","Data":"1425908845eb8c09ba5246aac4bfd03b2a4f877005fb54300c2f89705137f94b"}
Jul 27 19:56:57.252492 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:57.252398    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:56:57.252682 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:57.252587    2578 patch_prober.go:28] interesting pod/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 27 19:56:57.252682 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:57.252650    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5" podUID="155536fa-c04c-44d6-83bd-4c6f80d33856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 27 19:56:58.252591 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:58.252554    2578 patch_prober.go:28] interesting pod/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 27 19:56:58.252984 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:58.252608    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5" podUID="155536fa-c04c-44d6-83bd-4c6f80d33856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 27 19:56:59.253115 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:59.253041    2578 patch_prober.go:28] interesting pod/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 27 19:56:59.253516 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:56:59.253134    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5" podUID="155536fa-c04c-44d6-83bd-4c6f80d33856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 27 19:57:00.252840 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:00.252796    2578 patch_prober.go:28] interesting pod/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 27 19:57:00.253087 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:00.252859    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5" podUID="155536fa-c04c-44d6-83bd-4c6f80d33856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 27 19:57:01.252831 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:01.252794    2578 patch_prober.go:28] interesting pod/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 27 19:57:01.253253 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:01.252851    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5" podUID="155536fa-c04c-44d6-83bd-4c6f80d33856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 27 19:57:02.256835 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:02.256802    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:57:02.257275 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:02.257092    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:57:02.257867 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:02.257845    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:57:07.016700 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:07.016662    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e159107-q6bf5"]
Jul 27 19:57:07.020348 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:07.020323    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e159107-q6bf5"
Jul 27 19:57:07.022801 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:07.022775    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-875sf\""
Jul 27 19:57:07.027281 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:07.027255    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e159107-q6bf5"]
Jul 27 19:57:07.070691 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:07.070660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6183285f-a9e2-4a5c-8b6c-e5af1825fffe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6e159107-q6bf5\" (UID: \"6183285f-a9e2-4a5c-8b6c-e5af1825fffe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e159107-q6bf5"
Jul 27 19:57:07.171179 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:07.171144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6183285f-a9e2-4a5c-8b6c-e5af1825fffe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6e159107-q6bf5\" (UID: \"6183285f-a9e2-4a5c-8b6c-e5af1825fffe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e159107-q6bf5"
Jul 27 19:57:07.171805 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:07.171778    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6183285f-a9e2-4a5c-8b6c-e5af1825fffe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6e159107-q6bf5\" (UID: \"6183285f-a9e2-4a5c-8b6c-e5af1825fffe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e159107-q6bf5"
Jul 27 19:57:07.333187 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:07.333151    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e159107-q6bf5"
Jul 27 19:57:07.468069 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:07.466658    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e159107-q6bf5"]
Jul 27 19:57:08.039152 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:08.039114    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e159107-q6bf5" event={"ID":"6183285f-a9e2-4a5c-8b6c-e5af1825fffe","Type":"ContainerStarted","Data":"bdd384c5b10f9303c37049dc48576865983375f0f4645d62c84ac25dcf591b2d"}
Jul 27 19:57:08.039542 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:08.039173    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e159107-q6bf5" event={"ID":"6183285f-a9e2-4a5c-8b6c-e5af1825fffe","Type":"ContainerStarted","Data":"c0448c16812fb691a995500d7adb4a0727febccf8a80dc6ed2a342f8a3cb4b19"}
Jul 27 19:57:08.055817 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:08.055774    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e159107-q6bf5" podStartSLOduration=1.055759339 podStartE2EDuration="1.055759339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:57:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:57:08.053712455 +0000 UTC m=+1845.182076251" watchObservedRunningTime="2026-07-27 19:57:08.055759339 +0000 UTC m=+1845.184123134"
Jul 27 19:57:09.045417 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:09.045383    2578 generic.go:356] "Generic (PLEG): container finished" podID="6183285f-a9e2-4a5c-8b6c-e5af1825fffe" containerID="bdd384c5b10f9303c37049dc48576865983375f0f4645d62c84ac25dcf591b2d" exitCode=0
Jul 27 19:57:09.045882 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:09.045476    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e159107-q6bf5" event={"ID":"6183285f-a9e2-4a5c-8b6c-e5af1825fffe","Type":"ContainerDied","Data":"bdd384c5b10f9303c37049dc48576865983375f0f4645d62c84ac25dcf591b2d"}
Jul 27 19:57:10.180949 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:10.180920    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e159107-q6bf5"
Jul 27 19:57:10.297143 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:10.297109    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6183285f-a9e2-4a5c-8b6c-e5af1825fffe-maas-api-service-ca\") pod \"6183285f-a9e2-4a5c-8b6c-e5af1825fffe\" (UID: \"6183285f-a9e2-4a5c-8b6c-e5af1825fffe\") "
Jul 27 19:57:10.297484 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:10.297459    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6183285f-a9e2-4a5c-8b6c-e5af1825fffe-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6183285f-a9e2-4a5c-8b6c-e5af1825fffe" (UID: "6183285f-a9e2-4a5c-8b6c-e5af1825fffe"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:57:10.398582 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:10.398494    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6183285f-a9e2-4a5c-8b6c-e5af1825fffe-maas-api-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:57:11.055594 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:11.055558    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e159107-q6bf5" event={"ID":"6183285f-a9e2-4a5c-8b6c-e5af1825fffe","Type":"ContainerDied","Data":"c0448c16812fb691a995500d7adb4a0727febccf8a80dc6ed2a342f8a3cb4b19"}
Jul 27 19:57:11.055594 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:11.055592    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e159107-q6bf5"
Jul 27 19:57:11.055813 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:11.055617    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0448c16812fb691a995500d7adb4a0727febccf8a80dc6ed2a342f8a3cb4b19"
Jul 27 19:57:17.429851 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:17.429821    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"]
Jul 27 19:57:17.430341 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:17.430091    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg" podUID="e7e192cd-0ede-49f9-b93c-cdeb046c27f3" containerName="maas-api" containerID="cri-o://fc3027509f4cfdb0dd5a35948c7be8fbc5492d5943c8f3b2e270658d6f12c6d0" gracePeriod=30
Jul 27 19:57:17.681047 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:17.680980    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"
Jul 27 19:57:17.725680 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:17.725642    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e159107-q6bf5"]
Jul 27 19:57:17.727186 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:17.727163    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e159107-q6bf5"]
Jul 27 19:57:17.760822 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:17.760789    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-openshift-service-ca\") pod \"e7e192cd-0ede-49f9-b93c-cdeb046c27f3\" (UID: \"e7e192cd-0ede-49f9-b93c-cdeb046c27f3\") "
Jul 27 19:57:17.760822 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:17.760826    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-maas-api-tls\") pod \"e7e192cd-0ede-49f9-b93c-cdeb046c27f3\" (UID: \"e7e192cd-0ede-49f9-b93c-cdeb046c27f3\") "
Jul 27 19:57:17.761107 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:17.760860    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-592pv\" (UniqueName: \"kubernetes.io/projected/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-kube-api-access-592pv\") pod \"e7e192cd-0ede-49f9-b93c-cdeb046c27f3\" (UID: \"e7e192cd-0ede-49f9-b93c-cdeb046c27f3\") "
Jul 27 19:57:17.761263 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:17.761236    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e7e192cd-0ede-49f9-b93c-cdeb046c27f3" (UID: "e7e192cd-0ede-49f9-b93c-cdeb046c27f3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:57:17.763129 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:17.763107    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e7e192cd-0ede-49f9-b93c-cdeb046c27f3" (UID: "e7e192cd-0ede-49f9-b93c-cdeb046c27f3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:57:17.763240 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:17.763220    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-kube-api-access-592pv" (OuterVolumeSpecName: "kube-api-access-592pv") pod "e7e192cd-0ede-49f9-b93c-cdeb046c27f3" (UID: "e7e192cd-0ede-49f9-b93c-cdeb046c27f3"). InnerVolumeSpecName "kube-api-access-592pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:57:17.861767 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:17.861732    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-openshift-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:57:17.861767 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:17.861762    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-maas-api-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:57:17.861767 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:17.861771    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-592pv\" (UniqueName: \"kubernetes.io/projected/e7e192cd-0ede-49f9-b93c-cdeb046c27f3-kube-api-access-592pv\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:57:18.099389 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:18.099348    2578 generic.go:356] "Generic (PLEG): container finished" podID="e7e192cd-0ede-49f9-b93c-cdeb046c27f3" containerID="fc3027509f4cfdb0dd5a35948c7be8fbc5492d5943c8f3b2e270658d6f12c6d0" exitCode=0
Jul 27 19:57:18.099587 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:18.099415    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"
Jul 27 19:57:18.099587 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:18.099432    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg" event={"ID":"e7e192cd-0ede-49f9-b93c-cdeb046c27f3","Type":"ContainerDied","Data":"fc3027509f4cfdb0dd5a35948c7be8fbc5492d5943c8f3b2e270658d6f12c6d0"}
Jul 27 19:57:18.099587 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:18.099502    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg" event={"ID":"e7e192cd-0ede-49f9-b93c-cdeb046c27f3","Type":"ContainerDied","Data":"7bb77c436d398de1b52b930be70beb5cb1f548e1605f207c3fe4d6cd1ab24700"}
Jul 27 19:57:18.099587 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:18.099525    2578 scope.go:117] "RemoveContainer" containerID="fc3027509f4cfdb0dd5a35948c7be8fbc5492d5943c8f3b2e270658d6f12c6d0"
Jul 27 19:57:18.108633 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:18.108614    2578 scope.go:117] "RemoveContainer" containerID="fc3027509f4cfdb0dd5a35948c7be8fbc5492d5943c8f3b2e270658d6f12c6d0"
Jul 27 19:57:18.108877 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:57:18.108858    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc3027509f4cfdb0dd5a35948c7be8fbc5492d5943c8f3b2e270658d6f12c6d0\": container with ID starting with fc3027509f4cfdb0dd5a35948c7be8fbc5492d5943c8f3b2e270658d6f12c6d0 not found: ID does not exist" containerID="fc3027509f4cfdb0dd5a35948c7be8fbc5492d5943c8f3b2e270658d6f12c6d0"
Jul 27 19:57:18.108924 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:18.108885    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc3027509f4cfdb0dd5a35948c7be8fbc5492d5943c8f3b2e270658d6f12c6d0"} err="failed to get container status \"fc3027509f4cfdb0dd5a35948c7be8fbc5492d5943c8f3b2e270658d6f12c6d0\": rpc error: code = NotFound desc = could not find container \"fc3027509f4cfdb0dd5a35948c7be8fbc5492d5943c8f3b2e270658d6f12c6d0\": container with ID starting with fc3027509f4cfdb0dd5a35948c7be8fbc5492d5943c8f3b2e270658d6f12c6d0 not found: ID does not exist"
Jul 27 19:57:18.119737 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:18.119705    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"]
Jul 27 19:57:18.123380 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:18.123354    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6e159107-7859bb7c9f-ntzmg"]
Jul 27 19:57:18.854732 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:18.854703    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"]
Jul 27 19:57:18.855147 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:18.854925    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5" podUID="155536fa-c04c-44d6-83bd-4c6f80d33856" containerName="istio-proxy" containerID="cri-o://1425908845eb8c09ba5246aac4bfd03b2a4f877005fb54300c2f89705137f94b" gracePeriod=30
Jul 27 19:57:19.382496 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:19.382462    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6183285f-a9e2-4a5c-8b6c-e5af1825fffe" path="/var/lib/kubelet/pods/6183285f-a9e2-4a5c-8b6c-e5af1825fffe/volumes"
Jul 27 19:57:19.382841 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:19.382827    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7e192cd-0ede-49f9-b93c-cdeb046c27f3" path="/var/lib/kubelet/pods/e7e192cd-0ede-49f9-b93c-cdeb046c27f3/volumes"
Jul 27 19:57:21.770425 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:21.770380    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:57:21.948261 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:21.948227    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"]
Jul 27 19:57:21.948584 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:21.948569    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e192cd-0ede-49f9-b93c-cdeb046c27f3" containerName="maas-api"
Jul 27 19:57:21.948584 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:21.948585    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e192cd-0ede-49f9-b93c-cdeb046c27f3" containerName="maas-api"
Jul 27 19:57:21.948712 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:21.948604    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6183285f-a9e2-4a5c-8b6c-e5af1825fffe" containerName="revoke-keys"
Jul 27 19:57:21.948712 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:21.948609    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6183285f-a9e2-4a5c-8b6c-e5af1825fffe" containerName="revoke-keys"
Jul 27 19:57:21.948712 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:21.948659    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6183285f-a9e2-4a5c-8b6c-e5af1825fffe" containerName="revoke-keys"
Jul 27 19:57:21.948712 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:21.948669    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7e192cd-0ede-49f9-b93c-cdeb046c27f3" containerName="maas-api"
Jul 27 19:57:21.953016 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:21.952994    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"
Jul 27 19:57:21.955275 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:21.955250    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-86dhg\""
Jul 27 19:57:21.955397 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:21.955249    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-ee5db6ec-serving-cert\""
Jul 27 19:57:21.955397 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:21.955361    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:57:21.956214 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:21.956197    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:57:21.961797 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:21.961774    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"]
Jul 27 19:57:22.097383 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:22.097345    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-maas-api-tls\") pod \"maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9\" (UID: \"c61bca0e-1623-4cb7-9e78-b29cc1c0088c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"
Jul 27 19:57:22.097596 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:22.097396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-openshift-service-ca\") pod \"maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9\" (UID: \"c61bca0e-1623-4cb7-9e78-b29cc1c0088c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"
Jul 27 19:57:22.097596 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:22.097486    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg94g\" (UniqueName: \"kubernetes.io/projected/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-kube-api-access-tg94g\") pod \"maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9\" (UID: \"c61bca0e-1623-4cb7-9e78-b29cc1c0088c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"
Jul 27 19:57:22.198194 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:22.198161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg94g\" (UniqueName: \"kubernetes.io/projected/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-kube-api-access-tg94g\") pod \"maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9\" (UID: \"c61bca0e-1623-4cb7-9e78-b29cc1c0088c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"
Jul 27 19:57:22.198402 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:22.198252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-maas-api-tls\") pod \"maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9\" (UID: \"c61bca0e-1623-4cb7-9e78-b29cc1c0088c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"
Jul 27 19:57:22.198402 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:22.198283    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-openshift-service-ca\") pod \"maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9\" (UID: \"c61bca0e-1623-4cb7-9e78-b29cc1c0088c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"
Jul 27 19:57:22.198890 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:22.198863    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-openshift-service-ca\") pod \"maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9\" (UID: \"c61bca0e-1623-4cb7-9e78-b29cc1c0088c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"
Jul 27 19:57:22.200870 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:22.200844    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-maas-api-tls\") pod \"maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9\" (UID: \"c61bca0e-1623-4cb7-9e78-b29cc1c0088c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"
Jul 27 19:57:22.207040 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:22.207014    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg94g\" (UniqueName: \"kubernetes.io/projected/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-kube-api-access-tg94g\") pod \"maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9\" (UID: \"c61bca0e-1623-4cb7-9e78-b29cc1c0088c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"
Jul 27 19:57:22.265103 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:22.265043    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"
Jul 27 19:57:22.396518 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:22.396494    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"]
Jul 27 19:57:22.398928 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:57:22.398900    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc61bca0e_1623_4cb7_9e78_b29cc1c0088c.slice/crio-8320746bc8b7e587bf624f26b6afd7febe35739d2a048093beaa4e45bb06494d WatchSource:0}: Error finding container 8320746bc8b7e587bf624f26b6afd7febe35739d2a048093beaa4e45bb06494d: Status 404 returned error can't find the container with id 8320746bc8b7e587bf624f26b6afd7febe35739d2a048093beaa4e45bb06494d
Jul 27 19:57:23.125049 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:23.124941    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9" event={"ID":"c61bca0e-1623-4cb7-9e78-b29cc1c0088c","Type":"ContainerStarted","Data":"27c70a37835909131dfb94691b6003b9b4491ff2818d05850fc2ef1506927792"}
Jul 27 19:57:23.125049 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:23.125022    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9" event={"ID":"c61bca0e-1623-4cb7-9e78-b29cc1c0088c","Type":"ContainerStarted","Data":"8320746bc8b7e587bf624f26b6afd7febe35739d2a048093beaa4e45bb06494d"}
Jul 27 19:57:23.125555 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:23.125107    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"
Jul 27 19:57:23.145218 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:23.145167    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9" podStartSLOduration=1.6909945290000001 podStartE2EDuration="2.145154403s" totalImagesPullingTime="454.159874ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:57:23.143439851 +0000 UTC m=+1860.271803646" watchObservedRunningTime="2026-07-27 19:57:23.145154403 +0000 UTC m=+1860.273518198"
Jul 27 19:57:24.102624 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.102595    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:57:24.132635 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.132551    2578 generic.go:356] "Generic (PLEG): container finished" podID="155536fa-c04c-44d6-83bd-4c6f80d33856" containerID="1425908845eb8c09ba5246aac4bfd03b2a4f877005fb54300c2f89705137f94b" exitCode=0
Jul 27 19:57:24.132635 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.132598    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"
Jul 27 19:57:24.133177 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.132632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5" event={"ID":"155536fa-c04c-44d6-83bd-4c6f80d33856","Type":"ContainerDied","Data":"1425908845eb8c09ba5246aac4bfd03b2a4f877005fb54300c2f89705137f94b"}
Jul 27 19:57:24.133177 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.132713    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5" event={"ID":"155536fa-c04c-44d6-83bd-4c6f80d33856","Type":"ContainerDied","Data":"0b175b2399f5054e2926819cea8f4413f0a7a025c5a5151e4dee3eddf5670fe1"}
Jul 27 19:57:24.133177 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.132738    2578 scope.go:117] "RemoveContainer" containerID="1425908845eb8c09ba5246aac4bfd03b2a4f877005fb54300c2f89705137f94b"
Jul 27 19:57:24.142907 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.142885    2578 scope.go:117] "RemoveContainer" containerID="9d72fbe91f2534be10b42db142427b77953b2f41b495c4985a1c1975c57ae0ad"
Jul 27 19:57:24.152451 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.152424    2578 scope.go:117] "RemoveContainer" containerID="1425908845eb8c09ba5246aac4bfd03b2a4f877005fb54300c2f89705137f94b"
Jul 27 19:57:24.152729 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:57:24.152711    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1425908845eb8c09ba5246aac4bfd03b2a4f877005fb54300c2f89705137f94b\": container with ID starting with 1425908845eb8c09ba5246aac4bfd03b2a4f877005fb54300c2f89705137f94b not found: ID does not exist" containerID="1425908845eb8c09ba5246aac4bfd03b2a4f877005fb54300c2f89705137f94b"
Jul 27 19:57:24.152778 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.152738    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1425908845eb8c09ba5246aac4bfd03b2a4f877005fb54300c2f89705137f94b"} err="failed to get container status \"1425908845eb8c09ba5246aac4bfd03b2a4f877005fb54300c2f89705137f94b\": rpc error: code = NotFound desc = could not find container \"1425908845eb8c09ba5246aac4bfd03b2a4f877005fb54300c2f89705137f94b\": container with ID starting with 1425908845eb8c09ba5246aac4bfd03b2a4f877005fb54300c2f89705137f94b not found: ID does not exist"
Jul 27 19:57:24.152778 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.152757    2578 scope.go:117] "RemoveContainer" containerID="9d72fbe91f2534be10b42db142427b77953b2f41b495c4985a1c1975c57ae0ad"
Jul 27 19:57:24.152982 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:57:24.152967    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d72fbe91f2534be10b42db142427b77953b2f41b495c4985a1c1975c57ae0ad\": container with ID starting with 9d72fbe91f2534be10b42db142427b77953b2f41b495c4985a1c1975c57ae0ad not found: ID does not exist" containerID="9d72fbe91f2534be10b42db142427b77953b2f41b495c4985a1c1975c57ae0ad"
Jul 27 19:57:24.153025 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.152985    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d72fbe91f2534be10b42db142427b77953b2f41b495c4985a1c1975c57ae0ad"} err="failed to get container status \"9d72fbe91f2534be10b42db142427b77953b2f41b495c4985a1c1975c57ae0ad\": rpc error: code = NotFound desc = could not find container \"9d72fbe91f2534be10b42db142427b77953b2f41b495c4985a1c1975c57ae0ad\": container with ID starting with 9d72fbe91f2534be10b42db142427b77953b2f41b495c4985a1c1975c57ae0ad not found: ID does not exist"
Jul 27 19:57:24.215476 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.215450    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-workload-socket\") pod \"155536fa-c04c-44d6-83bd-4c6f80d33856\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") "
Jul 27 19:57:24.215637 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.215502    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-data\") pod \"155536fa-c04c-44d6-83bd-4c6f80d33856\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") "
Jul 27 19:57:24.215637 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.215533    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-token\") pod \"155536fa-c04c-44d6-83bd-4c6f80d33856\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") "
Jul 27 19:57:24.215637 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.215576    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6cvc\" (UniqueName: \"kubernetes.io/projected/155536fa-c04c-44d6-83bd-4c6f80d33856-kube-api-access-s6cvc\") pod \"155536fa-c04c-44d6-83bd-4c6f80d33856\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") "
Jul 27 19:57:24.215637 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.215615    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-workload-certs\") pod \"155536fa-c04c-44d6-83bd-4c6f80d33856\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") "
Jul 27 19:57:24.215846 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.215667    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-envoy\") pod \"155536fa-c04c-44d6-83bd-4c6f80d33856\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") "
Jul 27 19:57:24.215846 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.215695    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-podinfo\") pod \"155536fa-c04c-44d6-83bd-4c6f80d33856\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") "
Jul 27 19:57:24.215846 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.215724    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/155536fa-c04c-44d6-83bd-4c6f80d33856-istiod-ca-cert\") pod \"155536fa-c04c-44d6-83bd-4c6f80d33856\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") "
Jul 27 19:57:24.215846 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.215727    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "155536fa-c04c-44d6-83bd-4c6f80d33856" (UID: "155536fa-c04c-44d6-83bd-4c6f80d33856"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:24.215846 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.215752    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-credential-socket\") pod \"155536fa-c04c-44d6-83bd-4c6f80d33856\" (UID: \"155536fa-c04c-44d6-83bd-4c6f80d33856\") "
Jul 27 19:57:24.216132 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.216105    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/155536fa-c04c-44d6-83bd-4c6f80d33856-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "155536fa-c04c-44d6-83bd-4c6f80d33856" (UID: "155536fa-c04c-44d6-83bd-4c6f80d33856"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:57:24.216199 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.216163    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-workload-socket\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:57:24.216254 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.216212    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "155536fa-c04c-44d6-83bd-4c6f80d33856" (UID: "155536fa-c04c-44d6-83bd-4c6f80d33856"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:24.216407 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.216385    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "155536fa-c04c-44d6-83bd-4c6f80d33856" (UID: "155536fa-c04c-44d6-83bd-4c6f80d33856"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:24.216611 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.216583    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-data" (OuterVolumeSpecName: "istio-data") pod "155536fa-c04c-44d6-83bd-4c6f80d33856" (UID: "155536fa-c04c-44d6-83bd-4c6f80d33856"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:24.217940 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.217919    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-token" (OuterVolumeSpecName: "istio-token") pod "155536fa-c04c-44d6-83bd-4c6f80d33856" (UID: "155536fa-c04c-44d6-83bd-4c6f80d33856"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:57:24.218282 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.218259    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "155536fa-c04c-44d6-83bd-4c6f80d33856" (UID: "155536fa-c04c-44d6-83bd-4c6f80d33856"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:24.218344 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.218318    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/155536fa-c04c-44d6-83bd-4c6f80d33856-kube-api-access-s6cvc" (OuterVolumeSpecName: "kube-api-access-s6cvc") pod "155536fa-c04c-44d6-83bd-4c6f80d33856" (UID: "155536fa-c04c-44d6-83bd-4c6f80d33856"). InnerVolumeSpecName "kube-api-access-s6cvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:57:24.218344 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.218318    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "155536fa-c04c-44d6-83bd-4c6f80d33856" (UID: "155536fa-c04c-44d6-83bd-4c6f80d33856"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:57:24.317534 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.317501    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-data\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:57:24.317534 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.317528    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-token\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:57:24.317534 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.317537    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6cvc\" (UniqueName: \"kubernetes.io/projected/155536fa-c04c-44d6-83bd-4c6f80d33856-kube-api-access-s6cvc\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:57:24.317534 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.317546    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-workload-certs\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:57:24.317808 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.317555    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-envoy\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:57:24.317808 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.317563    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/155536fa-c04c-44d6-83bd-4c6f80d33856-istio-podinfo\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:57:24.317808 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.317578    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/155536fa-c04c-44d6-83bd-4c6f80d33856-istiod-ca-cert\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:57:24.317808 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.317585    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/155536fa-c04c-44d6-83bd-4c6f80d33856-credential-socket\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:57:24.453286 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.453239    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"]
Jul 27 19:57:24.454783 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:24.454762    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6e159107-openshift-default-6ccb5f479b-gc4q5"]
Jul 27 19:57:25.383497 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:25.383463    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="155536fa-c04c-44d6-83bd-4c6f80d33856" path="/var/lib/kubelet/pods/155536fa-c04c-44d6-83bd-4c6f80d33856/volumes"
Jul 27 19:57:29.138700 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:29.138660    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"
Jul 27 19:57:32.269442 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:32.269387    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:57:46.632478 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:46.632397    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5"]
Jul 27 19:57:46.632882 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:46.632769    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="155536fa-c04c-44d6-83bd-4c6f80d33856" containerName="istio-proxy"
Jul 27 19:57:46.632882 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:46.632783    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="155536fa-c04c-44d6-83bd-4c6f80d33856" containerName="istio-proxy"
Jul 27 19:57:46.632882 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:46.632840    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="155536fa-c04c-44d6-83bd-4c6f80d33856" containerName="istio-proxy"
Jul 27 19:57:46.637574 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:46.637550    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5"
Jul 27 19:57:46.640257 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:46.640235    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-875sf\""
Jul 27 19:57:46.645257 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:46.644772    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5"]
Jul 27 19:57:46.704070 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:46.704020    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/795a0aa6-33fe-4674-88fe-049252ff9f98-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5\" (UID: \"795a0aa6-33fe-4674-88fe-049252ff9f98\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5"
Jul 27 19:57:46.805454 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:46.805421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/795a0aa6-33fe-4674-88fe-049252ff9f98-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5\" (UID: \"795a0aa6-33fe-4674-88fe-049252ff9f98\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5"
Jul 27 19:57:46.806032 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:46.806011    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/795a0aa6-33fe-4674-88fe-049252ff9f98-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5\" (UID: \"795a0aa6-33fe-4674-88fe-049252ff9f98\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5"
Jul 27 19:57:46.950236 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:46.950124    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5"
Jul 27 19:57:47.082459 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:47.082430    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5"]
Jul 27 19:57:47.084509 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:57:47.084481    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795a0aa6_33fe_4674_88fe_049252ff9f98.slice/crio-0b0c4590bc991c2e798b3394d289b2fc39dc2cab966acbc47a5ac2e792bf5422 WatchSource:0}: Error finding container 0b0c4590bc991c2e798b3394d289b2fc39dc2cab966acbc47a5ac2e792bf5422: Status 404 returned error can't find the container with id 0b0c4590bc991c2e798b3394d289b2fc39dc2cab966acbc47a5ac2e792bf5422
Jul 27 19:57:47.238353 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:47.238266    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5" event={"ID":"795a0aa6-33fe-4674-88fe-049252ff9f98","Type":"ContainerStarted","Data":"0b0c4590bc991c2e798b3394d289b2fc39dc2cab966acbc47a5ac2e792bf5422"}
Jul 27 19:57:48.245259 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:48.245227    2578 generic.go:356] "Generic (PLEG): container finished" podID="795a0aa6-33fe-4674-88fe-049252ff9f98" containerID="c0b51546ba4c7d15289f18d72f10ec50f15aca34c31157cf676340f7f48808b6" exitCode=0
Jul 27 19:57:48.245657 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:48.245322    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5" event={"ID":"795a0aa6-33fe-4674-88fe-049252ff9f98","Type":"ContainerDied","Data":"c0b51546ba4c7d15289f18d72f10ec50f15aca34c31157cf676340f7f48808b6"}
Jul 27 19:57:49.377529 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:49.377507    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5"
Jul 27 19:57:49.428376 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:49.428341    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/795a0aa6-33fe-4674-88fe-049252ff9f98-maas-api-service-ca\") pod \"795a0aa6-33fe-4674-88fe-049252ff9f98\" (UID: \"795a0aa6-33fe-4674-88fe-049252ff9f98\") "
Jul 27 19:57:49.428680 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:49.428658    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/795a0aa6-33fe-4674-88fe-049252ff9f98-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "795a0aa6-33fe-4674-88fe-049252ff9f98" (UID: "795a0aa6-33fe-4674-88fe-049252ff9f98"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:57:49.529775 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:49.529743    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/795a0aa6-33fe-4674-88fe-049252ff9f98-maas-api-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:57:50.256179 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:50.256145    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5"
Jul 27 19:57:50.256179 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:50.256167    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5" event={"ID":"795a0aa6-33fe-4674-88fe-049252ff9f98","Type":"ContainerDied","Data":"0b0c4590bc991c2e798b3394d289b2fc39dc2cab966acbc47a5ac2e792bf5422"}
Jul 27 19:57:50.256459 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:50.256237    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b0c4590bc991c2e798b3394d289b2fc39dc2cab966acbc47a5ac2e792bf5422"
Jul 27 19:57:57.100761 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:57.100730    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"]
Jul 27 19:57:57.101300 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:57.100938    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9" podUID="c61bca0e-1623-4cb7-9e78-b29cc1c0088c" containerName="maas-api" containerID="cri-o://27c70a37835909131dfb94691b6003b9b4491ff2818d05850fc2ef1506927792" gracePeriod=30
Jul 27 19:57:57.290684 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:57.290654    2578 generic.go:356] "Generic (PLEG): container finished" podID="c61bca0e-1623-4cb7-9e78-b29cc1c0088c" containerID="27c70a37835909131dfb94691b6003b9b4491ff2818d05850fc2ef1506927792" exitCode=0
Jul 27 19:57:57.290855 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:57.290724    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9" event={"ID":"c61bca0e-1623-4cb7-9e78-b29cc1c0088c","Type":"ContainerDied","Data":"27c70a37835909131dfb94691b6003b9b4491ff2818d05850fc2ef1506927792"}
Jul 27 19:57:57.368328 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:57.368302    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"
Jul 27 19:57:57.399898 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:57.399864    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg94g\" (UniqueName: \"kubernetes.io/projected/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-kube-api-access-tg94g\") pod \"c61bca0e-1623-4cb7-9e78-b29cc1c0088c\" (UID: \"c61bca0e-1623-4cb7-9e78-b29cc1c0088c\") "
Jul 27 19:57:57.400080 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:57.399903    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-openshift-service-ca\") pod \"c61bca0e-1623-4cb7-9e78-b29cc1c0088c\" (UID: \"c61bca0e-1623-4cb7-9e78-b29cc1c0088c\") "
Jul 27 19:57:57.400080 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:57.399940    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-maas-api-tls\") pod \"c61bca0e-1623-4cb7-9e78-b29cc1c0088c\" (UID: \"c61bca0e-1623-4cb7-9e78-b29cc1c0088c\") "
Jul 27 19:57:57.400313 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:57.400282    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c61bca0e-1623-4cb7-9e78-b29cc1c0088c" (UID: "c61bca0e-1623-4cb7-9e78-b29cc1c0088c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:57:57.402193 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:57.402150    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-kube-api-access-tg94g" (OuterVolumeSpecName: "kube-api-access-tg94g") pod "c61bca0e-1623-4cb7-9e78-b29cc1c0088c" (UID: "c61bca0e-1623-4cb7-9e78-b29cc1c0088c"). InnerVolumeSpecName "kube-api-access-tg94g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:57:57.402316 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:57.402170    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c61bca0e-1623-4cb7-9e78-b29cc1c0088c" (UID: "c61bca0e-1623-4cb7-9e78-b29cc1c0088c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:57:57.417934 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:57.417909    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5"]
Jul 27 19:57:57.420445 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:57.420427    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ee5db6ec-cxdz5"]
Jul 27 19:57:57.501550 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:57.501519    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-openshift-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:57:57.501550 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:57.501546    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-maas-api-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:57:57.501550 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:57.501557    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg94g\" (UniqueName: \"kubernetes.io/projected/c61bca0e-1623-4cb7-9e78-b29cc1c0088c-kube-api-access-tg94g\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:57:58.296482 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:58.296452    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"
Jul 27 19:57:58.296482 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:58.296476    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9" event={"ID":"c61bca0e-1623-4cb7-9e78-b29cc1c0088c","Type":"ContainerDied","Data":"8320746bc8b7e587bf624f26b6afd7febe35739d2a048093beaa4e45bb06494d"}
Jul 27 19:57:58.296996 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:58.296532    2578 scope.go:117] "RemoveContainer" containerID="27c70a37835909131dfb94691b6003b9b4491ff2818d05850fc2ef1506927792"
Jul 27 19:57:58.322156 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:58.322130    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"]
Jul 27 19:57:58.328105 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:58.328083    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ee5db6ec-5b97c9d98c-vjvl9"]
Jul 27 19:57:59.382699 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:59.382665    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="795a0aa6-33fe-4674-88fe-049252ff9f98" path="/var/lib/kubelet/pods/795a0aa6-33fe-4674-88fe-049252ff9f98/volumes"
Jul 27 19:57:59.383097 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:57:59.383032    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c61bca0e-1623-4cb7-9e78-b29cc1c0088c" path="/var/lib/kubelet/pods/c61bca0e-1623-4cb7-9e78-b29cc1c0088c/volumes"
Jul 27 19:58:00.974946 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:58:00.974911    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:59:22.673780 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:22.673694    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:59:31.680869 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:31.680826    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:59:35.853999 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.853964    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"]
Jul 27 19:59:35.854467 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.854450    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c61bca0e-1623-4cb7-9e78-b29cc1c0088c" containerName="maas-api"
Jul 27 19:59:35.854519 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.854471    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c61bca0e-1623-4cb7-9e78-b29cc1c0088c" containerName="maas-api"
Jul 27 19:59:35.854519 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.854512    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="795a0aa6-33fe-4674-88fe-049252ff9f98" containerName="revoke-keys"
Jul 27 19:59:35.854590 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.854521    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="795a0aa6-33fe-4674-88fe-049252ff9f98" containerName="revoke-keys"
Jul 27 19:59:35.854590 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.854536    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="155536fa-c04c-44d6-83bd-4c6f80d33856" containerName="istio-proxy"
Jul 27 19:59:35.854590 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.854545    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="155536fa-c04c-44d6-83bd-4c6f80d33856" containerName="istio-proxy"
Jul 27 19:59:35.854694 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.854612    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="155536fa-c04c-44d6-83bd-4c6f80d33856" containerName="istio-proxy"
Jul 27 19:59:35.854694 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.854628    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c61bca0e-1623-4cb7-9e78-b29cc1c0088c" containerName="maas-api"
Jul 27 19:59:35.854694 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.854636    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="795a0aa6-33fe-4674-88fe-049252ff9f98" containerName="revoke-keys"
Jul 27 19:59:35.857958 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.857940    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:35.860358 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.860334    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c7847b84-openshift-default-dockercfg-64pgw\""
Jul 27 19:59:35.872887 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.872867    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"]
Jul 27 19:59:35.910943 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.910909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-workload-certs\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:35.910943 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.910942    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-envoy\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:35.911159 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.910969    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-podinfo\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:35.911159 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.910990    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-credential-socket\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:35.911159 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.911016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-token\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:35.911159 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.911037    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istiod-ca-cert\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:35.911159 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.911114    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-data\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:35.911159 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.911157    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tl7k\" (UniqueName: \"kubernetes.io/projected/831a9a31-ec85-4374-85f8-387ed1fcb2d1-kube-api-access-7tl7k\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:35.911356 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:35.911175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-workload-socket\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.012076 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.012016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-credential-socket\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.012076 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.012071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-token\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.012327 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.012177    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istiod-ca-cert\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.012327 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.012206    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-data\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.012327 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.012256    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tl7k\" (UniqueName: \"kubernetes.io/projected/831a9a31-ec85-4374-85f8-387ed1fcb2d1-kube-api-access-7tl7k\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.012327 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.012274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-workload-socket\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.012327 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.012302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-workload-certs\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.012588 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.012433    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-envoy\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.012588 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.012461    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-credential-socket\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.012588 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.012532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-podinfo\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.012588 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.012570    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-workload-socket\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.012796 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.012634    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-data\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.012796 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.012736    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-workload-certs\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.012956 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.012827    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istiod-ca-cert\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.014935 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.014908    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-envoy\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.015162 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.015146    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-podinfo\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.020451 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.020426    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-token\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.020858 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.020840    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tl7k\" (UniqueName: \"kubernetes.io/projected/831a9a31-ec85-4374-85f8-387ed1fcb2d1-kube-api-access-7tl7k\") pod \"e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") " pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.168426 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.168353    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:36.305931 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.305905    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"]
Jul 27 19:59:36.308253 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:59:36.308227    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831a9a31_ec85_4374_85f8_387ed1fcb2d1.slice/crio-cc067af8f08dc8a20789b22b0098a935c23c58f764c391ce9268647bcba0e747 WatchSource:0}: Error finding container cc067af8f08dc8a20789b22b0098a935c23c58f764c391ce9268647bcba0e747: Status 404 returned error can't find the container with id cc067af8f08dc8a20789b22b0098a935c23c58f764c391ce9268647bcba0e747
Jul 27 19:59:36.310474 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.310437    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:59:36.310558 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.310545    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:59:36.310619 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.310604    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:59:36.740432 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.740394    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw" event={"ID":"831a9a31-ec85-4374-85f8-387ed1fcb2d1","Type":"ContainerStarted","Data":"81740b10d4b8e0d1bdf2ff41876eba8b353e162ec32e273c164889e3cfc9ea86"}
Jul 27 19:59:36.740599 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.740456    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw" event={"ID":"831a9a31-ec85-4374-85f8-387ed1fcb2d1","Type":"ContainerStarted","Data":"cc067af8f08dc8a20789b22b0098a935c23c58f764c391ce9268647bcba0e747"}
Jul 27 19:59:36.762071 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:36.762006    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw" podStartSLOduration=1.761986359 podStartE2EDuration="1.761986359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:59:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:59:36.759465427 +0000 UTC m=+1993.887829228" watchObservedRunningTime="2026-07-27 19:59:36.761986359 +0000 UTC m=+1993.890350156"
Jul 27 19:59:37.168576 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:37.168530    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:37.173786 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:37.173758    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:37.745201 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:37.745165    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:37.746222 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:37.746206    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:38.717208 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:38.717173    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"]
Jul 27 19:59:38.720909 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:38.720885    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"
Jul 27 19:59:38.723293 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:38.723267    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-c7847b84-serving-cert\""
Jul 27 19:59:38.723418 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:38.723372    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-86dhg\""
Jul 27 19:59:38.724366 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:38.724348    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:59:38.724445 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:38.724363    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:59:38.732363 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:38.732340    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"]
Jul 27 19:59:38.734564 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:38.734538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmq6n\" (UniqueName: \"kubernetes.io/projected/18ef7938-241a-4509-9f45-b6ff6eb04a31-kube-api-access-zmq6n\") pod \"maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt\" (UID: \"18ef7938-241a-4509-9f45-b6ff6eb04a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"
Jul 27 19:59:38.734652 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:38.734582    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18ef7938-241a-4509-9f45-b6ff6eb04a31-openshift-service-ca\") pod \"maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt\" (UID: \"18ef7938-241a-4509-9f45-b6ff6eb04a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"
Jul 27 19:59:38.734701 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:38.734679    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18ef7938-241a-4509-9f45-b6ff6eb04a31-maas-api-tls\") pod \"maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt\" (UID: \"18ef7938-241a-4509-9f45-b6ff6eb04a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"
Jul 27 19:59:38.836009 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:38.835966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18ef7938-241a-4509-9f45-b6ff6eb04a31-maas-api-tls\") pod \"maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt\" (UID: \"18ef7938-241a-4509-9f45-b6ff6eb04a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"
Jul 27 19:59:38.836222 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:38.836036    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmq6n\" (UniqueName: \"kubernetes.io/projected/18ef7938-241a-4509-9f45-b6ff6eb04a31-kube-api-access-zmq6n\") pod \"maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt\" (UID: \"18ef7938-241a-4509-9f45-b6ff6eb04a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"
Jul 27 19:59:38.836222 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:38.836090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18ef7938-241a-4509-9f45-b6ff6eb04a31-openshift-service-ca\") pod \"maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt\" (UID: \"18ef7938-241a-4509-9f45-b6ff6eb04a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"
Jul 27 19:59:38.836222 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:59:38.836170    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-serving-cert: secret "maas-api-e2e-mt-c7847b84-serving-cert" not found
Jul 27 19:59:38.836412 ip-10-0-142-24 kubenswrapper[2578]: E0727 19:59:38.836256    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18ef7938-241a-4509-9f45-b6ff6eb04a31-maas-api-tls podName:18ef7938-241a-4509-9f45-b6ff6eb04a31 nodeName:}" failed. No retries permitted until 2026-07-27 19:59:39.336234369 +0000 UTC m=+1996.464598143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/18ef7938-241a-4509-9f45-b6ff6eb04a31-maas-api-tls") pod "maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt" (UID: "18ef7938-241a-4509-9f45-b6ff6eb04a31") : secret "maas-api-e2e-mt-c7847b84-serving-cert" not found
Jul 27 19:59:38.836855 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:38.836834    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18ef7938-241a-4509-9f45-b6ff6eb04a31-openshift-service-ca\") pod \"maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt\" (UID: \"18ef7938-241a-4509-9f45-b6ff6eb04a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"
Jul 27 19:59:38.844542 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:38.844516    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmq6n\" (UniqueName: \"kubernetes.io/projected/18ef7938-241a-4509-9f45-b6ff6eb04a31-kube-api-access-zmq6n\") pod \"maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt\" (UID: \"18ef7938-241a-4509-9f45-b6ff6eb04a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"
Jul 27 19:59:39.341362 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:39.341325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18ef7938-241a-4509-9f45-b6ff6eb04a31-maas-api-tls\") pod \"maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt\" (UID: \"18ef7938-241a-4509-9f45-b6ff6eb04a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"
Jul 27 19:59:39.343995 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:39.343970    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18ef7938-241a-4509-9f45-b6ff6eb04a31-maas-api-tls\") pod \"maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt\" (UID: \"18ef7938-241a-4509-9f45-b6ff6eb04a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"
Jul 27 19:59:39.632259 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:39.632170    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"
Jul 27 19:59:39.763042 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:39.763017    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"]
Jul 27 19:59:39.765298 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:59:39.765273    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ef7938_241a_4509_9f45_b6ff6eb04a31.slice/crio-b1a7c55110cecbcdce79fea77f004beb32aff18f72faef42d75ff2e04a3d93c4 WatchSource:0}: Error finding container b1a7c55110cecbcdce79fea77f004beb32aff18f72faef42d75ff2e04a3d93c4: Status 404 returned error can't find the container with id b1a7c55110cecbcdce79fea77f004beb32aff18f72faef42d75ff2e04a3d93c4
Jul 27 19:59:40.761211 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:40.761178    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt" event={"ID":"18ef7938-241a-4509-9f45-b6ff6eb04a31","Type":"ContainerStarted","Data":"fcc8954dcea1ed95bed033781a92aea3a8485efb8bf82de4046ccef6b58a987c"}
Jul 27 19:59:40.761392 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:40.761235    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt" event={"ID":"18ef7938-241a-4509-9f45-b6ff6eb04a31","Type":"ContainerStarted","Data":"b1a7c55110cecbcdce79fea77f004beb32aff18f72faef42d75ff2e04a3d93c4"}
Jul 27 19:59:40.761392 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:40.761306    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"
Jul 27 19:59:40.778913 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:40.778864    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt" podStartSLOduration=1.941483328 podStartE2EDuration="2.778847919s" totalImagesPullingTime="837.364591ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:59:40.777037121 +0000 UTC m=+1997.905400916" watchObservedRunningTime="2026-07-27 19:59:40.778847919 +0000 UTC m=+1997.907211715"
Jul 27 19:59:44.976530 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:44.976494    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 19:59:46.776136 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:46.775299    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"
Jul 27 19:59:50.638916 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:50.638871    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv"]
Jul 27 19:59:50.643249 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:50.643230    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv"
Jul 27 19:59:50.646042 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:50.645839    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-875sf\""
Jul 27 19:59:50.648511 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:50.648469    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv"]
Jul 27 19:59:50.747117 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:50.747079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91298673-1fea-486e-90da-dfacbfa562a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv\" (UID: \"91298673-1fea-486e-90da-dfacbfa562a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv"
Jul 27 19:59:50.847681 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:50.847637    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91298673-1fea-486e-90da-dfacbfa562a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv\" (UID: \"91298673-1fea-486e-90da-dfacbfa562a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv"
Jul 27 19:59:50.848516 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:50.848488    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91298673-1fea-486e-90da-dfacbfa562a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv\" (UID: \"91298673-1fea-486e-90da-dfacbfa562a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv"
Jul 27 19:59:50.956483 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:50.956390    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv"
Jul 27 19:59:51.102637 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:51.102509    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv"]
Jul 27 19:59:51.104799 ip-10-0-142-24 kubenswrapper[2578]: W0727 19:59:51.104771    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91298673_1fea_486e_90da_dfacbfa562a4.slice/crio-55b095379ae10df8e84ea5a2562a125229023e1510fb4a39b86bf1a3667bc18d WatchSource:0}: Error finding container 55b095379ae10df8e84ea5a2562a125229023e1510fb4a39b86bf1a3667bc18d: Status 404 returned error can't find the container with id 55b095379ae10df8e84ea5a2562a125229023e1510fb4a39b86bf1a3667bc18d
Jul 27 19:59:51.818243 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:51.818209    2578 generic.go:356] "Generic (PLEG): container finished" podID="91298673-1fea-486e-90da-dfacbfa562a4" containerID="6a6c72e63c08c5c4d05ed5dd17c1f76c7ccb7e458159bd0c77c7078d95e99890" exitCode=0
Jul 27 19:59:51.818568 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:51.818255    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv" event={"ID":"91298673-1fea-486e-90da-dfacbfa562a4","Type":"ContainerDied","Data":"6a6c72e63c08c5c4d05ed5dd17c1f76c7ccb7e458159bd0c77c7078d95e99890"}
Jul 27 19:59:51.818568 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:51.818304    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv" event={"ID":"91298673-1fea-486e-90da-dfacbfa562a4","Type":"ContainerStarted","Data":"55b095379ae10df8e84ea5a2562a125229023e1510fb4a39b86bf1a3667bc18d"}
Jul 27 19:59:52.746424 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:52.746395    2578 patch_prober.go:28] interesting pod/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 27 19:59:52.746558 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:52.746450    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw" podUID="831a9a31-ec85-4374-85f8-387ed1fcb2d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 27 19:59:52.825367 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:52.825336    2578 generic.go:356] "Generic (PLEG): container finished" podID="831a9a31-ec85-4374-85f8-387ed1fcb2d1" containerID="81740b10d4b8e0d1bdf2ff41876eba8b353e162ec32e273c164889e3cfc9ea86" exitCode=0
Jul 27 19:59:52.825716 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:52.825413    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw" event={"ID":"831a9a31-ec85-4374-85f8-387ed1fcb2d1","Type":"ContainerDied","Data":"81740b10d4b8e0d1bdf2ff41876eba8b353e162ec32e273c164889e3cfc9ea86"}
Jul 27 19:59:52.826079 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:52.825837    2578 scope.go:117] "RemoveContainer" containerID="81740b10d4b8e0d1bdf2ff41876eba8b353e162ec32e273c164889e3cfc9ea86"
Jul 27 19:59:52.826845 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:52.826811    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:59:52.826947 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:52.826892    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:59:52.827007 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:52.826941    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 19:59:52.964109 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:52.964036    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv"
Jul 27 19:59:53.067260 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:53.067227    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91298673-1fea-486e-90da-dfacbfa562a4-maas-api-service-ca\") pod \"91298673-1fea-486e-90da-dfacbfa562a4\" (UID: \"91298673-1fea-486e-90da-dfacbfa562a4\") "
Jul 27 19:59:53.067619 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:53.067585    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91298673-1fea-486e-90da-dfacbfa562a4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "91298673-1fea-486e-90da-dfacbfa562a4" (UID: "91298673-1fea-486e-90da-dfacbfa562a4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:59:53.168677 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:53.168641    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91298673-1fea-486e-90da-dfacbfa562a4-maas-api-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 19:59:53.832713 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:53.832673    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw" event={"ID":"831a9a31-ec85-4374-85f8-387ed1fcb2d1","Type":"ContainerStarted","Data":"25580c99c66a5fd3f6ffbde177e4d67968f6b6cbc50e08e8b8695c33525a53b9"}
Jul 27 19:59:53.833986 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:53.833966    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv"
Jul 27 19:59:53.833986 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:53.833978    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv" event={"ID":"91298673-1fea-486e-90da-dfacbfa562a4","Type":"ContainerDied","Data":"55b095379ae10df8e84ea5a2562a125229023e1510fb4a39b86bf1a3667bc18d"}
Jul 27 19:59:53.834165 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:53.834022    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55b095379ae10df8e84ea5a2562a125229023e1510fb4a39b86bf1a3667bc18d"
Jul 27 19:59:54.182144 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:54.169110    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:54.182144 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:54.181705    2578 patch_prober.go:28] interesting pod/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 27 19:59:54.182144 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:54.181772    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw" podUID="831a9a31-ec85-4374-85f8-387ed1fcb2d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 27 19:59:55.169461 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:55.169420    2578 patch_prober.go:28] interesting pod/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 27 19:59:55.170078 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:55.170017    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw" podUID="831a9a31-ec85-4374-85f8-387ed1fcb2d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 27 19:59:56.170224 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:56.169762    2578 patch_prober.go:28] interesting pod/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 27 19:59:56.170224 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:56.169826    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw" podUID="831a9a31-ec85-4374-85f8-387ed1fcb2d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 27 19:59:57.169563 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:57.169524    2578 patch_prober.go:28] interesting pod/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 27 19:59:57.169874 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:57.169840    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw" podUID="831a9a31-ec85-4374-85f8-387ed1fcb2d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 27 19:59:58.172397 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:58.172371    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:58.172832 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:58.172750    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 19:59:58.173361 ip-10-0-142-24 kubenswrapper[2578]: I0727 19:59:58.173341    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 20:00:00.136892 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.136848    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753040-xvs6v"]
Jul 27 20:00:00.137465 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.137444    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91298673-1fea-486e-90da-dfacbfa562a4" containerName="revoke-keys"
Jul 27 20:00:00.137553 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.137468    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="91298673-1fea-486e-90da-dfacbfa562a4" containerName="revoke-keys"
Jul 27 20:00:00.137604 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.137563    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="91298673-1fea-486e-90da-dfacbfa562a4" containerName="revoke-keys"
Jul 27 20:00:00.140457 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.140435    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c7847b84-29753040-s4nkg"]
Jul 27 20:00:00.140577 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.140559    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753040-xvs6v"
Jul 27 20:00:00.143134 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.143111    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-875sf\""
Jul 27 20:00:00.143499 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.143484    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c7847b84-29753040-s4nkg"
Jul 27 20:00:00.149469 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.149446    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753040-xvs6v"]
Jul 27 20:00:00.151720 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.151695    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c7847b84-29753040-s4nkg"]
Jul 27 20:00:00.152558 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.152539    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753040-xvs6v"
Jul 27 20:00:00.160754 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.160728    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c7847b84-29753040-s4nkg"
Jul 27 20:00:00.298386 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.298352    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753040-xvs6v"]
Jul 27 20:00:00.300576 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:00:00.300537    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fa57c2e_da35_4080_bb29_d3d7792de8c2.slice/crio-6bf49201abaa078c1a81d127cb6ee6f96d4e30f89813593a6e96608930cc5117 WatchSource:0}: Error finding container 6bf49201abaa078c1a81d127cb6ee6f96d4e30f89813593a6e96608930cc5117: Status 404 returned error can't find the container with id 6bf49201abaa078c1a81d127cb6ee6f96d4e30f89813593a6e96608930cc5117
Jul 27 20:00:00.325857 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.325831    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c7847b84-29753040-s4nkg"]
Jul 27 20:00:00.336219 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:00:00.336187    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod686fedde_1b5f_4de4_83b8_d7fa291c0fdc.slice/crio-6bd01612b3169538d3a2f41d4c5ec554f7247cab562840445941af651152fbb9 WatchSource:0}: Error finding container 6bd01612b3169538d3a2f41d4c5ec554f7247cab562840445941af651152fbb9: Status 404 returned error can't find the container with id 6bd01612b3169538d3a2f41d4c5ec554f7247cab562840445941af651152fbb9
Jul 27 20:00:00.752620 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.752531    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"]
Jul 27 20:00:00.752774 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.752726    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt" podUID="18ef7938-241a-4509-9f45-b6ff6eb04a31" containerName="maas-api" containerID="cri-o://fcc8954dcea1ed95bed033781a92aea3a8485efb8bf82de4046ccef6b58a987c" gracePeriod=30
Jul 27 20:00:00.776411 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.776382    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c7847b84-29753040-s4nkg"]
Jul 27 20:00:00.869144 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.869106    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753040-xvs6v" event={"ID":"6fa57c2e-da35-4080-bb29-d3d7792de8c2","Type":"ContainerStarted","Data":"a2560d6d407f329d7e0cab91d175dbe95c397dbb0e3a22e0b3a849dc59881f3c"}
Jul 27 20:00:00.869332 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.869171    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753040-xvs6v" event={"ID":"6fa57c2e-da35-4080-bb29-d3d7792de8c2","Type":"ContainerStarted","Data":"6bf49201abaa078c1a81d127cb6ee6f96d4e30f89813593a6e96608930cc5117"}
Jul 27 20:00:00.870815 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.870737    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c7847b84-29753040-s4nkg" event={"ID":"686fedde-1b5f-4de4-83b8-d7fa291c0fdc","Type":"ContainerStarted","Data":"a7d8a5e4683ad684bb9936ffb2d91a3837b4a00f21e291e450d5cb2ce4699bc9"}
Jul 27 20:00:00.870815 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.870785    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c7847b84-29753040-s4nkg" event={"ID":"686fedde-1b5f-4de4-83b8-d7fa291c0fdc","Type":"ContainerStarted","Data":"6bd01612b3169538d3a2f41d4c5ec554f7247cab562840445941af651152fbb9"}
Jul 27 20:00:00.885855 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.885794    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753040-xvs6v" podStartSLOduration=0.885776165 podStartE2EDuration="885.776165ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:00:00.885377521 +0000 UTC m=+2018.013741316" watchObservedRunningTime="2026-07-27 20:00:00.885776165 +0000 UTC m=+2018.014139962"
Jul 27 20:00:00.901090 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.901022    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c7847b84-29753040-s4nkg" podStartSLOduration=0.901006968 podStartE2EDuration="901.006968ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:00:00.898668196 +0000 UTC m=+2018.027031993" watchObservedRunningTime="2026-07-27 20:00:00.901006968 +0000 UTC m=+2018.029370763"
Jul 27 20:00:00.939239 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.939207    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv"]
Jul 27 20:00:00.942277 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.942252    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c7847b84-bmbqv"]
Jul 27 20:00:00.994754 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:00.994728    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"
Jul 27 20:00:01.157219 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.157186    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18ef7938-241a-4509-9f45-b6ff6eb04a31-openshift-service-ca\") pod \"18ef7938-241a-4509-9f45-b6ff6eb04a31\" (UID: \"18ef7938-241a-4509-9f45-b6ff6eb04a31\") "
Jul 27 20:00:01.157590 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.157244    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmq6n\" (UniqueName: \"kubernetes.io/projected/18ef7938-241a-4509-9f45-b6ff6eb04a31-kube-api-access-zmq6n\") pod \"18ef7938-241a-4509-9f45-b6ff6eb04a31\" (UID: \"18ef7938-241a-4509-9f45-b6ff6eb04a31\") "
Jul 27 20:00:01.157590 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.157264    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18ef7938-241a-4509-9f45-b6ff6eb04a31-maas-api-tls\") pod \"18ef7938-241a-4509-9f45-b6ff6eb04a31\" (UID: \"18ef7938-241a-4509-9f45-b6ff6eb04a31\") "
Jul 27 20:00:01.157590 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.157574    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18ef7938-241a-4509-9f45-b6ff6eb04a31-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "18ef7938-241a-4509-9f45-b6ff6eb04a31" (UID: "18ef7938-241a-4509-9f45-b6ff6eb04a31"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:00:01.159556 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.159530    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18ef7938-241a-4509-9f45-b6ff6eb04a31-kube-api-access-zmq6n" (OuterVolumeSpecName: "kube-api-access-zmq6n") pod "18ef7938-241a-4509-9f45-b6ff6eb04a31" (UID: "18ef7938-241a-4509-9f45-b6ff6eb04a31"). InnerVolumeSpecName "kube-api-access-zmq6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:00:01.159641 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.159559    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18ef7938-241a-4509-9f45-b6ff6eb04a31-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "18ef7938-241a-4509-9f45-b6ff6eb04a31" (UID: "18ef7938-241a-4509-9f45-b6ff6eb04a31"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:00:01.258174 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.258132    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18ef7938-241a-4509-9f45-b6ff6eb04a31-openshift-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:00:01.258351 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.258188    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmq6n\" (UniqueName: \"kubernetes.io/projected/18ef7938-241a-4509-9f45-b6ff6eb04a31-kube-api-access-zmq6n\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:00:01.258351 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.258199    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18ef7938-241a-4509-9f45-b6ff6eb04a31-maas-api-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:00:01.382729 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.382650    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91298673-1fea-486e-90da-dfacbfa562a4" path="/var/lib/kubelet/pods/91298673-1fea-486e-90da-dfacbfa562a4/volumes"
Jul 27 20:00:01.877240 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.877204    2578 generic.go:356] "Generic (PLEG): container finished" podID="6fa57c2e-da35-4080-bb29-d3d7792de8c2" containerID="a2560d6d407f329d7e0cab91d175dbe95c397dbb0e3a22e0b3a849dc59881f3c" exitCode=0
Jul 27 20:00:01.877429 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.877281    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753040-xvs6v" event={"ID":"6fa57c2e-da35-4080-bb29-d3d7792de8c2","Type":"ContainerDied","Data":"a2560d6d407f329d7e0cab91d175dbe95c397dbb0e3a22e0b3a849dc59881f3c"}
Jul 27 20:00:01.878467 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.878444    2578 generic.go:356] "Generic (PLEG): container finished" podID="18ef7938-241a-4509-9f45-b6ff6eb04a31" containerID="fcc8954dcea1ed95bed033781a92aea3a8485efb8bf82de4046ccef6b58a987c" exitCode=0
Jul 27 20:00:01.878590 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.878483    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"
Jul 27 20:00:01.878590 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.878531    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt" event={"ID":"18ef7938-241a-4509-9f45-b6ff6eb04a31","Type":"ContainerDied","Data":"fcc8954dcea1ed95bed033781a92aea3a8485efb8bf82de4046ccef6b58a987c"}
Jul 27 20:00:01.878699 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.878583    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt" event={"ID":"18ef7938-241a-4509-9f45-b6ff6eb04a31","Type":"ContainerDied","Data":"b1a7c55110cecbcdce79fea77f004beb32aff18f72faef42d75ff2e04a3d93c4"}
Jul 27 20:00:01.878699 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.878635    2578 scope.go:117] "RemoveContainer" containerID="fcc8954dcea1ed95bed033781a92aea3a8485efb8bf82de4046ccef6b58a987c"
Jul 27 20:00:01.880140 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.880115    2578 generic.go:356] "Generic (PLEG): container finished" podID="686fedde-1b5f-4de4-83b8-d7fa291c0fdc" containerID="a7d8a5e4683ad684bb9936ffb2d91a3837b4a00f21e291e450d5cb2ce4699bc9" exitCode=6
Jul 27 20:00:01.880261 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.880138    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c7847b84-29753040-s4nkg" event={"ID":"686fedde-1b5f-4de4-83b8-d7fa291c0fdc","Type":"ContainerDied","Data":"a7d8a5e4683ad684bb9936ffb2d91a3837b4a00f21e291e450d5cb2ce4699bc9"}
Jul 27 20:00:01.888877 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.888857    2578 scope.go:117] "RemoveContainer" containerID="fcc8954dcea1ed95bed033781a92aea3a8485efb8bf82de4046ccef6b58a987c"
Jul 27 20:00:01.889205 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:00:01.889181    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcc8954dcea1ed95bed033781a92aea3a8485efb8bf82de4046ccef6b58a987c\": container with ID starting with fcc8954dcea1ed95bed033781a92aea3a8485efb8bf82de4046ccef6b58a987c not found: ID does not exist" containerID="fcc8954dcea1ed95bed033781a92aea3a8485efb8bf82de4046ccef6b58a987c"
Jul 27 20:00:01.889291 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.889211    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcc8954dcea1ed95bed033781a92aea3a8485efb8bf82de4046ccef6b58a987c"} err="failed to get container status \"fcc8954dcea1ed95bed033781a92aea3a8485efb8bf82de4046ccef6b58a987c\": rpc error: code = NotFound desc = could not find container \"fcc8954dcea1ed95bed033781a92aea3a8485efb8bf82de4046ccef6b58a987c\": container with ID starting with fcc8954dcea1ed95bed033781a92aea3a8485efb8bf82de4046ccef6b58a987c not found: ID does not exist"
Jul 27 20:00:01.922688 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.922651    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"]
Jul 27 20:00:01.925984 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:01.925959    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c7847b84-874cbc4b5-7nbtt"]
Jul 27 20:00:02.015635 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:02.015610    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c7847b84-29753040-s4nkg"
Jul 27 20:00:02.886953 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:02.886922    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c7847b84-29753040-s4nkg"
Jul 27 20:00:02.887448 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:02.886972    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c7847b84-29753040-s4nkg" event={"ID":"686fedde-1b5f-4de4-83b8-d7fa291c0fdc","Type":"ContainerDied","Data":"6bd01612b3169538d3a2f41d4c5ec554f7247cab562840445941af651152fbb9"}
Jul 27 20:00:02.887448 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:02.887039    2578 scope.go:117] "RemoveContainer" containerID="a7d8a5e4683ad684bb9936ffb2d91a3837b4a00f21e291e450d5cb2ce4699bc9"
Jul 27 20:00:02.914997 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:02.914967    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c7847b84-29753040-s4nkg"]
Jul 27 20:00:02.916627 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:02.916598    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-c7847b84-29753040-s4nkg"]
Jul 27 20:00:03.020873 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:03.020847    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753040-xvs6v"
Jul 27 20:00:03.383206 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:03.383171    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18ef7938-241a-4509-9f45-b6ff6eb04a31" path="/var/lib/kubelet/pods/18ef7938-241a-4509-9f45-b6ff6eb04a31/volumes"
Jul 27 20:00:03.383458 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:03.383445    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="686fedde-1b5f-4de4-83b8-d7fa291c0fdc" path="/var/lib/kubelet/pods/686fedde-1b5f-4de4-83b8-d7fa291c0fdc/volumes"
Jul 27 20:00:03.770315 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:03.770223    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:00:03.893416 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:03.893391    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753040-xvs6v"
Jul 27 20:00:03.893906 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:03.893431    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753040-xvs6v" event={"ID":"6fa57c2e-da35-4080-bb29-d3d7792de8c2","Type":"ContainerDied","Data":"6bf49201abaa078c1a81d127cb6ee6f96d4e30f89813593a6e96608930cc5117"}
Jul 27 20:00:03.893906 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:03.893479    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bf49201abaa078c1a81d127cb6ee6f96d4e30f89813593a6e96608930cc5117"
Jul 27 20:00:07.538774 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:07.538743    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"]
Jul 27 20:00:07.539269 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:07.538999    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw" podUID="831a9a31-ec85-4374-85f8-387ed1fcb2d1" containerName="istio-proxy" containerID="cri-o://25580c99c66a5fd3f6ffbde177e4d67968f6b6cbc50e08e8b8695c33525a53b9" gracePeriod=30
Jul 27 20:00:12.790660 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.790637    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 20:00:12.943262 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.943182    2578 generic.go:356] "Generic (PLEG): container finished" podID="831a9a31-ec85-4374-85f8-387ed1fcb2d1" containerID="25580c99c66a5fd3f6ffbde177e4d67968f6b6cbc50e08e8b8695c33525a53b9" exitCode=0
Jul 27 20:00:12.943262 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.943230    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"
Jul 27 20:00:12.943444 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.943270    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw" event={"ID":"831a9a31-ec85-4374-85f8-387ed1fcb2d1","Type":"ContainerDied","Data":"25580c99c66a5fd3f6ffbde177e4d67968f6b6cbc50e08e8b8695c33525a53b9"}
Jul 27 20:00:12.943444 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.943324    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw" event={"ID":"831a9a31-ec85-4374-85f8-387ed1fcb2d1","Type":"ContainerDied","Data":"cc067af8f08dc8a20789b22b0098a935c23c58f764c391ce9268647bcba0e747"}
Jul 27 20:00:12.943444 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.943347    2578 scope.go:117] "RemoveContainer" containerID="25580c99c66a5fd3f6ffbde177e4d67968f6b6cbc50e08e8b8695c33525a53b9"
Jul 27 20:00:12.952002 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.951982    2578 scope.go:117] "RemoveContainer" containerID="81740b10d4b8e0d1bdf2ff41876eba8b353e162ec32e273c164889e3cfc9ea86"
Jul 27 20:00:12.959593 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.959576    2578 scope.go:117] "RemoveContainer" containerID="25580c99c66a5fd3f6ffbde177e4d67968f6b6cbc50e08e8b8695c33525a53b9"
Jul 27 20:00:12.959807 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:00:12.959792    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25580c99c66a5fd3f6ffbde177e4d67968f6b6cbc50e08e8b8695c33525a53b9\": container with ID starting with 25580c99c66a5fd3f6ffbde177e4d67968f6b6cbc50e08e8b8695c33525a53b9 not found: ID does not exist" containerID="25580c99c66a5fd3f6ffbde177e4d67968f6b6cbc50e08e8b8695c33525a53b9"
Jul 27 20:00:12.959861 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.959816    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25580c99c66a5fd3f6ffbde177e4d67968f6b6cbc50e08e8b8695c33525a53b9"} err="failed to get container status \"25580c99c66a5fd3f6ffbde177e4d67968f6b6cbc50e08e8b8695c33525a53b9\": rpc error: code = NotFound desc = could not find container \"25580c99c66a5fd3f6ffbde177e4d67968f6b6cbc50e08e8b8695c33525a53b9\": container with ID starting with 25580c99c66a5fd3f6ffbde177e4d67968f6b6cbc50e08e8b8695c33525a53b9 not found: ID does not exist"
Jul 27 20:00:12.959861 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.959830    2578 scope.go:117] "RemoveContainer" containerID="81740b10d4b8e0d1bdf2ff41876eba8b353e162ec32e273c164889e3cfc9ea86"
Jul 27 20:00:12.960045 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:00:12.960027    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81740b10d4b8e0d1bdf2ff41876eba8b353e162ec32e273c164889e3cfc9ea86\": container with ID starting with 81740b10d4b8e0d1bdf2ff41876eba8b353e162ec32e273c164889e3cfc9ea86 not found: ID does not exist" containerID="81740b10d4b8e0d1bdf2ff41876eba8b353e162ec32e273c164889e3cfc9ea86"
Jul 27 20:00:12.960216 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.960118    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81740b10d4b8e0d1bdf2ff41876eba8b353e162ec32e273c164889e3cfc9ea86"} err="failed to get container status \"81740b10d4b8e0d1bdf2ff41876eba8b353e162ec32e273c164889e3cfc9ea86\": rpc error: code = NotFound desc = could not find container \"81740b10d4b8e0d1bdf2ff41876eba8b353e162ec32e273c164889e3cfc9ea86\": container with ID starting with 81740b10d4b8e0d1bdf2ff41876eba8b353e162ec32e273c164889e3cfc9ea86 not found: ID does not exist"
Jul 27 20:00:12.962321 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.962305    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-workload-certs\") pod \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") "
Jul 27 20:00:12.962377 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.962341    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-token\") pod \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") "
Jul 27 20:00:12.962377 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.962370    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-workload-socket\") pod \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") "
Jul 27 20:00:12.962438 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.962387    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-envoy\") pod \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") "
Jul 27 20:00:12.962438 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.962414    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tl7k\" (UniqueName: \"kubernetes.io/projected/831a9a31-ec85-4374-85f8-387ed1fcb2d1-kube-api-access-7tl7k\") pod \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") "
Jul 27 20:00:12.962438 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.962434    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-data\") pod \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") "
Jul 27 20:00:12.962559 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.962454    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-credential-socket\") pod \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") "
Jul 27 20:00:12.962559 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.962489    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istiod-ca-cert\") pod \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") "
Jul 27 20:00:12.962655 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.962570    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-podinfo\") pod \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\" (UID: \"831a9a31-ec85-4374-85f8-387ed1fcb2d1\") "
Jul 27 20:00:12.962655 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.962600    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "831a9a31-ec85-4374-85f8-387ed1fcb2d1" (UID: "831a9a31-ec85-4374-85f8-387ed1fcb2d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:00:12.962784 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.962761    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "831a9a31-ec85-4374-85f8-387ed1fcb2d1" (UID: "831a9a31-ec85-4374-85f8-387ed1fcb2d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:00:12.962848 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.962779    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "831a9a31-ec85-4374-85f8-387ed1fcb2d1" (UID: "831a9a31-ec85-4374-85f8-387ed1fcb2d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:00:12.963008 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.962899    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-workload-certs\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:00:12.963106 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.963024    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-workload-socket\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:00:12.963160 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.963135    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "831a9a31-ec85-4374-85f8-387ed1fcb2d1" (UID: "831a9a31-ec85-4374-85f8-387ed1fcb2d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:00:12.963412 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.963350    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-data" (OuterVolumeSpecName: "istio-data") pod "831a9a31-ec85-4374-85f8-387ed1fcb2d1" (UID: "831a9a31-ec85-4374-85f8-387ed1fcb2d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:00:12.964502 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.964478    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-token" (OuterVolumeSpecName: "istio-token") pod "831a9a31-ec85-4374-85f8-387ed1fcb2d1" (UID: "831a9a31-ec85-4374-85f8-387ed1fcb2d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:00:12.964764 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.964748    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "831a9a31-ec85-4374-85f8-387ed1fcb2d1" (UID: "831a9a31-ec85-4374-85f8-387ed1fcb2d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:00:12.965179 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.965162    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/831a9a31-ec85-4374-85f8-387ed1fcb2d1-kube-api-access-7tl7k" (OuterVolumeSpecName: "kube-api-access-7tl7k") pod "831a9a31-ec85-4374-85f8-387ed1fcb2d1" (UID: "831a9a31-ec85-4374-85f8-387ed1fcb2d1"). InnerVolumeSpecName "kube-api-access-7tl7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:00:12.965288 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:12.965267    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "831a9a31-ec85-4374-85f8-387ed1fcb2d1" (UID: "831a9a31-ec85-4374-85f8-387ed1fcb2d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:00:13.063750 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:13.063723    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-data\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:00:13.063750 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:13.063751    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-credential-socket\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:00:13.063940 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:13.063763    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istiod-ca-cert\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:00:13.063940 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:13.063771    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-podinfo\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:00:13.063940 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:13.063779    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-token\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:00:13.063940 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:13.063786    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/831a9a31-ec85-4374-85f8-387ed1fcb2d1-istio-envoy\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:00:13.063940 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:13.063795    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tl7k\" (UniqueName: \"kubernetes.io/projected/831a9a31-ec85-4374-85f8-387ed1fcb2d1-kube-api-access-7tl7k\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:00:13.264590 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:13.264552    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"]
Jul 27 20:00:13.270991 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:13.270967    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c7847b84-openshift-default-69479fd9d8-jfjmw"]
Jul 27 20:00:13.382281 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:13.382250    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="831a9a31-ec85-4374-85f8-387ed1fcb2d1" path="/var/lib/kubelet/pods/831a9a31-ec85-4374-85f8-387ed1fcb2d1/volumes"
Jul 27 20:00:28.076794 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.076750    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"]
Jul 27 20:00:28.077245 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.077085    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="831a9a31-ec85-4374-85f8-387ed1fcb2d1" containerName="istio-proxy"
Jul 27 20:00:28.077245 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.077097    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="831a9a31-ec85-4374-85f8-387ed1fcb2d1" containerName="istio-proxy"
Jul 27 20:00:28.077245 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.077107    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="686fedde-1b5f-4de4-83b8-d7fa291c0fdc" containerName="cleanup"
Jul 27 20:00:28.077245 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.077113    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="686fedde-1b5f-4de4-83b8-d7fa291c0fdc" containerName="cleanup"
Jul 27 20:00:28.077245 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.077126    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18ef7938-241a-4509-9f45-b6ff6eb04a31" containerName="maas-api"
Jul 27 20:00:28.077245 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.077133    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="18ef7938-241a-4509-9f45-b6ff6eb04a31" containerName="maas-api"
Jul 27 20:00:28.077245 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.077151    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa57c2e-da35-4080-bb29-d3d7792de8c2" containerName="cleanup"
Jul 27 20:00:28.077245 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.077156    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa57c2e-da35-4080-bb29-d3d7792de8c2" containerName="cleanup"
Jul 27 20:00:28.077245 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.077203    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="686fedde-1b5f-4de4-83b8-d7fa291c0fdc" containerName="cleanup"
Jul 27 20:00:28.077245 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.077208    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="831a9a31-ec85-4374-85f8-387ed1fcb2d1" containerName="istio-proxy"
Jul 27 20:00:28.077245 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.077215    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="831a9a31-ec85-4374-85f8-387ed1fcb2d1" containerName="istio-proxy"
Jul 27 20:00:28.077245 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.077222    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="18ef7938-241a-4509-9f45-b6ff6eb04a31" containerName="maas-api"
Jul 27 20:00:28.077245 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.077228    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa57c2e-da35-4080-bb29-d3d7792de8c2" containerName="cleanup"
Jul 27 20:00:28.079920 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.079902    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.085302 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.085275    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-73760660-openshift-default-dockercfg-85cdv\""
Jul 27 20:00:28.117046 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.117014    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"]
Jul 27 20:00:28.183840 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.183803    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-workload-socket\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.183840 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.183842    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-credential-socket\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.184047 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.183874    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-token\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.184047 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.183893    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-envoy\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.184047 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.183935    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-workload-certs\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.184047 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.183998    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-podinfo\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.184047 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.184013    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istiod-ca-cert\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.184047 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.184033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsd5p\" (UniqueName: \"kubernetes.io/projected/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-kube-api-access-gsd5p\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.184316 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.184118    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-data\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.284820 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.284784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-data\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.284820 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.284826    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-workload-socket\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.285085 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.284846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-credential-socket\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.285085 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.284890    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-token\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.285085 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.284909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-envoy\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.285085 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.284928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-workload-certs\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.285085 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.284965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-podinfo\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.285353 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.285112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istiod-ca-cert\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.285353 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.285161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsd5p\" (UniqueName: \"kubernetes.io/projected/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-kube-api-access-gsd5p\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.285353 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.285221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-data\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.285353 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.285334    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-workload-socket\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.285565 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.285429    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-credential-socket\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.285565 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.285516    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-workload-certs\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.285845 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.285811    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istiod-ca-cert\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.287303 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.287281    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-envoy\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.287604 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.287587    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-podinfo\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.294956 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.294933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsd5p\" (UniqueName: \"kubernetes.io/projected/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-kube-api-access-gsd5p\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.295089 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.294943    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-token\") pod \"e2e-mt-73760660-openshift-default-6dc79f5684-95xgl\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") " pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.389991 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.389915    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:28.522651 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.522622    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"]
Jul 27 20:00:28.524368 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:00:28.524339    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d1e1ae_f35f_4bcf_8f4e_712f75ecefaa.slice/crio-aa2c15d7842a8581c553bef9b146beae03c4119c692a1884f7ef8bdc25388e4e WatchSource:0}: Error finding container aa2c15d7842a8581c553bef9b146beae03c4119c692a1884f7ef8bdc25388e4e: Status 404 returned error can't find the container with id aa2c15d7842a8581c553bef9b146beae03c4119c692a1884f7ef8bdc25388e4e
Jul 27 20:00:28.526524 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.526489    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:00:28.526591 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.526557    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:00:28.526630 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:28.526593    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:00:29.019210 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:29.019172    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl" event={"ID":"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa","Type":"ContainerStarted","Data":"62e7ff562fa6bfbc25968b1839044f94fdde00e2f246876045472d46d00b4828"}
Jul 27 20:00:29.019381 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:29.019229    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl" event={"ID":"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa","Type":"ContainerStarted","Data":"aa2c15d7842a8581c553bef9b146beae03c4119c692a1884f7ef8bdc25388e4e"}
Jul 27 20:00:29.041749 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:29.041703    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl" podStartSLOduration=1.041688014 podStartE2EDuration="1.041688014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:00:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:00:29.04040287 +0000 UTC m=+2046.168766663" watchObservedRunningTime="2026-07-27 20:00:29.041688014 +0000 UTC m=+2046.170051807"
Jul 27 20:00:29.390214 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:29.390179    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:29.394935 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:29.394908    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:30.023717 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:30.023683    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:30.024633 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:30.024614    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:31.022036 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.022003    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"]
Jul 27 20:00:31.022535 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.022519    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="831a9a31-ec85-4374-85f8-387ed1fcb2d1" containerName="istio-proxy"
Jul 27 20:00:31.022579 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.022539    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="831a9a31-ec85-4374-85f8-387ed1fcb2d1" containerName="istio-proxy"
Jul 27 20:00:31.026114 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.026093    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"
Jul 27 20:00:31.028300 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.028276    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-73760660-serving-cert\""
Jul 27 20:00:31.028492 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.028474    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 20:00:31.028579 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.028536    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 20:00:31.029386 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.029371    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-86dhg\""
Jul 27 20:00:31.035343 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.035316    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"]
Jul 27 20:00:31.111919 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.111888    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/039e4401-42ff-4126-abfa-b39145e9b491-maas-api-tls\") pod \"maas-api-e2e-mt-73760660-6664bf65cc-9gldp\" (UID: \"039e4401-42ff-4126-abfa-b39145e9b491\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"
Jul 27 20:00:31.112119 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.111971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9gh4\" (UniqueName: \"kubernetes.io/projected/039e4401-42ff-4126-abfa-b39145e9b491-kube-api-access-j9gh4\") pod \"maas-api-e2e-mt-73760660-6664bf65cc-9gldp\" (UID: \"039e4401-42ff-4126-abfa-b39145e9b491\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"
Jul 27 20:00:31.112119 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.112048    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/039e4401-42ff-4126-abfa-b39145e9b491-openshift-service-ca\") pod \"maas-api-e2e-mt-73760660-6664bf65cc-9gldp\" (UID: \"039e4401-42ff-4126-abfa-b39145e9b491\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"
Jul 27 20:00:31.213232 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.213202    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9gh4\" (UniqueName: \"kubernetes.io/projected/039e4401-42ff-4126-abfa-b39145e9b491-kube-api-access-j9gh4\") pod \"maas-api-e2e-mt-73760660-6664bf65cc-9gldp\" (UID: \"039e4401-42ff-4126-abfa-b39145e9b491\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"
Jul 27 20:00:31.213426 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.213265    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/039e4401-42ff-4126-abfa-b39145e9b491-openshift-service-ca\") pod \"maas-api-e2e-mt-73760660-6664bf65cc-9gldp\" (UID: \"039e4401-42ff-4126-abfa-b39145e9b491\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"
Jul 27 20:00:31.213426 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.213327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/039e4401-42ff-4126-abfa-b39145e9b491-maas-api-tls\") pod \"maas-api-e2e-mt-73760660-6664bf65cc-9gldp\" (UID: \"039e4401-42ff-4126-abfa-b39145e9b491\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"
Jul 27 20:00:31.213426 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:00:31.213411    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-73760660-serving-cert: secret "maas-api-e2e-mt-73760660-serving-cert" not found
Jul 27 20:00:31.213593 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:00:31.213488    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/039e4401-42ff-4126-abfa-b39145e9b491-maas-api-tls podName:039e4401-42ff-4126-abfa-b39145e9b491 nodeName:}" failed. No retries permitted until 2026-07-27 20:00:31.713467289 +0000 UTC m=+2048.841831064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/039e4401-42ff-4126-abfa-b39145e9b491-maas-api-tls") pod "maas-api-e2e-mt-73760660-6664bf65cc-9gldp" (UID: "039e4401-42ff-4126-abfa-b39145e9b491") : secret "maas-api-e2e-mt-73760660-serving-cert" not found
Jul 27 20:00:31.214025 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.214003    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/039e4401-42ff-4126-abfa-b39145e9b491-openshift-service-ca\") pod \"maas-api-e2e-mt-73760660-6664bf65cc-9gldp\" (UID: \"039e4401-42ff-4126-abfa-b39145e9b491\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"
Jul 27 20:00:31.221987 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.221967    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9gh4\" (UniqueName: \"kubernetes.io/projected/039e4401-42ff-4126-abfa-b39145e9b491-kube-api-access-j9gh4\") pod \"maas-api-e2e-mt-73760660-6664bf65cc-9gldp\" (UID: \"039e4401-42ff-4126-abfa-b39145e9b491\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"
Jul 27 20:00:31.718505 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.718472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/039e4401-42ff-4126-abfa-b39145e9b491-maas-api-tls\") pod \"maas-api-e2e-mt-73760660-6664bf65cc-9gldp\" (UID: \"039e4401-42ff-4126-abfa-b39145e9b491\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"
Jul 27 20:00:31.721037 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.721003    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/039e4401-42ff-4126-abfa-b39145e9b491-maas-api-tls\") pod \"maas-api-e2e-mt-73760660-6664bf65cc-9gldp\" (UID: \"039e4401-42ff-4126-abfa-b39145e9b491\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"
Jul 27 20:00:31.938960 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:31.938928    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"
Jul 27 20:00:32.068463 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:32.068424    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"]
Jul 27 20:00:32.070805 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:00:32.070781    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039e4401_42ff_4126_abfa_b39145e9b491.slice/crio-b83d732bfd715bd577d588967ba042f8fca49d6d25e20d9248ee5625948235a1 WatchSource:0}: Error finding container b83d732bfd715bd577d588967ba042f8fca49d6d25e20d9248ee5625948235a1: Status 404 returned error can't find the container with id b83d732bfd715bd577d588967ba042f8fca49d6d25e20d9248ee5625948235a1
Jul 27 20:00:32.072564 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:32.072548    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:00:33.039734 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:33.039696    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp" event={"ID":"039e4401-42ff-4126-abfa-b39145e9b491","Type":"ContainerStarted","Data":"a67cf01643ca0a734d2ee7126d837dbd47677c37417813d2f754584d690fdf25"}
Jul 27 20:00:33.039853 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:33.039781    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp" event={"ID":"039e4401-42ff-4126-abfa-b39145e9b491","Type":"ContainerStarted","Data":"b83d732bfd715bd577d588967ba042f8fca49d6d25e20d9248ee5625948235a1"}
Jul 27 20:00:33.039853 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:33.039821    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"
Jul 27 20:00:33.060050 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:33.060005    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp" podStartSLOduration=1.176786317 podStartE2EDuration="2.05999005s" totalImagesPullingTime="883.203733ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:00:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:00:33.058310488 +0000 UTC m=+2050.186674285" watchObservedRunningTime="2026-07-27 20:00:33.05999005 +0000 UTC m=+2050.188353825"
Jul 27 20:00:35.978615 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:35.978584    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:00:39.050904 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:39.050873    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"
Jul 27 20:00:44.104201 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:44.104168    2578 generic.go:356] "Generic (PLEG): container finished" podID="d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" containerID="62e7ff562fa6bfbc25968b1839044f94fdde00e2f246876045472d46d00b4828" exitCode=0
Jul 27 20:00:44.104605 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:44.104217    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl" event={"ID":"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa","Type":"ContainerDied","Data":"62e7ff562fa6bfbc25968b1839044f94fdde00e2f246876045472d46d00b4828"}
Jul 27 20:00:44.104647 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:44.104633    2578 scope.go:117] "RemoveContainer" containerID="62e7ff562fa6bfbc25968b1839044f94fdde00e2f246876045472d46d00b4828"
Jul 27 20:00:44.105651 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:44.105623    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:00:44.105754 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:44.105690    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:00:44.105754 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:44.105723    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:00:44.775488 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:44.775442    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:00:45.023756 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:45.023713    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:45.110520 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:45.110437    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl" event={"ID":"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa","Type":"ContainerStarted","Data":"26c12a88a44e86e65d327d135af6b4a5a525a9fb10e2081042ec1ff65cb5c787"}
Jul 27 20:00:45.390915 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:45.390781    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:45.392320 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:45.391946    2578 patch_prober.go:28] interesting pod/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 27 20:00:45.392320 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:45.392012    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl" podUID="d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 27 20:00:46.390673 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:46.390622    2578 patch_prober.go:28] interesting pod/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 27 20:00:46.391204 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:46.390729    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl" podUID="d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 27 20:00:47.391418 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:47.391382    2578 patch_prober.go:28] interesting pod/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 27 20:00:47.391999 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:47.391969    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl" podUID="d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 27 20:00:48.390488 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:48.390440    2578 patch_prober.go:28] interesting pod/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 27 20:00:48.390708 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:48.390510    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl" podUID="d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 27 20:00:49.394658 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:49.394623    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:49.395166 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:49.394997    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:49.395698 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:49.395675    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:00:56.183246 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:00:56.183211    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:01:04.477835 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:04.477797    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73760660-rmbh4"]
Jul 27 20:01:04.482252 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:04.482223    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73760660-rmbh4"
Jul 27 20:01:04.487599 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:04.487574    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-875sf\""
Jul 27 20:01:04.487760 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:04.487653    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73760660-rmbh4"]
Jul 27 20:01:04.625009 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:04.624969    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec58dede-bfd0-4418-94c2-83ed7fee1aa5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-73760660-rmbh4\" (UID: \"ec58dede-bfd0-4418-94c2-83ed7fee1aa5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73760660-rmbh4"
Jul 27 20:01:04.725550 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:04.725505    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec58dede-bfd0-4418-94c2-83ed7fee1aa5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-73760660-rmbh4\" (UID: \"ec58dede-bfd0-4418-94c2-83ed7fee1aa5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73760660-rmbh4"
Jul 27 20:01:04.726162 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:04.726141    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec58dede-bfd0-4418-94c2-83ed7fee1aa5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-73760660-rmbh4\" (UID: \"ec58dede-bfd0-4418-94c2-83ed7fee1aa5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73760660-rmbh4"
Jul 27 20:01:04.794578 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:04.794554    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73760660-rmbh4"
Jul 27 20:01:05.128829 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:05.128803    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73760660-rmbh4"]
Jul 27 20:01:05.131111 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:01:05.131082    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec58dede_bfd0_4418_94c2_83ed7fee1aa5.slice/crio-0b423c39d391b1bdea814ca1d234da299a01c531454680f750b82f44d9e350b1 WatchSource:0}: Error finding container 0b423c39d391b1bdea814ca1d234da299a01c531454680f750b82f44d9e350b1: Status 404 returned error can't find the container with id 0b423c39d391b1bdea814ca1d234da299a01c531454680f750b82f44d9e350b1
Jul 27 20:01:05.207182 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:05.207146    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73760660-rmbh4" event={"ID":"ec58dede-bfd0-4418-94c2-83ed7fee1aa5","Type":"ContainerStarted","Data":"0b423c39d391b1bdea814ca1d234da299a01c531454680f750b82f44d9e350b1"}
Jul 27 20:01:06.213097 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:06.213039    2578 generic.go:356] "Generic (PLEG): container finished" podID="ec58dede-bfd0-4418-94c2-83ed7fee1aa5" containerID="f8b47a4f3c573fcf3bc805ea091e15220d24302ad0e0e101503e3d42c7183a74" exitCode=0
Jul 27 20:01:06.213544 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:06.213129    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73760660-rmbh4" event={"ID":"ec58dede-bfd0-4418-94c2-83ed7fee1aa5","Type":"ContainerDied","Data":"f8b47a4f3c573fcf3bc805ea091e15220d24302ad0e0e101503e3d42c7183a74"}
Jul 27 20:01:07.350350 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:07.350323    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73760660-rmbh4"
Jul 27 20:01:07.547156 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:07.547121    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec58dede-bfd0-4418-94c2-83ed7fee1aa5-maas-api-service-ca\") pod \"ec58dede-bfd0-4418-94c2-83ed7fee1aa5\" (UID: \"ec58dede-bfd0-4418-94c2-83ed7fee1aa5\") "
Jul 27 20:01:07.547435 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:07.547413    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec58dede-bfd0-4418-94c2-83ed7fee1aa5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ec58dede-bfd0-4418-94c2-83ed7fee1aa5" (UID: "ec58dede-bfd0-4418-94c2-83ed7fee1aa5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:01:07.648428 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:07.648394    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec58dede-bfd0-4418-94c2-83ed7fee1aa5-maas-api-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:01:08.224322 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:08.224290    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73760660-rmbh4" event={"ID":"ec58dede-bfd0-4418-94c2-83ed7fee1aa5","Type":"ContainerDied","Data":"0b423c39d391b1bdea814ca1d234da299a01c531454680f750b82f44d9e350b1"}
Jul 27 20:01:08.224490 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:08.224339    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b423c39d391b1bdea814ca1d234da299a01c531454680f750b82f44d9e350b1"
Jul 27 20:01:08.224490 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:08.224303    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73760660-rmbh4"
Jul 27 20:01:18.772900 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:18.772865    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:01:20.033947 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.033910    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"]
Jul 27 20:01:20.034461 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.034241    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp" podUID="039e4401-42ff-4126-abfa-b39145e9b491" containerName="maas-api" containerID="cri-o://a67cf01643ca0a734d2ee7126d837dbd47677c37417813d2f754584d690fdf25" gracePeriod=30
Jul 27 20:01:20.211722 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.211662    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73760660-rmbh4"]
Jul 27 20:01:20.214857 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.214828    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73760660-rmbh4"]
Jul 27 20:01:20.280888 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.280859    2578 generic.go:356] "Generic (PLEG): container finished" podID="039e4401-42ff-4126-abfa-b39145e9b491" containerID="a67cf01643ca0a734d2ee7126d837dbd47677c37417813d2f754584d690fdf25" exitCode=0
Jul 27 20:01:20.281017 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.280928    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp" event={"ID":"039e4401-42ff-4126-abfa-b39145e9b491","Type":"ContainerDied","Data":"a67cf01643ca0a734d2ee7126d837dbd47677c37417813d2f754584d690fdf25"}
Jul 27 20:01:20.281017 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.280979    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp" event={"ID":"039e4401-42ff-4126-abfa-b39145e9b491","Type":"ContainerDied","Data":"b83d732bfd715bd577d588967ba042f8fca49d6d25e20d9248ee5625948235a1"}
Jul 27 20:01:20.281017 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.280996    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b83d732bfd715bd577d588967ba042f8fca49d6d25e20d9248ee5625948235a1"
Jul 27 20:01:20.294613 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.294558    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"
Jul 27 20:01:20.346622 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.346591    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/039e4401-42ff-4126-abfa-b39145e9b491-maas-api-tls\") pod \"039e4401-42ff-4126-abfa-b39145e9b491\" (UID: \"039e4401-42ff-4126-abfa-b39145e9b491\") "
Jul 27 20:01:20.346791 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.346640    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9gh4\" (UniqueName: \"kubernetes.io/projected/039e4401-42ff-4126-abfa-b39145e9b491-kube-api-access-j9gh4\") pod \"039e4401-42ff-4126-abfa-b39145e9b491\" (UID: \"039e4401-42ff-4126-abfa-b39145e9b491\") "
Jul 27 20:01:20.346791 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.346687    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/039e4401-42ff-4126-abfa-b39145e9b491-openshift-service-ca\") pod \"039e4401-42ff-4126-abfa-b39145e9b491\" (UID: \"039e4401-42ff-4126-abfa-b39145e9b491\") "
Jul 27 20:01:20.347099 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.347048    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/039e4401-42ff-4126-abfa-b39145e9b491-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "039e4401-42ff-4126-abfa-b39145e9b491" (UID: "039e4401-42ff-4126-abfa-b39145e9b491"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:01:20.348917 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.348894    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/039e4401-42ff-4126-abfa-b39145e9b491-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "039e4401-42ff-4126-abfa-b39145e9b491" (UID: "039e4401-42ff-4126-abfa-b39145e9b491"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:01:20.348917 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.348911    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/039e4401-42ff-4126-abfa-b39145e9b491-kube-api-access-j9gh4" (OuterVolumeSpecName: "kube-api-access-j9gh4") pod "039e4401-42ff-4126-abfa-b39145e9b491" (UID: "039e4401-42ff-4126-abfa-b39145e9b491"). InnerVolumeSpecName "kube-api-access-j9gh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:01:20.447574 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.447544    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/039e4401-42ff-4126-abfa-b39145e9b491-maas-api-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:01:20.447574 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.447570    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9gh4\" (UniqueName: \"kubernetes.io/projected/039e4401-42ff-4126-abfa-b39145e9b491-kube-api-access-j9gh4\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:01:20.447574 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:20.447579    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/039e4401-42ff-4126-abfa-b39145e9b491-openshift-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:01:21.285992 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:21.285954    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"
Jul 27 20:01:21.306292 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:21.306264    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"]
Jul 27 20:01:21.309212 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:21.309189    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-73760660-6664bf65cc-9gldp"]
Jul 27 20:01:21.382762 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:21.382731    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="039e4401-42ff-4126-abfa-b39145e9b491" path="/var/lib/kubelet/pods/039e4401-42ff-4126-abfa-b39145e9b491/volumes"
Jul 27 20:01:21.383049 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:21.383036    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec58dede-bfd0-4418-94c2-83ed7fee1aa5" path="/var/lib/kubelet/pods/ec58dede-bfd0-4418-94c2-83ed7fee1aa5/volumes"
Jul 27 20:01:27.575815 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:01:27.575780    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:02:23.480597 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:23.480524    2578 scope.go:117] "RemoveContainer" containerID="d5fefb7ef347119be12d3ab8f4ac19cd31fc3ca6733becfb8b0e8452ebf0e4c3"
Jul 27 20:02:26.277581 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:26.277542    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"]
Jul 27 20:02:26.277995 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:26.277764    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl" podUID="d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" containerName="istio-proxy" containerID="cri-o://26c12a88a44e86e65d327d135af6b4a5a525a9fb10e2081042ec1ff65cb5c787" gracePeriod=30
Jul 27 20:02:29.879115 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:29.879080    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:02:31.526009 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.525982    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:02:31.552495 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.552393    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-workload-socket\") pod \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") "
Jul 27 20:02:31.552495 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.552455    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-envoy\") pod \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") "
Jul 27 20:02:31.552699 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.552523    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsd5p\" (UniqueName: \"kubernetes.io/projected/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-kube-api-access-gsd5p\") pod \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") "
Jul 27 20:02:31.552699 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.552574    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-podinfo\") pod \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") "
Jul 27 20:02:31.552699 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.552620    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-workload-certs\") pod \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") "
Jul 27 20:02:31.552856 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.552724    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" (UID: "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:02:31.552856 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.552819    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-token\") pod \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") "
Jul 27 20:02:31.552856 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.552846    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-data\") pod \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") "
Jul 27 20:02:31.552995 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.552875    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istiod-ca-cert\") pod \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") "
Jul 27 20:02:31.552995 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.552919    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-credential-socket\") pod \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\" (UID: \"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa\") "
Jul 27 20:02:31.553288 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.553237    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-workload-socket\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:02:31.553965 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.553919    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" (UID: "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:02:31.554566 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.554542    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" (UID: "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:02:31.554741 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.554719    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-data" (OuterVolumeSpecName: "istio-data") pod "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" (UID: "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:02:31.554864 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.554766    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" (UID: "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:02:31.555157 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.555136    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" (UID: "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:02:31.555784 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.555740    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" (UID: "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:02:31.556646 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.556617    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-kube-api-access-gsd5p" (OuterVolumeSpecName: "kube-api-access-gsd5p") pod "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" (UID: "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa"). InnerVolumeSpecName "kube-api-access-gsd5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:02:31.556966 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.556939    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-token" (OuterVolumeSpecName: "istio-token") pod "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" (UID: "d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:02:31.613879 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.613849    2578 generic.go:356] "Generic (PLEG): container finished" podID="d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" containerID="26c12a88a44e86e65d327d135af6b4a5a525a9fb10e2081042ec1ff65cb5c787" exitCode=0
Jul 27 20:02:31.614023 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.613903    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"
Jul 27 20:02:31.614023 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.613933    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl" event={"ID":"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa","Type":"ContainerDied","Data":"26c12a88a44e86e65d327d135af6b4a5a525a9fb10e2081042ec1ff65cb5c787"}
Jul 27 20:02:31.614023 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.613986    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl" event={"ID":"d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa","Type":"ContainerDied","Data":"aa2c15d7842a8581c553bef9b146beae03c4119c692a1884f7ef8bdc25388e4e"}
Jul 27 20:02:31.614023 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.614011    2578 scope.go:117] "RemoveContainer" containerID="26c12a88a44e86e65d327d135af6b4a5a525a9fb10e2081042ec1ff65cb5c787"
Jul 27 20:02:31.623798 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.623779    2578 scope.go:117] "RemoveContainer" containerID="62e7ff562fa6bfbc25968b1839044f94fdde00e2f246876045472d46d00b4828"
Jul 27 20:02:31.633496 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.633466    2578 scope.go:117] "RemoveContainer" containerID="26c12a88a44e86e65d327d135af6b4a5a525a9fb10e2081042ec1ff65cb5c787"
Jul 27 20:02:31.633881 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:02:31.633861    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26c12a88a44e86e65d327d135af6b4a5a525a9fb10e2081042ec1ff65cb5c787\": container with ID starting with 26c12a88a44e86e65d327d135af6b4a5a525a9fb10e2081042ec1ff65cb5c787 not found: ID does not exist" containerID="26c12a88a44e86e65d327d135af6b4a5a525a9fb10e2081042ec1ff65cb5c787"
Jul 27 20:02:31.633982 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.633889    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26c12a88a44e86e65d327d135af6b4a5a525a9fb10e2081042ec1ff65cb5c787"} err="failed to get container status \"26c12a88a44e86e65d327d135af6b4a5a525a9fb10e2081042ec1ff65cb5c787\": rpc error: code = NotFound desc = could not find container \"26c12a88a44e86e65d327d135af6b4a5a525a9fb10e2081042ec1ff65cb5c787\": container with ID starting with 26c12a88a44e86e65d327d135af6b4a5a525a9fb10e2081042ec1ff65cb5c787 not found: ID does not exist"
Jul 27 20:02:31.633982 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.633909    2578 scope.go:117] "RemoveContainer" containerID="62e7ff562fa6bfbc25968b1839044f94fdde00e2f246876045472d46d00b4828"
Jul 27 20:02:31.634272 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:02:31.634191    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62e7ff562fa6bfbc25968b1839044f94fdde00e2f246876045472d46d00b4828\": container with ID starting with 62e7ff562fa6bfbc25968b1839044f94fdde00e2f246876045472d46d00b4828 not found: ID does not exist" containerID="62e7ff562fa6bfbc25968b1839044f94fdde00e2f246876045472d46d00b4828"
Jul 27 20:02:31.634272 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.634216    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62e7ff562fa6bfbc25968b1839044f94fdde00e2f246876045472d46d00b4828"} err="failed to get container status \"62e7ff562fa6bfbc25968b1839044f94fdde00e2f246876045472d46d00b4828\": rpc error: code = NotFound desc = could not find container \"62e7ff562fa6bfbc25968b1839044f94fdde00e2f246876045472d46d00b4828\": container with ID starting with 62e7ff562fa6bfbc25968b1839044f94fdde00e2f246876045472d46d00b4828 not found: ID does not exist"
Jul 27 20:02:31.653528 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.653501    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"]
Jul 27 20:02:31.653819 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.653799    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-credential-socket\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:02:31.653903 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.653825    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-envoy\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:02:31.653903 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.653842    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsd5p\" (UniqueName: \"kubernetes.io/projected/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-kube-api-access-gsd5p\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:02:31.653903 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.653854    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-podinfo\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:02:31.653903 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.653867    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-workload-certs\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:02:31.653903 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.653879    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-token\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:02:31.653903 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.653891    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istio-data\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:02:31.653903 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.653902    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa-istiod-ca-cert\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:02:31.667349 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:31.667327    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-73760660-openshift-default-6dc79f5684-95xgl"]
Jul 27 20:02:33.383206 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:33.383171    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" path="/var/lib/kubelet/pods/d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa/volumes"
Jul 27 20:02:42.084078 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:02:42.084028    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:03:22.499928 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.499892    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"]
Jul 27 20:03:22.500477 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.500291    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="039e4401-42ff-4126-abfa-b39145e9b491" containerName="maas-api"
Jul 27 20:03:22.500477 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.500305    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="039e4401-42ff-4126-abfa-b39145e9b491" containerName="maas-api"
Jul 27 20:03:22.500477 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.500338    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec58dede-bfd0-4418-94c2-83ed7fee1aa5" containerName="revoke-keys"
Jul 27 20:03:22.500477 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.500360    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec58dede-bfd0-4418-94c2-83ed7fee1aa5" containerName="revoke-keys"
Jul 27 20:03:22.500477 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.500373    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" containerName="istio-proxy"
Jul 27 20:03:22.500477 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.500378    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" containerName="istio-proxy"
Jul 27 20:03:22.500477 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.500388    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" containerName="istio-proxy"
Jul 27 20:03:22.500477 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.500393    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" containerName="istio-proxy"
Jul 27 20:03:22.500477 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.500456    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec58dede-bfd0-4418-94c2-83ed7fee1aa5" containerName="revoke-keys"
Jul 27 20:03:22.500477 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.500466    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" containerName="istio-proxy"
Jul 27 20:03:22.500477 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.500472    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="039e4401-42ff-4126-abfa-b39145e9b491" containerName="maas-api"
Jul 27 20:03:22.503383 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.503365    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.505839 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.505822    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-79961d-openshift-default-dockercfg-fdfsl\""
Jul 27 20:03:22.515263 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.515241    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"]
Jul 27 20:03:22.583088 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.583046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-credential-socket\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.583227 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.583102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-podinfo\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.583227 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.583139    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf8gd\" (UniqueName: \"kubernetes.io/projected/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-kube-api-access-nf8gd\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.583227 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.583190    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-workload-socket\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.583227 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.583219    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-envoy\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.583372 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.583244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-token\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.583372 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.583313    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-workload-certs\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.583372 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.583343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istiod-ca-cert\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.583372 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.583365    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-data\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.684417 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.684382    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-token\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.684605 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.684430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-workload-certs\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.684605 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.684449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istiod-ca-cert\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.684605 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.684466    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-data\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.684605 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.684525    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-credential-socket\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.684605 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.684575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-podinfo\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.684605 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.684595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf8gd\" (UniqueName: \"kubernetes.io/projected/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-kube-api-access-nf8gd\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.684926 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.684620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-workload-socket\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.684926 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.684647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-envoy\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.684926 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.684818    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-workload-certs\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.685147 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.685127    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-credential-socket\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.685257 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.685235    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istiod-ca-cert\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.685322 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.685263    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-data\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.685322 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.685301    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-workload-socket\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.687153 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.687122    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-podinfo\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.687254 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.687199    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-envoy\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.692176 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.692153    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-token\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.692256 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.692177    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf8gd\" (UniqueName: \"kubernetes.io/projected/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-kube-api-access-nf8gd\") pod \"e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") " pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.813638 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.813600    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:22.952075 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.952031    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"]
Jul 27 20:03:22.954168 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:03:22.954136    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5350bb35_4827_4dfb_a4d1_572fa2fcabc3.slice/crio-4bc4044b333db7cce99a38b022f3a5fdc2f72f3ad675f6469da1053261ff996c WatchSource:0}: Error finding container 4bc4044b333db7cce99a38b022f3a5fdc2f72f3ad675f6469da1053261ff996c: Status 404 returned error can't find the container with id 4bc4044b333db7cce99a38b022f3a5fdc2f72f3ad675f6469da1053261ff996c
Jul 27 20:03:22.956366 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.956335    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:03:22.956465 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.956398    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:03:22.956465 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:22.956425    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:03:23.499498 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:23.499466    2578 scope.go:117] "RemoveContainer" containerID="bdd384c5b10f9303c37049dc48576865983375f0f4645d62c84ac25dcf591b2d"
Jul 27 20:03:23.507370 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:23.507352    2578 scope.go:117] "RemoveContainer" containerID="69da9489e1a82236bc576e3c6e4dc7b060f63fbfb0ec0a7f8349ad81d1d549ad"
Jul 27 20:03:23.860678 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:23.860643    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw" event={"ID":"5350bb35-4827-4dfb-a4d1-572fa2fcabc3","Type":"ContainerStarted","Data":"6bac374a7c2528ad31a1d4c2693e25df69b138bccbc05efd3893bea85a17d408"}
Jul 27 20:03:23.860874 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:23.860702    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw" event={"ID":"5350bb35-4827-4dfb-a4d1-572fa2fcabc3","Type":"ContainerStarted","Data":"4bc4044b333db7cce99a38b022f3a5fdc2f72f3ad675f6469da1053261ff996c"}
Jul 27 20:03:23.880966 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:23.880911    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw" podStartSLOduration=1.880894927 podStartE2EDuration="1.880894927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:03:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:03:23.879383081 +0000 UTC m=+2221.007746902" watchObservedRunningTime="2026-07-27 20:03:23.880894927 +0000 UTC m=+2221.009258722"
Jul 27 20:03:24.813958 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:24.813910    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:24.818971 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:24.818945    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:24.866106 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:24.866076    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:24.867109 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:24.867087    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:25.846996 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:25.846959    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"]
Jul 27 20:03:25.847401 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:25.847352    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7d1e1ae-f35f-4bcf-8f4e-712f75ecefaa" containerName="istio-proxy"
Jul 27 20:03:25.851850 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:25.851835    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"
Jul 27 20:03:25.854223 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:25.854099    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-79961d-serving-cert\""
Jul 27 20:03:25.854223 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:25.854207    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 20:03:25.854413 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:25.854247    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-86dhg\""
Jul 27 20:03:25.855211 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:25.855196    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 20:03:25.858764 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:25.858642    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"]
Jul 27 20:03:25.913389 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:25.913358    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a746af54-031e-4c8f-92a8-da44b578d420-openshift-service-ca\") pod \"maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl\" (UID: \"a746af54-031e-4c8f-92a8-da44b578d420\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"
Jul 27 20:03:25.913389 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:25.913394    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a746af54-031e-4c8f-92a8-da44b578d420-maas-api-tls\") pod \"maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl\" (UID: \"a746af54-031e-4c8f-92a8-da44b578d420\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"
Jul 27 20:03:25.913649 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:25.913501    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9jdp\" (UniqueName: \"kubernetes.io/projected/a746af54-031e-4c8f-92a8-da44b578d420-kube-api-access-b9jdp\") pod \"maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl\" (UID: \"a746af54-031e-4c8f-92a8-da44b578d420\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"
Jul 27 20:03:26.014382 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:26.014349    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a746af54-031e-4c8f-92a8-da44b578d420-openshift-service-ca\") pod \"maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl\" (UID: \"a746af54-031e-4c8f-92a8-da44b578d420\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"
Jul 27 20:03:26.014561 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:26.014388    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a746af54-031e-4c8f-92a8-da44b578d420-maas-api-tls\") pod \"maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl\" (UID: \"a746af54-031e-4c8f-92a8-da44b578d420\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"
Jul 27 20:03:26.014561 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:26.014430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9jdp\" (UniqueName: \"kubernetes.io/projected/a746af54-031e-4c8f-92a8-da44b578d420-kube-api-access-b9jdp\") pod \"maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl\" (UID: \"a746af54-031e-4c8f-92a8-da44b578d420\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"
Jul 27 20:03:26.014641 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:03:26.014559    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-serving-cert: secret "maas-api-e2e-inf-a-79961d-serving-cert" not found
Jul 27 20:03:26.014641 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:03:26.014628    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a746af54-031e-4c8f-92a8-da44b578d420-maas-api-tls podName:a746af54-031e-4c8f-92a8-da44b578d420 nodeName:}" failed. No retries permitted until 2026-07-27 20:03:26.514612676 +0000 UTC m=+2223.642976450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a746af54-031e-4c8f-92a8-da44b578d420-maas-api-tls") pod "maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl" (UID: "a746af54-031e-4c8f-92a8-da44b578d420") : secret "maas-api-e2e-inf-a-79961d-serving-cert" not found
Jul 27 20:03:26.014979 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:26.014961    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a746af54-031e-4c8f-92a8-da44b578d420-openshift-service-ca\") pod \"maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl\" (UID: \"a746af54-031e-4c8f-92a8-da44b578d420\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"
Jul 27 20:03:26.023447 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:26.023417    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9jdp\" (UniqueName: \"kubernetes.io/projected/a746af54-031e-4c8f-92a8-da44b578d420-kube-api-access-b9jdp\") pod \"maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl\" (UID: \"a746af54-031e-4c8f-92a8-da44b578d420\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"
Jul 27 20:03:26.520281 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:26.520246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a746af54-031e-4c8f-92a8-da44b578d420-maas-api-tls\") pod \"maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl\" (UID: \"a746af54-031e-4c8f-92a8-da44b578d420\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"
Jul 27 20:03:26.520456 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:03:26.520374    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-serving-cert: secret "maas-api-e2e-inf-a-79961d-serving-cert" not found
Jul 27 20:03:26.520456 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:03:26.520434    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a746af54-031e-4c8f-92a8-da44b578d420-maas-api-tls podName:a746af54-031e-4c8f-92a8-da44b578d420 nodeName:}" failed. No retries permitted until 2026-07-27 20:03:27.520419769 +0000 UTC m=+2224.648783546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a746af54-031e-4c8f-92a8-da44b578d420-maas-api-tls") pod "maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl" (UID: "a746af54-031e-4c8f-92a8-da44b578d420") : secret "maas-api-e2e-inf-a-79961d-serving-cert" not found
Jul 27 20:03:27.530212 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:27.530180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a746af54-031e-4c8f-92a8-da44b578d420-maas-api-tls\") pod \"maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl\" (UID: \"a746af54-031e-4c8f-92a8-da44b578d420\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"
Jul 27 20:03:27.532633 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:27.532613    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a746af54-031e-4c8f-92a8-da44b578d420-maas-api-tls\") pod \"maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl\" (UID: \"a746af54-031e-4c8f-92a8-da44b578d420\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"
Jul 27 20:03:27.664723 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:27.664686    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"
Jul 27 20:03:27.793760 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:27.793737    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"]
Jul 27 20:03:27.795591 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:03:27.795559    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda746af54_031e_4c8f_92a8_da44b578d420.slice/crio-41d9385e5f7cf839cafc74b86c105da753f85f5f5306c33ca4ab13b8ce14a1a1 WatchSource:0}: Error finding container 41d9385e5f7cf839cafc74b86c105da753f85f5f5306c33ca4ab13b8ce14a1a1: Status 404 returned error can't find the container with id 41d9385e5f7cf839cafc74b86c105da753f85f5f5306c33ca4ab13b8ce14a1a1
Jul 27 20:03:27.882192 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:27.882156    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl" event={"ID":"a746af54-031e-4c8f-92a8-da44b578d420","Type":"ContainerStarted","Data":"41d9385e5f7cf839cafc74b86c105da753f85f5f5306c33ca4ab13b8ce14a1a1"}
Jul 27 20:03:28.887496 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:28.887464    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl" event={"ID":"a746af54-031e-4c8f-92a8-da44b578d420","Type":"ContainerStarted","Data":"09a136042033f29b14a5571425e647da273f227bf262d650550cb9f3926702f6"}
Jul 27 20:03:28.887886 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:28.887568    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"
Jul 27 20:03:28.905138 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:28.905092    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl" podStartSLOduration=3.348861994 podStartE2EDuration="3.905079071s" totalImagesPullingTime="556.217077ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:03:28.903757723 +0000 UTC m=+2226.032121520" watchObservedRunningTime="2026-07-27 20:03:28.905079071 +0000 UTC m=+2226.033442863"
Jul 27 20:03:30.975932 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:30.975895    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:03:34.321912 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:34.321868    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"]
Jul 27 20:03:34.325596 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:34.325574    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"
Jul 27 20:03:34.328424 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:34.328398    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-08e715-serving-cert\""
Jul 27 20:03:34.336867 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:34.336845    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"]
Jul 27 20:03:34.398603 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:34.398567    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56e2cfc7-8a71-477e-9857-52bd7591f60f-maas-api-tls\") pod \"maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7\" (UID: \"56e2cfc7-8a71-477e-9857-52bd7591f60f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"
Jul 27 20:03:34.398803 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:34.398660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56e2cfc7-8a71-477e-9857-52bd7591f60f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7\" (UID: \"56e2cfc7-8a71-477e-9857-52bd7591f60f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"
Jul 27 20:03:34.398803 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:34.398684    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgpqz\" (UniqueName: \"kubernetes.io/projected/56e2cfc7-8a71-477e-9857-52bd7591f60f-kube-api-access-zgpqz\") pod \"maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7\" (UID: \"56e2cfc7-8a71-477e-9857-52bd7591f60f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"
Jul 27 20:03:34.499242 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:34.499204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56e2cfc7-8a71-477e-9857-52bd7591f60f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7\" (UID: \"56e2cfc7-8a71-477e-9857-52bd7591f60f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"
Jul 27 20:03:34.499429 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:34.499253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgpqz\" (UniqueName: \"kubernetes.io/projected/56e2cfc7-8a71-477e-9857-52bd7591f60f-kube-api-access-zgpqz\") pod \"maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7\" (UID: \"56e2cfc7-8a71-477e-9857-52bd7591f60f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"
Jul 27 20:03:34.499429 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:34.499355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56e2cfc7-8a71-477e-9857-52bd7591f60f-maas-api-tls\") pod \"maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7\" (UID: \"56e2cfc7-8a71-477e-9857-52bd7591f60f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"
Jul 27 20:03:34.499951 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:34.499926    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56e2cfc7-8a71-477e-9857-52bd7591f60f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7\" (UID: \"56e2cfc7-8a71-477e-9857-52bd7591f60f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"
Jul 27 20:03:34.501873 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:34.501842    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56e2cfc7-8a71-477e-9857-52bd7591f60f-maas-api-tls\") pod \"maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7\" (UID: \"56e2cfc7-8a71-477e-9857-52bd7591f60f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"
Jul 27 20:03:34.506963 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:34.506945    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgpqz\" (UniqueName: \"kubernetes.io/projected/56e2cfc7-8a71-477e-9857-52bd7591f60f-kube-api-access-zgpqz\") pod \"maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7\" (UID: \"56e2cfc7-8a71-477e-9857-52bd7591f60f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"
Jul 27 20:03:34.637186 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:34.637094    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"
Jul 27 20:03:34.798432 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:34.798126    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"]
Jul 27 20:03:34.800412 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:03:34.800382    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e2cfc7_8a71_477e_9857_52bd7591f60f.slice/crio-4de1c5d9d1da98a5afbbf16a9471bfefc2a5262cd7c6daaa14f5acda6f29c1b4 WatchSource:0}: Error finding container 4de1c5d9d1da98a5afbbf16a9471bfefc2a5262cd7c6daaa14f5acda6f29c1b4: Status 404 returned error can't find the container with id 4de1c5d9d1da98a5afbbf16a9471bfefc2a5262cd7c6daaa14f5acda6f29c1b4
Jul 27 20:03:34.899662 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:34.899581    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"
Jul 27 20:03:34.917097 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:34.917042    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7" event={"ID":"56e2cfc7-8a71-477e-9857-52bd7591f60f","Type":"ContainerStarted","Data":"4de1c5d9d1da98a5afbbf16a9471bfefc2a5262cd7c6daaa14f5acda6f29c1b4"}
Jul 27 20:03:35.923629 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:35.923592    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7" event={"ID":"56e2cfc7-8a71-477e-9857-52bd7591f60f","Type":"ContainerStarted","Data":"e3be623f4207dff1730d2a741211f65ee55079d1d7923ddbe4e465a9ec556b8d"}
Jul 27 20:03:35.924026 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:35.923702    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"
Jul 27 20:03:35.942979 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:35.942931    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7" podStartSLOduration=1.418835746 podStartE2EDuration="1.942915033s" totalImagesPullingTime="524.079287ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:03:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:03:35.942033109 +0000 UTC m=+2233.070396907" watchObservedRunningTime="2026-07-27 20:03:35.942915033 +0000 UTC m=+2233.071278877"
Jul 27 20:03:39.867198 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:39.867162    2578 patch_prober.go:28] interesting pod/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 27 20:03:39.867612 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:39.867251    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw" podUID="5350bb35-4827-4dfb-a4d1-572fa2fcabc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 27 20:03:39.944700 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:39.944666    2578 generic.go:356] "Generic (PLEG): container finished" podID="5350bb35-4827-4dfb-a4d1-572fa2fcabc3" containerID="6bac374a7c2528ad31a1d4c2693e25df69b138bccbc05efd3893bea85a17d408" exitCode=0
Jul 27 20:03:39.944860 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:39.944742    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw" event={"ID":"5350bb35-4827-4dfb-a4d1-572fa2fcabc3","Type":"ContainerDied","Data":"6bac374a7c2528ad31a1d4c2693e25df69b138bccbc05efd3893bea85a17d408"}
Jul 27 20:03:39.945176 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:39.945156    2578 scope.go:117] "RemoveContainer" containerID="6bac374a7c2528ad31a1d4c2693e25df69b138bccbc05efd3893bea85a17d408"
Jul 27 20:03:39.946172 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:39.946143    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:03:39.946246 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:39.946214    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:03:39.946288 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:39.946255    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:03:40.069189 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:40.069151    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:03:40.957571 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:40.957535    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw" event={"ID":"5350bb35-4827-4dfb-a4d1-572fa2fcabc3","Type":"ContainerStarted","Data":"987a246e4cb20b42381f4be5a8d636be8579a6290594695283fa0cc72c122ced"}
Jul 27 20:03:41.813782 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:41.813746    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:41.813965 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:41.813941    2578 patch_prober.go:28] interesting pod/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 27 20:03:41.814009 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:41.813995    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw" podUID="5350bb35-4827-4dfb-a4d1-572fa2fcabc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 27 20:03:41.935712 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:41.935682    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"
Jul 27 20:03:42.814892 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:42.814850    2578 patch_prober.go:28] interesting pod/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 27 20:03:42.815309 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:42.814920    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw" podUID="5350bb35-4827-4dfb-a4d1-572fa2fcabc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 27 20:03:43.814336 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:43.814299    2578 patch_prober.go:28] interesting pod/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 27 20:03:43.814513 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:43.814365    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw" podUID="5350bb35-4827-4dfb-a4d1-572fa2fcabc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 27 20:03:44.814531 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:44.814488    2578 patch_prober.go:28] interesting pod/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 27 20:03:44.814946 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:44.814547    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw" podUID="5350bb35-4827-4dfb-a4d1-572fa2fcabc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 27 20:03:45.817998 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:45.817958    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:45.818403 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:45.818364    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:03:45.819146 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:03:45.819126    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:04:03.370457 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:04:03.370420    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:04:14.878379 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:04:14.878334    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:04:23.532271 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:04:23.532234    2578 scope.go:117] "RemoveContainer" containerID="c0b51546ba4c7d15289f18d72f10ec50f15aca34c31157cf676340f7f48808b6"
Jul 27 20:04:29.480044 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:04:29.480007    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:05:04.238534 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:04.238500    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-79961d-q6vps"]
Jul 27 20:05:04.242038 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:04.242022    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-79961d-q6vps"
Jul 27 20:05:04.244503 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:04.244476    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-875sf\""
Jul 27 20:05:04.250133 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:04.250109    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-79961d-q6vps"]
Jul 27 20:05:04.265318 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:04.265286    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/743f04f1-8e47-4b0b-a163-3d9d340b2751-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-79961d-q6vps\" (UID: \"743f04f1-8e47-4b0b-a163-3d9d340b2751\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-79961d-q6vps"
Jul 27 20:05:04.366397 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:04.366366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/743f04f1-8e47-4b0b-a163-3d9d340b2751-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-79961d-q6vps\" (UID: \"743f04f1-8e47-4b0b-a163-3d9d340b2751\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-79961d-q6vps"
Jul 27 20:05:04.366927 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:04.366909    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/743f04f1-8e47-4b0b-a163-3d9d340b2751-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-79961d-q6vps\" (UID: \"743f04f1-8e47-4b0b-a163-3d9d340b2751\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-79961d-q6vps"
Jul 27 20:05:04.553406 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:04.553376    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-79961d-q6vps"
Jul 27 20:05:04.684896 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:04.684867    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-79961d-q6vps"]
Jul 27 20:05:04.687565 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:05:04.687538    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod743f04f1_8e47_4b0b_a163_3d9d340b2751.slice/crio-5ccff813084cdbf7667178561c06328cdedc378f88e20fa750a385ed5ba3c023 WatchSource:0}: Error finding container 5ccff813084cdbf7667178561c06328cdedc378f88e20fa750a385ed5ba3c023: Status 404 returned error can't find the container with id 5ccff813084cdbf7667178561c06328cdedc378f88e20fa750a385ed5ba3c023
Jul 27 20:05:05.370220 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:05.370187    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-79961d-q6vps" event={"ID":"743f04f1-8e47-4b0b-a163-3d9d340b2751","Type":"ContainerStarted","Data":"6e6d9040f87936fa91a7dc9f568bb49e296654e1290c8ce7da72ab5e7ce8b20b"}
Jul 27 20:05:05.370691 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:05.370248    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-79961d-q6vps" event={"ID":"743f04f1-8e47-4b0b-a163-3d9d340b2751","Type":"ContainerStarted","Data":"5ccff813084cdbf7667178561c06328cdedc378f88e20fa750a385ed5ba3c023"}
Jul 27 20:05:05.387228 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:05.387182    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-79961d-q6vps" podStartSLOduration=1.3871682459999999 podStartE2EDuration="1.387168246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:05:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:05:05.385645029 +0000 UTC m=+2322.514008819" watchObservedRunningTime="2026-07-27 20:05:05.387168246 +0000 UTC m=+2322.515532070"
Jul 27 20:05:06.376174 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:06.376137    2578 generic.go:356] "Generic (PLEG): container finished" podID="743f04f1-8e47-4b0b-a163-3d9d340b2751" containerID="6e6d9040f87936fa91a7dc9f568bb49e296654e1290c8ce7da72ab5e7ce8b20b" exitCode=0
Jul 27 20:05:06.376591 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:06.376228    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-79961d-q6vps" event={"ID":"743f04f1-8e47-4b0b-a163-3d9d340b2751","Type":"ContainerDied","Data":"6e6d9040f87936fa91a7dc9f568bb49e296654e1290c8ce7da72ab5e7ce8b20b"}
Jul 27 20:05:07.517253 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:07.517228    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-79961d-q6vps"
Jul 27 20:05:07.598337 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:07.598308    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/743f04f1-8e47-4b0b-a163-3d9d340b2751-maas-api-service-ca\") pod \"743f04f1-8e47-4b0b-a163-3d9d340b2751\" (UID: \"743f04f1-8e47-4b0b-a163-3d9d340b2751\") "
Jul 27 20:05:07.598743 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:07.598716    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/743f04f1-8e47-4b0b-a163-3d9d340b2751-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "743f04f1-8e47-4b0b-a163-3d9d340b2751" (UID: "743f04f1-8e47-4b0b-a163-3d9d340b2751"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:05:07.699470 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:07.699383    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/743f04f1-8e47-4b0b-a163-3d9d340b2751-maas-api-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:05:08.389711 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:08.389675    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-79961d-q6vps"
Jul 27 20:05:08.389884 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:08.389723    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-79961d-q6vps" event={"ID":"743f04f1-8e47-4b0b-a163-3d9d340b2751","Type":"ContainerDied","Data":"5ccff813084cdbf7667178561c06328cdedc378f88e20fa750a385ed5ba3c023"}
Jul 27 20:05:08.389884 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:08.389765    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ccff813084cdbf7667178561c06328cdedc378f88e20fa750a385ed5ba3c023"
Jul 27 20:05:08.479012 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:08.478981    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:05:14.652595 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:14.652517    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"]
Jul 27 20:05:14.652989 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:14.652751    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl" podUID="a746af54-031e-4c8f-92a8-da44b578d420" containerName="maas-api" containerID="cri-o://09a136042033f29b14a5571425e647da273f227bf262d650550cb9f3926702f6" gracePeriod=30
Jul 27 20:05:14.844652 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:14.844614    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-79961d-q6vps"]
Jul 27 20:05:14.846303 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:14.846276    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-79961d-q6vps"]
Jul 27 20:05:14.906341 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:14.906284    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"
Jul 27 20:05:14.966877 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:14.966845    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a746af54-031e-4c8f-92a8-da44b578d420-openshift-service-ca\") pod \"a746af54-031e-4c8f-92a8-da44b578d420\" (UID: \"a746af54-031e-4c8f-92a8-da44b578d420\") "
Jul 27 20:05:14.967047 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:14.966894    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a746af54-031e-4c8f-92a8-da44b578d420-maas-api-tls\") pod \"a746af54-031e-4c8f-92a8-da44b578d420\" (UID: \"a746af54-031e-4c8f-92a8-da44b578d420\") "
Jul 27 20:05:14.967047 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:14.966918    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9jdp\" (UniqueName: \"kubernetes.io/projected/a746af54-031e-4c8f-92a8-da44b578d420-kube-api-access-b9jdp\") pod \"a746af54-031e-4c8f-92a8-da44b578d420\" (UID: \"a746af54-031e-4c8f-92a8-da44b578d420\") "
Jul 27 20:05:14.967240 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:14.967216    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a746af54-031e-4c8f-92a8-da44b578d420-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a746af54-031e-4c8f-92a8-da44b578d420" (UID: "a746af54-031e-4c8f-92a8-da44b578d420"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:05:14.969084 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:14.969041    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a746af54-031e-4c8f-92a8-da44b578d420-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a746af54-031e-4c8f-92a8-da44b578d420" (UID: "a746af54-031e-4c8f-92a8-da44b578d420"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:05:14.969202 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:14.969172    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a746af54-031e-4c8f-92a8-da44b578d420-kube-api-access-b9jdp" (OuterVolumeSpecName: "kube-api-access-b9jdp") pod "a746af54-031e-4c8f-92a8-da44b578d420" (UID: "a746af54-031e-4c8f-92a8-da44b578d420"). InnerVolumeSpecName "kube-api-access-b9jdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:05:15.068371 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:15.068339    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9jdp\" (UniqueName: \"kubernetes.io/projected/a746af54-031e-4c8f-92a8-da44b578d420-kube-api-access-b9jdp\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:05:15.068371 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:15.068364    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a746af54-031e-4c8f-92a8-da44b578d420-openshift-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:05:15.068371 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:15.068374    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a746af54-031e-4c8f-92a8-da44b578d420-maas-api-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:05:15.383033 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:15.382998    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="743f04f1-8e47-4b0b-a163-3d9d340b2751" path="/var/lib/kubelet/pods/743f04f1-8e47-4b0b-a163-3d9d340b2751/volumes"
Jul 27 20:05:15.420326 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:15.420284    2578 generic.go:356] "Generic (PLEG): container finished" podID="a746af54-031e-4c8f-92a8-da44b578d420" containerID="09a136042033f29b14a5571425e647da273f227bf262d650550cb9f3926702f6" exitCode=0
Jul 27 20:05:15.420698 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:15.420330    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl" event={"ID":"a746af54-031e-4c8f-92a8-da44b578d420","Type":"ContainerDied","Data":"09a136042033f29b14a5571425e647da273f227bf262d650550cb9f3926702f6"}
Jul 27 20:05:15.420698 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:15.420408    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl" event={"ID":"a746af54-031e-4c8f-92a8-da44b578d420","Type":"ContainerDied","Data":"41d9385e5f7cf839cafc74b86c105da753f85f5f5306c33ca4ab13b8ce14a1a1"}
Jul 27 20:05:15.420698 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:15.420343    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"
Jul 27 20:05:15.420698 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:15.420430    2578 scope.go:117] "RemoveContainer" containerID="09a136042033f29b14a5571425e647da273f227bf262d650550cb9f3926702f6"
Jul 27 20:05:15.428726 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:15.428707    2578 scope.go:117] "RemoveContainer" containerID="09a136042033f29b14a5571425e647da273f227bf262d650550cb9f3926702f6"
Jul 27 20:05:15.428972 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:05:15.428952    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09a136042033f29b14a5571425e647da273f227bf262d650550cb9f3926702f6\": container with ID starting with 09a136042033f29b14a5571425e647da273f227bf262d650550cb9f3926702f6 not found: ID does not exist" containerID="09a136042033f29b14a5571425e647da273f227bf262d650550cb9f3926702f6"
Jul 27 20:05:15.429041 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:15.428979    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09a136042033f29b14a5571425e647da273f227bf262d650550cb9f3926702f6"} err="failed to get container status \"09a136042033f29b14a5571425e647da273f227bf262d650550cb9f3926702f6\": rpc error: code = NotFound desc = could not find container \"09a136042033f29b14a5571425e647da273f227bf262d650550cb9f3926702f6\": container with ID starting with 09a136042033f29b14a5571425e647da273f227bf262d650550cb9f3926702f6 not found: ID does not exist"
Jul 27 20:05:15.436241 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:15.436217    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"]
Jul 27 20:05:15.438192 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:15.438170    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl"]
Jul 27 20:05:17.383321 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:17.383288    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a746af54-031e-4c8f-92a8-da44b578d420" path="/var/lib/kubelet/pods/a746af54-031e-4c8f-92a8-da44b578d420/volumes"
Jul 27 20:05:17.893962 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:17.893910    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79961d-64b74db69b-2r6tl" podUID="a746af54-031e-4c8f-92a8-da44b578d420" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.44:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 27 20:05:21.411311 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:21.411282    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"]
Jul 27 20:05:21.411687 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:21.411470    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw" podUID="5350bb35-4827-4dfb-a4d1-572fa2fcabc3" containerName="istio-proxy" containerID="cri-o://987a246e4cb20b42381f4be5a8d636be8579a6290594695283fa0cc72c122ced" gracePeriod=30
Jul 27 20:05:21.765088 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:21.762440    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e715-njwwj"]
Jul 27 20:05:21.765088 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:21.763250    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="743f04f1-8e47-4b0b-a163-3d9d340b2751" containerName="revoke-keys"
Jul 27 20:05:21.765088 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:21.763270    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="743f04f1-8e47-4b0b-a163-3d9d340b2751" containerName="revoke-keys"
Jul 27 20:05:21.765088 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:21.763318    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a746af54-031e-4c8f-92a8-da44b578d420" containerName="maas-api"
Jul 27 20:05:21.765088 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:21.763326    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a746af54-031e-4c8f-92a8-da44b578d420" containerName="maas-api"
Jul 27 20:05:21.765088 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:21.763491    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a746af54-031e-4c8f-92a8-da44b578d420" containerName="maas-api"
Jul 27 20:05:21.765088 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:21.763502    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="743f04f1-8e47-4b0b-a163-3d9d340b2751" containerName="revoke-keys"
Jul 27 20:05:21.768418 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:21.768386    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e715-njwwj"
Jul 27 20:05:21.771027 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:21.771000    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-875sf\""
Jul 27 20:05:21.771405 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:21.771381    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e715-njwwj"]
Jul 27 20:05:21.824771 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:21.824741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe9c69a0-e53e-439d-a07f-3212beec8250-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-08e715-njwwj\" (UID: \"fe9c69a0-e53e-439d-a07f-3212beec8250\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e715-njwwj"
Jul 27 20:05:21.925894 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:21.925864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe9c69a0-e53e-439d-a07f-3212beec8250-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-08e715-njwwj\" (UID: \"fe9c69a0-e53e-439d-a07f-3212beec8250\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e715-njwwj"
Jul 27 20:05:21.926501 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:21.926475    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe9c69a0-e53e-439d-a07f-3212beec8250-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-08e715-njwwj\" (UID: \"fe9c69a0-e53e-439d-a07f-3212beec8250\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e715-njwwj"
Jul 27 20:05:22.079671 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:22.079636    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e715-njwwj"
Jul 27 20:05:22.203839 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:22.203795    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e715-njwwj"]
Jul 27 20:05:22.204621 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:05:22.204596    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe9c69a0_e53e_439d_a07f_3212beec8250.slice/crio-dc7c7f5fc928dd6a2b55d56eec713549a0bd5a5a5b5a61260b784a7195642757 WatchSource:0}: Error finding container dc7c7f5fc928dd6a2b55d56eec713549a0bd5a5a5b5a61260b784a7195642757: Status 404 returned error can't find the container with id dc7c7f5fc928dd6a2b55d56eec713549a0bd5a5a5b5a61260b784a7195642757
Jul 27 20:05:22.456259 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:22.456222    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e715-njwwj" event={"ID":"fe9c69a0-e53e-439d-a07f-3212beec8250","Type":"ContainerStarted","Data":"dc7c7f5fc928dd6a2b55d56eec713549a0bd5a5a5b5a61260b784a7195642757"}
Jul 27 20:05:23.461986 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:23.461956    2578 generic.go:356] "Generic (PLEG): container finished" podID="fe9c69a0-e53e-439d-a07f-3212beec8250" containerID="510750ced40648297eb8a5af6456cdb0081aec7be6a611a0bd0eb28a0ac4fc8a" exitCode=0
Jul 27 20:05:23.462371 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:23.462008    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e715-njwwj" event={"ID":"fe9c69a0-e53e-439d-a07f-3212beec8250","Type":"ContainerDied","Data":"510750ced40648297eb8a5af6456cdb0081aec7be6a611a0bd0eb28a0ac4fc8a"}
Jul 27 20:05:24.473915 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:24.473885    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:05:24.594103 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:24.594075    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e715-njwwj"
Jul 27 20:05:24.649303 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:24.649276    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe9c69a0-e53e-439d-a07f-3212beec8250-maas-api-service-ca\") pod \"fe9c69a0-e53e-439d-a07f-3212beec8250\" (UID: \"fe9c69a0-e53e-439d-a07f-3212beec8250\") "
Jul 27 20:05:24.649615 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:24.649585    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe9c69a0-e53e-439d-a07f-3212beec8250-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fe9c69a0-e53e-439d-a07f-3212beec8250" (UID: "fe9c69a0-e53e-439d-a07f-3212beec8250"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:05:24.749849 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:24.749778    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe9c69a0-e53e-439d-a07f-3212beec8250-maas-api-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:05:25.471822 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:25.471793    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e715-njwwj"
Jul 27 20:05:25.471822 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:25.471806    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e715-njwwj" event={"ID":"fe9c69a0-e53e-439d-a07f-3212beec8250","Type":"ContainerDied","Data":"dc7c7f5fc928dd6a2b55d56eec713549a0bd5a5a5b5a61260b784a7195642757"}
Jul 27 20:05:25.472035 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:25.471847    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc7c7f5fc928dd6a2b55d56eec713549a0bd5a5a5b5a61260b784a7195642757"
Jul 27 20:05:26.649726 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.649703    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:05:26.767689 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.767604    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-envoy\") pod \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") "
Jul 27 20:05:26.767689 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.767636    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-data\") pod \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") "
Jul 27 20:05:26.767689 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.767671    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-credential-socket\") pod \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") "
Jul 27 20:05:26.767976 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.767721    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-workload-socket\") pod \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") "
Jul 27 20:05:26.767976 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.767749    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istiod-ca-cert\") pod \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") "
Jul 27 20:05:26.767976 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.767818    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nf8gd\" (UniqueName: \"kubernetes.io/projected/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-kube-api-access-nf8gd\") pod \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") "
Jul 27 20:05:26.767976 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.767841    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-workload-certs\") pod \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") "
Jul 27 20:05:26.767976 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.767869    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-podinfo\") pod \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") "
Jul 27 20:05:26.768250 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.768041    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5350bb35-4827-4dfb-a4d1-572fa2fcabc3" (UID: "5350bb35-4827-4dfb-a4d1-572fa2fcabc3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:05:26.768250 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.768034    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5350bb35-4827-4dfb-a4d1-572fa2fcabc3" (UID: "5350bb35-4827-4dfb-a4d1-572fa2fcabc3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:05:26.768250 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.768109    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-token\") pod \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\" (UID: \"5350bb35-4827-4dfb-a4d1-572fa2fcabc3\") "
Jul 27 20:05:26.768402 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.768296    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5350bb35-4827-4dfb-a4d1-572fa2fcabc3" (UID: "5350bb35-4827-4dfb-a4d1-572fa2fcabc3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:05:26.768536 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.768510    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5350bb35-4827-4dfb-a4d1-572fa2fcabc3" (UID: "5350bb35-4827-4dfb-a4d1-572fa2fcabc3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:05:26.768598 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.768527    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-data" (OuterVolumeSpecName: "istio-data") pod "5350bb35-4827-4dfb-a4d1-572fa2fcabc3" (UID: "5350bb35-4827-4dfb-a4d1-572fa2fcabc3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:05:26.768655 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.768634    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-credential-socket\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:05:26.768700 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.768654    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-workload-socket\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:05:26.768700 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.768668    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istiod-ca-cert\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:05:26.768763 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.768721    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-workload-certs\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:05:26.768864 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.768829    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-data\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:05:26.770236 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.770215    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-token" (OuterVolumeSpecName: "istio-token") pod "5350bb35-4827-4dfb-a4d1-572fa2fcabc3" (UID: "5350bb35-4827-4dfb-a4d1-572fa2fcabc3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:05:26.770359 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.770235    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-kube-api-access-nf8gd" (OuterVolumeSpecName: "kube-api-access-nf8gd") pod "5350bb35-4827-4dfb-a4d1-572fa2fcabc3" (UID: "5350bb35-4827-4dfb-a4d1-572fa2fcabc3"). InnerVolumeSpecName "kube-api-access-nf8gd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:05:26.770453 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.770434    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5350bb35-4827-4dfb-a4d1-572fa2fcabc3" (UID: "5350bb35-4827-4dfb-a4d1-572fa2fcabc3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:05:26.770453 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.770439    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5350bb35-4827-4dfb-a4d1-572fa2fcabc3" (UID: "5350bb35-4827-4dfb-a4d1-572fa2fcabc3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:05:26.869998 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.869952    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-envoy\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:05:26.869998 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.869992    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nf8gd\" (UniqueName: \"kubernetes.io/projected/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-kube-api-access-nf8gd\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:05:26.869998 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.870001    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-podinfo\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:05:26.869998 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:26.870009    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5350bb35-4827-4dfb-a4d1-572fa2fcabc3-istio-token\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:05:27.483065 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:27.483018    2578 generic.go:356] "Generic (PLEG): container finished" podID="5350bb35-4827-4dfb-a4d1-572fa2fcabc3" containerID="987a246e4cb20b42381f4be5a8d636be8579a6290594695283fa0cc72c122ced" exitCode=0
Jul 27 20:05:27.483250 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:27.483089    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"
Jul 27 20:05:27.483250 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:27.483087    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw" event={"ID":"5350bb35-4827-4dfb-a4d1-572fa2fcabc3","Type":"ContainerDied","Data":"987a246e4cb20b42381f4be5a8d636be8579a6290594695283fa0cc72c122ced"}
Jul 27 20:05:27.483250 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:27.483234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw" event={"ID":"5350bb35-4827-4dfb-a4d1-572fa2fcabc3","Type":"ContainerDied","Data":"4bc4044b333db7cce99a38b022f3a5fdc2f72f3ad675f6469da1053261ff996c"}
Jul 27 20:05:27.483424 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:27.483272    2578 scope.go:117] "RemoveContainer" containerID="987a246e4cb20b42381f4be5a8d636be8579a6290594695283fa0cc72c122ced"
Jul 27 20:05:27.491792 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:27.491778    2578 scope.go:117] "RemoveContainer" containerID="6bac374a7c2528ad31a1d4c2693e25df69b138bccbc05efd3893bea85a17d408"
Jul 27 20:05:27.499142 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:27.499126    2578 scope.go:117] "RemoveContainer" containerID="987a246e4cb20b42381f4be5a8d636be8579a6290594695283fa0cc72c122ced"
Jul 27 20:05:27.499380 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:05:27.499362    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"987a246e4cb20b42381f4be5a8d636be8579a6290594695283fa0cc72c122ced\": container with ID starting with 987a246e4cb20b42381f4be5a8d636be8579a6290594695283fa0cc72c122ced not found: ID does not exist" containerID="987a246e4cb20b42381f4be5a8d636be8579a6290594695283fa0cc72c122ced"
Jul 27 20:05:27.499420 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:27.499388    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"987a246e4cb20b42381f4be5a8d636be8579a6290594695283fa0cc72c122ced"} err="failed to get container status \"987a246e4cb20b42381f4be5a8d636be8579a6290594695283fa0cc72c122ced\": rpc error: code = NotFound desc = could not find container \"987a246e4cb20b42381f4be5a8d636be8579a6290594695283fa0cc72c122ced\": container with ID starting with 987a246e4cb20b42381f4be5a8d636be8579a6290594695283fa0cc72c122ced not found: ID does not exist"
Jul 27 20:05:27.499420 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:27.499404    2578 scope.go:117] "RemoveContainer" containerID="6bac374a7c2528ad31a1d4c2693e25df69b138bccbc05efd3893bea85a17d408"
Jul 27 20:05:27.499639 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:05:27.499624    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bac374a7c2528ad31a1d4c2693e25df69b138bccbc05efd3893bea85a17d408\": container with ID starting with 6bac374a7c2528ad31a1d4c2693e25df69b138bccbc05efd3893bea85a17d408 not found: ID does not exist" containerID="6bac374a7c2528ad31a1d4c2693e25df69b138bccbc05efd3893bea85a17d408"
Jul 27 20:05:27.499693 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:27.499646    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bac374a7c2528ad31a1d4c2693e25df69b138bccbc05efd3893bea85a17d408"} err="failed to get container status \"6bac374a7c2528ad31a1d4c2693e25df69b138bccbc05efd3893bea85a17d408\": rpc error: code = NotFound desc = could not find container \"6bac374a7c2528ad31a1d4c2693e25df69b138bccbc05efd3893bea85a17d408\": container with ID starting with 6bac374a7c2528ad31a1d4c2693e25df69b138bccbc05efd3893bea85a17d408 not found: ID does not exist"
Jul 27 20:05:27.502263 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:27.502236    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"]
Jul 27 20:05:27.505843 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:27.505823    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-79961d-openshift-default-5cc96b8ff8-qtqhw"]
Jul 27 20:05:29.382258 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:29.382230    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5350bb35-4827-4dfb-a4d1-572fa2fcabc3" path="/var/lib/kubelet/pods/5350bb35-4827-4dfb-a4d1-572fa2fcabc3/volumes"
Jul 27 20:05:32.330644 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:32.330605    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"]
Jul 27 20:05:32.331120 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:32.330889    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7" podUID="56e2cfc7-8a71-477e-9857-52bd7591f60f" containerName="maas-api" containerID="cri-o://e3be623f4207dff1730d2a741211f65ee55079d1d7923ddbe4e465a9ec556b8d" gracePeriod=30
Jul 27 20:05:32.507137 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:32.507102    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e715-njwwj"]
Jul 27 20:05:32.509028 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:32.508998    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e715-njwwj"]
Jul 27 20:05:32.516469 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:32.516444    2578 generic.go:356] "Generic (PLEG): container finished" podID="56e2cfc7-8a71-477e-9857-52bd7591f60f" containerID="e3be623f4207dff1730d2a741211f65ee55079d1d7923ddbe4e465a9ec556b8d" exitCode=0
Jul 27 20:05:32.516574 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:32.516496    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7" event={"ID":"56e2cfc7-8a71-477e-9857-52bd7591f60f","Type":"ContainerDied","Data":"e3be623f4207dff1730d2a741211f65ee55079d1d7923ddbe4e465a9ec556b8d"}
Jul 27 20:05:32.573675 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:32.573641    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"
Jul 27 20:05:32.721665 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:32.721586    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgpqz\" (UniqueName: \"kubernetes.io/projected/56e2cfc7-8a71-477e-9857-52bd7591f60f-kube-api-access-zgpqz\") pod \"56e2cfc7-8a71-477e-9857-52bd7591f60f\" (UID: \"56e2cfc7-8a71-477e-9857-52bd7591f60f\") "
Jul 27 20:05:32.721805 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:32.721692    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56e2cfc7-8a71-477e-9857-52bd7591f60f-maas-api-tls\") pod \"56e2cfc7-8a71-477e-9857-52bd7591f60f\" (UID: \"56e2cfc7-8a71-477e-9857-52bd7591f60f\") "
Jul 27 20:05:32.721805 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:32.721712    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56e2cfc7-8a71-477e-9857-52bd7591f60f-openshift-service-ca\") pod \"56e2cfc7-8a71-477e-9857-52bd7591f60f\" (UID: \"56e2cfc7-8a71-477e-9857-52bd7591f60f\") "
Jul 27 20:05:32.722163 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:32.722127    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56e2cfc7-8a71-477e-9857-52bd7591f60f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56e2cfc7-8a71-477e-9857-52bd7591f60f" (UID: "56e2cfc7-8a71-477e-9857-52bd7591f60f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:05:32.723781 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:32.723757    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56e2cfc7-8a71-477e-9857-52bd7591f60f-kube-api-access-zgpqz" (OuterVolumeSpecName: "kube-api-access-zgpqz") pod "56e2cfc7-8a71-477e-9857-52bd7591f60f" (UID: "56e2cfc7-8a71-477e-9857-52bd7591f60f"). InnerVolumeSpecName "kube-api-access-zgpqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:05:32.723867 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:32.723790    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56e2cfc7-8a71-477e-9857-52bd7591f60f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56e2cfc7-8a71-477e-9857-52bd7591f60f" (UID: "56e2cfc7-8a71-477e-9857-52bd7591f60f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:05:32.823010 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:32.822979    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgpqz\" (UniqueName: \"kubernetes.io/projected/56e2cfc7-8a71-477e-9857-52bd7591f60f-kube-api-access-zgpqz\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:05:32.823010 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:32.823005    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56e2cfc7-8a71-477e-9857-52bd7591f60f-maas-api-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:05:32.823010 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:32.823013    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56e2cfc7-8a71-477e-9857-52bd7591f60f-openshift-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:05:33.382782 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:33.382748    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe9c69a0-e53e-439d-a07f-3212beec8250" path="/var/lib/kubelet/pods/fe9c69a0-e53e-439d-a07f-3212beec8250/volumes"
Jul 27 20:05:33.522420 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:33.522389    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"
Jul 27 20:05:33.522599 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:33.522382    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7" event={"ID":"56e2cfc7-8a71-477e-9857-52bd7591f60f","Type":"ContainerDied","Data":"4de1c5d9d1da98a5afbbf16a9471bfefc2a5262cd7c6daaa14f5acda6f29c1b4"}
Jul 27 20:05:33.522599 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:33.522540    2578 scope.go:117] "RemoveContainer" containerID="e3be623f4207dff1730d2a741211f65ee55079d1d7923ddbe4e465a9ec556b8d"
Jul 27 20:05:33.537481 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:33.537458    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"]
Jul 27 20:05:33.540793 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:33.540770    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-08e715-59cf6c466c-zlch7"]
Jul 27 20:05:35.382770 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:35.382740    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56e2cfc7-8a71-477e-9857-52bd7591f60f" path="/var/lib/kubelet/pods/56e2cfc7-8a71-477e-9857-52bd7591f60f/volumes"
Jul 27 20:05:35.569096 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:35.569063    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:05:40.129067 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.129012    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"]
Jul 27 20:05:40.129497 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.129480    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe9c69a0-e53e-439d-a07f-3212beec8250" containerName="revoke-keys"
Jul 27 20:05:40.129552 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.129499    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe9c69a0-e53e-439d-a07f-3212beec8250" containerName="revoke-keys"
Jul 27 20:05:40.129552 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.129514    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56e2cfc7-8a71-477e-9857-52bd7591f60f" containerName="maas-api"
Jul 27 20:05:40.129552 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.129522    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="56e2cfc7-8a71-477e-9857-52bd7591f60f" containerName="maas-api"
Jul 27 20:05:40.129552 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.129537    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5350bb35-4827-4dfb-a4d1-572fa2fcabc3" containerName="istio-proxy"
Jul 27 20:05:40.129552 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.129543    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5350bb35-4827-4dfb-a4d1-572fa2fcabc3" containerName="istio-proxy"
Jul 27 20:05:40.129552 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.129552    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5350bb35-4827-4dfb-a4d1-572fa2fcabc3" containerName="istio-proxy"
Jul 27 20:05:40.129849 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.129558    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5350bb35-4827-4dfb-a4d1-572fa2fcabc3" containerName="istio-proxy"
Jul 27 20:05:40.129849 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.129622    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="56e2cfc7-8a71-477e-9857-52bd7591f60f" containerName="maas-api"
Jul 27 20:05:40.129849 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.129630    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5350bb35-4827-4dfb-a4d1-572fa2fcabc3" containerName="istio-proxy"
Jul 27 20:05:40.129849 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.129640    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe9c69a0-e53e-439d-a07f-3212beec8250" containerName="revoke-keys"
Jul 27 20:05:40.133939 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.133922    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.136267 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.136247    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-3b36df-openshift-default-dockercfg-nmrxl\""
Jul 27 20:05:40.144025 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.143996    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"]
Jul 27 20:05:40.279074 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.279027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-credential-socket\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.279243 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.279094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmrfs\" (UniqueName: \"kubernetes.io/projected/98094f24-0ebb-4b08-ac3b-fa75587cf779-kube-api-access-dmrfs\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.279243 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.279160    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-envoy\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.279243 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.279191    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-token\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.279243 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.279222    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-workload-socket\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.279243 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.279240    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-data\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.279435 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.279256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-podinfo\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.279435 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.279280    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98094f24-0ebb-4b08-ac3b-fa75587cf779-istiod-ca-cert\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.279435 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.279301    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-workload-certs\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.380300 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.380206    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-credential-socket\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.380300 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.380254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmrfs\" (UniqueName: \"kubernetes.io/projected/98094f24-0ebb-4b08-ac3b-fa75587cf779-kube-api-access-dmrfs\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.380491 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.380380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-envoy\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.380491 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.380424    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-token\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.380491 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.380456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-workload-socket\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.380491 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.380483    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-data\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.380664 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.380510    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-podinfo\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.380664 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.380548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98094f24-0ebb-4b08-ac3b-fa75587cf779-istiod-ca-cert\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.380664 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.380577    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-workload-certs\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.380664 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.380619    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-credential-socket\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.380858 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.380783    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-workload-socket\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.380917 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.380881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-data\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.380917 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.380902    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-workload-certs\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.381239 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.381218    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98094f24-0ebb-4b08-ac3b-fa75587cf779-istiod-ca-cert\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.382772 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.382749    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-envoy\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.383213 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.383189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-podinfo\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.399578 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.399547    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmrfs\" (UniqueName: \"kubernetes.io/projected/98094f24-0ebb-4b08-ac3b-fa75587cf779-kube-api-access-dmrfs\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.399928 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.399911    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-token\") pod \"e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") " pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.444141 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.444112    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:40.582938 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.582913    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"]
Jul 27 20:05:40.584855 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:05:40.584827    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98094f24_0ebb_4b08_ac3b_fa75587cf779.slice/crio-ddab878a6dea9853c44bb3f8134417ea7ea398c6693b02abb0d67365de49d484 WatchSource:0}: Error finding container ddab878a6dea9853c44bb3f8134417ea7ea398c6693b02abb0d67365de49d484: Status 404 returned error can't find the container with id ddab878a6dea9853c44bb3f8134417ea7ea398c6693b02abb0d67365de49d484
Jul 27 20:05:40.586880 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.586852    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:05:40.586943 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.586912    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:05:40.586943 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:40.586940    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:05:41.564854 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:41.564817    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw" event={"ID":"98094f24-0ebb-4b08-ac3b-fa75587cf779","Type":"ContainerStarted","Data":"4853bde8b7578805b2b324df718e8c1ad84a2ad90d1e783b2d1c46e6d790c9d2"}
Jul 27 20:05:41.565308 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:41.564870    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw" event={"ID":"98094f24-0ebb-4b08-ac3b-fa75587cf779","Type":"ContainerStarted","Data":"ddab878a6dea9853c44bb3f8134417ea7ea398c6693b02abb0d67365de49d484"}
Jul 27 20:05:41.584858 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:41.584806    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw" podStartSLOduration=1.584791185 podStartE2EDuration="1.584791185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:05:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:05:41.584423169 +0000 UTC m=+2358.712786965" watchObservedRunningTime="2026-07-27 20:05:41.584791185 +0000 UTC m=+2358.713154977"
Jul 27 20:05:42.444437 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:42.444400    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:42.449363 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:42.449337    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:42.570370 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:42.570339    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:42.571171 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:42.571152    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:05:43.560020 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:43.559986    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"]
Jul 27 20:05:43.560475 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:43.560454    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5350bb35-4827-4dfb-a4d1-572fa2fcabc3" containerName="istio-proxy"
Jul 27 20:05:43.563474 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:43.563457    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"
Jul 27 20:05:43.565985 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:43.565947    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-3b36df-serving-cert\""
Jul 27 20:05:43.566115 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:43.565949    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 20:05:43.566960 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:43.566944    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-86dhg\""
Jul 27 20:05:43.567076 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:43.566981    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 20:05:43.573841 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:43.573819    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"]
Jul 27 20:05:43.712300 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:43.712263    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbn2l\" (UniqueName: \"kubernetes.io/projected/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-kube-api-access-vbn2l\") pod \"maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58\" (UID: \"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"
Jul 27 20:05:43.712517 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:43.712410    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-openshift-service-ca\") pod \"maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58\" (UID: \"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"
Jul 27 20:05:43.712517 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:43.712463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-maas-api-tls\") pod \"maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58\" (UID: \"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"
Jul 27 20:05:43.813266 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:43.813160    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-openshift-service-ca\") pod \"maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58\" (UID: \"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"
Jul 27 20:05:43.813266 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:43.813220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-maas-api-tls\") pod \"maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58\" (UID: \"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"
Jul 27 20:05:43.813499 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:43.813285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbn2l\" (UniqueName: \"kubernetes.io/projected/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-kube-api-access-vbn2l\") pod \"maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58\" (UID: \"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"
Jul 27 20:05:43.813499 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:05:43.813369    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-serving-cert: secret "maas-api-e2e-api-a-3b36df-serving-cert" not found
Jul 27 20:05:43.813499 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:05:43.813430    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-maas-api-tls podName:4513b5c3-41d1-41ee-b413-3a8a9e5c08e7 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:44.313415103 +0000 UTC m=+2361.441778877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-maas-api-tls") pod "maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58" (UID: "4513b5c3-41d1-41ee-b413-3a8a9e5c08e7") : secret "maas-api-e2e-api-a-3b36df-serving-cert" not found
Jul 27 20:05:43.813791 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:43.813772    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-openshift-service-ca\") pod \"maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58\" (UID: \"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"
Jul 27 20:05:43.823682 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:43.823651    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbn2l\" (UniqueName: \"kubernetes.io/projected/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-kube-api-access-vbn2l\") pod \"maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58\" (UID: \"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"
Jul 27 20:05:44.317628 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:44.317584    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-maas-api-tls\") pod \"maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58\" (UID: \"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"
Jul 27 20:05:44.320183 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:44.320155    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-maas-api-tls\") pod \"maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58\" (UID: \"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"
Jul 27 20:05:44.475197 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:44.475162    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"
Jul 27 20:05:44.608685 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:44.608648    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"]
Jul 27 20:05:44.611160 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:05:44.611126    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4513b5c3_41d1_41ee_b413_3a8a9e5c08e7.slice/crio-ffe8a60cadb247315bfe9113d6866d2e572d6cdb61d72bda40fb1cb78f85ff87 WatchSource:0}: Error finding container ffe8a60cadb247315bfe9113d6866d2e572d6cdb61d72bda40fb1cb78f85ff87: Status 404 returned error can't find the container with id ffe8a60cadb247315bfe9113d6866d2e572d6cdb61d72bda40fb1cb78f85ff87
Jul 27 20:05:44.612532 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:44.612514    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:05:45.587398 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:45.587361    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58" event={"ID":"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7","Type":"ContainerStarted","Data":"ee9b0a47944c4b324733508f3704ef53b98c467be9fc9013408745a0a44906d8"}
Jul 27 20:05:45.587590 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:45.587416    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58" event={"ID":"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7","Type":"ContainerStarted","Data":"ffe8a60cadb247315bfe9113d6866d2e572d6cdb61d72bda40fb1cb78f85ff87"}
Jul 27 20:05:45.587590 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:45.587442    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"
Jul 27 20:05:45.604966 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:45.604918    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58" podStartSLOduration=2.078625019 podStartE2EDuration="2.604903214s" totalImagesPullingTime="526.278195ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:05:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:05:45.603144818 +0000 UTC m=+2362.731508614" watchObservedRunningTime="2026-07-27 20:05:45.604903214 +0000 UTC m=+2362.733267009"
Jul 27 20:05:51.597756 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:51.597724    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"
Jul 27 20:05:51.678657 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:51.678624    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:05:52.041573 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:52.041541    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"]
Jul 27 20:05:52.045210 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:52.045191    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"
Jul 27 20:05:52.047526 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:52.047506    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-d978f1-serving-cert\""
Jul 27 20:05:52.055652 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:52.055629    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"]
Jul 27 20:05:52.189404 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:52.189366    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhcsg\" (UniqueName: \"kubernetes.io/projected/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-kube-api-access-hhcsg\") pod \"maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv\" (UID: \"3fb2aedd-8a05-4f2b-a6b4-0353d974427e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"
Jul 27 20:05:52.189404 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:52.189405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-maas-api-tls\") pod \"maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv\" (UID: \"3fb2aedd-8a05-4f2b-a6b4-0353d974427e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"
Jul 27 20:05:52.189637 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:52.189454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-openshift-service-ca\") pod \"maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv\" (UID: \"3fb2aedd-8a05-4f2b-a6b4-0353d974427e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"
Jul 27 20:05:52.290846 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:52.290805    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhcsg\" (UniqueName: \"kubernetes.io/projected/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-kube-api-access-hhcsg\") pod \"maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv\" (UID: \"3fb2aedd-8a05-4f2b-a6b4-0353d974427e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"
Jul 27 20:05:52.290846 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:52.290849    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-maas-api-tls\") pod \"maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv\" (UID: \"3fb2aedd-8a05-4f2b-a6b4-0353d974427e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"
Jul 27 20:05:52.291145 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:52.290892    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-openshift-service-ca\") pod \"maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv\" (UID: \"3fb2aedd-8a05-4f2b-a6b4-0353d974427e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"
Jul 27 20:05:52.291145 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:05:52.291013    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-serving-cert: secret "maas-api-e2e-api-b-d978f1-serving-cert" not found
Jul 27 20:05:52.291145 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:05:52.291092    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-maas-api-tls podName:3fb2aedd-8a05-4f2b-a6b4-0353d974427e nodeName:}" failed. No retries permitted until 2026-07-27 20:05:52.791076209 +0000 UTC m=+2369.919439983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-maas-api-tls") pod "maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv" (UID: "3fb2aedd-8a05-4f2b-a6b4-0353d974427e") : secret "maas-api-e2e-api-b-d978f1-serving-cert" not found
Jul 27 20:05:52.291623 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:52.291567    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-openshift-service-ca\") pod \"maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv\" (UID: \"3fb2aedd-8a05-4f2b-a6b4-0353d974427e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"
Jul 27 20:05:52.301847 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:52.301824    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhcsg\" (UniqueName: \"kubernetes.io/projected/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-kube-api-access-hhcsg\") pod \"maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv\" (UID: \"3fb2aedd-8a05-4f2b-a6b4-0353d974427e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"
Jul 27 20:05:52.795507 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:52.795477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-maas-api-tls\") pod \"maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv\" (UID: \"3fb2aedd-8a05-4f2b-a6b4-0353d974427e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"
Jul 27 20:05:52.798173 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:52.798148    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-maas-api-tls\") pod \"maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv\" (UID: \"3fb2aedd-8a05-4f2b-a6b4-0353d974427e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"
Jul 27 20:05:52.956687 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:52.956654    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"
Jul 27 20:05:53.318690 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:53.318662    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"]
Jul 27 20:05:53.320799 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:05:53.320772    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb2aedd_8a05_4f2b_a6b4_0353d974427e.slice/crio-ea38fd29a618e0c3ec12f76506e46ac3c9463659b663729a787ac8b7b3f2f039 WatchSource:0}: Error finding container ea38fd29a618e0c3ec12f76506e46ac3c9463659b663729a787ac8b7b3f2f039: Status 404 returned error can't find the container with id ea38fd29a618e0c3ec12f76506e46ac3c9463659b663729a787ac8b7b3f2f039
Jul 27 20:05:53.629355 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:53.629271    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv" event={"ID":"3fb2aedd-8a05-4f2b-a6b4-0353d974427e","Type":"ContainerStarted","Data":"ea38fd29a618e0c3ec12f76506e46ac3c9463659b663729a787ac8b7b3f2f039"}
Jul 27 20:05:54.634927 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:54.634891    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv" event={"ID":"3fb2aedd-8a05-4f2b-a6b4-0353d974427e","Type":"ContainerStarted","Data":"13c2ab2c116f8c71ca45d2bccf3c32c285209214634d8d1cbc03642e4ba0f328"}
Jul 27 20:05:54.635314 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:54.635011    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"
Jul 27 20:05:54.653386 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:54.653339    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv" podStartSLOduration=2.292377112 podStartE2EDuration="2.653323007s" totalImagesPullingTime="360.945895ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:05:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:05:54.653018521 +0000 UTC m=+2371.781382318" watchObservedRunningTime="2026-07-27 20:05:54.653323007 +0000 UTC m=+2371.781686803"
Jul 27 20:05:58.612267 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:58.612219    2578 patch_prober.go:28] interesting pod/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 20:05:58.612808 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:05:58.612306    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw" podUID="98094f24-0ebb-4b08-ac3b-fa75587cf779" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 20:06:00.645526 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:00.645492    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"
Jul 27 20:06:00.665142 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:00.665110    2578 generic.go:356] "Generic (PLEG): container finished" podID="98094f24-0ebb-4b08-ac3b-fa75587cf779" containerID="4853bde8b7578805b2b324df718e8c1ad84a2ad90d1e783b2d1c46e6d790c9d2" exitCode=0
Jul 27 20:06:00.665280 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:00.665178    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw" event={"ID":"98094f24-0ebb-4b08-ac3b-fa75587cf779","Type":"ContainerDied","Data":"4853bde8b7578805b2b324df718e8c1ad84a2ad90d1e783b2d1c46e6d790c9d2"}
Jul 27 20:06:00.665512 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:00.665499    2578 scope.go:117] "RemoveContainer" containerID="4853bde8b7578805b2b324df718e8c1ad84a2ad90d1e783b2d1c46e6d790c9d2"
Jul 27 20:06:00.666432 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:00.666407    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:06:00.666522 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:00.666502    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:06:00.666586 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:00.666561    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:06:01.674909 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:01.673923    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw" event={"ID":"98094f24-0ebb-4b08-ac3b-fa75587cf779","Type":"ContainerStarted","Data":"2013b0f1992b6c9638d4c3360ccc9bb46eaa726806b34608b1689fbd8ad7f809"}
Jul 27 20:06:02.444702 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:02.444667    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:06:02.444938 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:02.444920    2578 patch_prober.go:28] interesting pod/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 27 20:06:02.444989 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:02.444967    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw" podUID="98094f24-0ebb-4b08-ac3b-fa75587cf779" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 27 20:06:03.444786 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:03.444752    2578 patch_prober.go:28] interesting pod/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 27 20:06:03.445196 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:03.444802    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw" podUID="98094f24-0ebb-4b08-ac3b-fa75587cf779" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 27 20:06:04.356085 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:04.356034    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b36df-26lzf"]
Jul 27 20:06:04.358908 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:04.358893    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b36df-26lzf"
Jul 27 20:06:04.361269 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:04.361250    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-875sf\""
Jul 27 20:06:04.367084 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:04.367039    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b36df-26lzf"]
Jul 27 20:06:04.398548 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:04.398495    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb1825a0-bfc0-4c28-81fd-8700fdd04089-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3b36df-26lzf\" (UID: \"eb1825a0-bfc0-4c28-81fd-8700fdd04089\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b36df-26lzf"
Jul 27 20:06:04.445017 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:04.444980    2578 patch_prober.go:28] interesting pod/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 27 20:06:04.445406 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:04.445033    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw" podUID="98094f24-0ebb-4b08-ac3b-fa75587cf779" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 27 20:06:04.500117 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:04.500077    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb1825a0-bfc0-4c28-81fd-8700fdd04089-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3b36df-26lzf\" (UID: \"eb1825a0-bfc0-4c28-81fd-8700fdd04089\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b36df-26lzf"
Jul 27 20:06:04.500667 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:04.500646    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb1825a0-bfc0-4c28-81fd-8700fdd04089-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3b36df-26lzf\" (UID: \"eb1825a0-bfc0-4c28-81fd-8700fdd04089\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b36df-26lzf"
Jul 27 20:06:04.670307 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:04.670207    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b36df-26lzf"
Jul 27 20:06:04.840848 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:04.840818    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b36df-26lzf"]
Jul 27 20:06:04.843088 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:06:04.843031    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1825a0_bfc0_4c28_81fd_8700fdd04089.slice/crio-be256e56483e112a0f2bb08f02acb738dd73985907b3d6b73bd56918dae9a267 WatchSource:0}: Error finding container be256e56483e112a0f2bb08f02acb738dd73985907b3d6b73bd56918dae9a267: Status 404 returned error can't find the container with id be256e56483e112a0f2bb08f02acb738dd73985907b3d6b73bd56918dae9a267
Jul 27 20:06:05.444938 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:05.444852    2578 patch_prober.go:28] interesting pod/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 27 20:06:05.444938 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:05.444912    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw" podUID="98094f24-0ebb-4b08-ac3b-fa75587cf779" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 27 20:06:05.707553 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:05.707486    2578 generic.go:356] "Generic (PLEG): container finished" podID="eb1825a0-bfc0-4c28-81fd-8700fdd04089" containerID="282fbe9764c3dca52d375ac48bd83a43b5cf7b1601ea0087ee231745450f0338" exitCode=0
Jul 27 20:06:05.707553 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:05.707542    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b36df-26lzf" event={"ID":"eb1825a0-bfc0-4c28-81fd-8700fdd04089","Type":"ContainerDied","Data":"282fbe9764c3dca52d375ac48bd83a43b5cf7b1601ea0087ee231745450f0338"}
Jul 27 20:06:05.707698 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:05.707583    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b36df-26lzf" event={"ID":"eb1825a0-bfc0-4c28-81fd-8700fdd04089","Type":"ContainerStarted","Data":"be256e56483e112a0f2bb08f02acb738dd73985907b3d6b73bd56918dae9a267"}
Jul 27 20:06:06.448554 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:06.448518    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:06:06.448954 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:06.448778    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:06:06.449475 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:06.449457    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:06:06.848208 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:06.848181    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b36df-26lzf"
Jul 27 20:06:06.920406 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:06.920368    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb1825a0-bfc0-4c28-81fd-8700fdd04089-maas-api-service-ca\") pod \"eb1825a0-bfc0-4c28-81fd-8700fdd04089\" (UID: \"eb1825a0-bfc0-4c28-81fd-8700fdd04089\") "
Jul 27 20:06:06.920722 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:06.920698    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb1825a0-bfc0-4c28-81fd-8700fdd04089-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eb1825a0-bfc0-4c28-81fd-8700fdd04089" (UID: "eb1825a0-bfc0-4c28-81fd-8700fdd04089"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:06:07.021010 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:07.020932    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb1825a0-bfc0-4c28-81fd-8700fdd04089-maas-api-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:06:07.479193 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:07.479157    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:06:07.719390 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:07.719303    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b36df-26lzf"
Jul 27 20:06:07.719390 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:07.719334    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b36df-26lzf" event={"ID":"eb1825a0-bfc0-4c28-81fd-8700fdd04089","Type":"ContainerDied","Data":"be256e56483e112a0f2bb08f02acb738dd73985907b3d6b73bd56918dae9a267"}
Jul 27 20:06:07.719390 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:07.719381    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be256e56483e112a0f2bb08f02acb738dd73985907b3d6b73bd56918dae9a267"
Jul 27 20:06:19.986028 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:19.985990    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"]
Jul 27 20:06:19.986570 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:19.986261    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58" podUID="4513b5c3-41d1-41ee-b413-3a8a9e5c08e7" containerName="maas-api" containerID="cri-o://ee9b0a47944c4b324733508f3704ef53b98c467be9fc9013408745a0a44906d8" gracePeriod=30
Jul 27 20:06:20.165447 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.165412    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b36df-26lzf"]
Jul 27 20:06:20.169039 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.169008    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b36df-26lzf"]
Jul 27 20:06:20.242608 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.242543    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"
Jul 27 20:06:20.340157 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.340119    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-maas-api-tls\") pod \"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7\" (UID: \"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7\") "
Jul 27 20:06:20.340157 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.340160    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbn2l\" (UniqueName: \"kubernetes.io/projected/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-kube-api-access-vbn2l\") pod \"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7\" (UID: \"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7\") "
Jul 27 20:06:20.340423 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.340302    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-openshift-service-ca\") pod \"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7\" (UID: \"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7\") "
Jul 27 20:06:20.340676 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.340655    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4513b5c3-41d1-41ee-b413-3a8a9e5c08e7" (UID: "4513b5c3-41d1-41ee-b413-3a8a9e5c08e7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:06:20.342454 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.342428    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4513b5c3-41d1-41ee-b413-3a8a9e5c08e7" (UID: "4513b5c3-41d1-41ee-b413-3a8a9e5c08e7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:06:20.342621 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.342480    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-kube-api-access-vbn2l" (OuterVolumeSpecName: "kube-api-access-vbn2l") pod "4513b5c3-41d1-41ee-b413-3a8a9e5c08e7" (UID: "4513b5c3-41d1-41ee-b413-3a8a9e5c08e7"). InnerVolumeSpecName "kube-api-access-vbn2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:06:20.441297 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.441264    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-maas-api-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:06:20.441297 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.441292    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbn2l\" (UniqueName: \"kubernetes.io/projected/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-kube-api-access-vbn2l\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:06:20.441297 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.441302    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7-openshift-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:06:20.783299 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.783263    2578 generic.go:356] "Generic (PLEG): container finished" podID="4513b5c3-41d1-41ee-b413-3a8a9e5c08e7" containerID="ee9b0a47944c4b324733508f3704ef53b98c467be9fc9013408745a0a44906d8" exitCode=0
Jul 27 20:06:20.783477 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.783309    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"
Jul 27 20:06:20.783477 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.783353    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58" event={"ID":"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7","Type":"ContainerDied","Data":"ee9b0a47944c4b324733508f3704ef53b98c467be9fc9013408745a0a44906d8"}
Jul 27 20:06:20.783477 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.783404    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58" event={"ID":"4513b5c3-41d1-41ee-b413-3a8a9e5c08e7","Type":"ContainerDied","Data":"ffe8a60cadb247315bfe9113d6866d2e572d6cdb61d72bda40fb1cb78f85ff87"}
Jul 27 20:06:20.783477 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.783426    2578 scope.go:117] "RemoveContainer" containerID="ee9b0a47944c4b324733508f3704ef53b98c467be9fc9013408745a0a44906d8"
Jul 27 20:06:20.795372 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.795354    2578 scope.go:117] "RemoveContainer" containerID="ee9b0a47944c4b324733508f3704ef53b98c467be9fc9013408745a0a44906d8"
Jul 27 20:06:20.795645 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:06:20.795627    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee9b0a47944c4b324733508f3704ef53b98c467be9fc9013408745a0a44906d8\": container with ID starting with ee9b0a47944c4b324733508f3704ef53b98c467be9fc9013408745a0a44906d8 not found: ID does not exist" containerID="ee9b0a47944c4b324733508f3704ef53b98c467be9fc9013408745a0a44906d8"
Jul 27 20:06:20.795708 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.795653    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee9b0a47944c4b324733508f3704ef53b98c467be9fc9013408745a0a44906d8"} err="failed to get container status \"ee9b0a47944c4b324733508f3704ef53b98c467be9fc9013408745a0a44906d8\": rpc error: code = NotFound desc = could not find container \"ee9b0a47944c4b324733508f3704ef53b98c467be9fc9013408745a0a44906d8\": container with ID starting with ee9b0a47944c4b324733508f3704ef53b98c467be9fc9013408745a0a44906d8 not found: ID does not exist"
Jul 27 20:06:20.804469 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.804446    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"]
Jul 27 20:06:20.807753 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:20.807730    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b36df-848bcb74b9-x6t58"]
Jul 27 20:06:21.383999 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:21.383968    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4513b5c3-41d1-41ee-b413-3a8a9e5c08e7" path="/var/lib/kubelet/pods/4513b5c3-41d1-41ee-b413-3a8a9e5c08e7/volumes"
Jul 27 20:06:21.384400 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:21.384323    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb1825a0-bfc0-4c28-81fd-8700fdd04089" path="/var/lib/kubelet/pods/eb1825a0-bfc0-4c28-81fd-8700fdd04089/volumes"
Jul 27 20:06:22.984631 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:22.984593    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:06:23.560976 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:23.560937    2578 scope.go:117] "RemoveContainer" containerID="6a6c72e63c08c5c4d05ed5dd17c1f76c7ccb7e458159bd0c77c7078d95e99890"
Jul 27 20:06:26.783693 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:26.783658    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"]
Jul 27 20:06:26.784187 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:26.783877    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw" podUID="98094f24-0ebb-4b08-ac3b-fa75587cf779" containerName="istio-proxy" containerID="cri-o://2013b0f1992b6c9638d4c3360ccc9bb46eaa726806b34608b1689fbd8ad7f809" gracePeriod=30
Jul 27 20:06:27.151397 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.151311    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d978f1-gzks4"]
Jul 27 20:06:27.151652 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.151640    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4513b5c3-41d1-41ee-b413-3a8a9e5c08e7" containerName="maas-api"
Jul 27 20:06:27.151700 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.151654    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4513b5c3-41d1-41ee-b413-3a8a9e5c08e7" containerName="maas-api"
Jul 27 20:06:27.151700 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.151667    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb1825a0-bfc0-4c28-81fd-8700fdd04089" containerName="revoke-keys"
Jul 27 20:06:27.151700 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.151672    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb1825a0-bfc0-4c28-81fd-8700fdd04089" containerName="revoke-keys"
Jul 27 20:06:27.151797 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.151735    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb1825a0-bfc0-4c28-81fd-8700fdd04089" containerName="revoke-keys"
Jul 27 20:06:27.151797 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.151746    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4513b5c3-41d1-41ee-b413-3a8a9e5c08e7" containerName="maas-api"
Jul 27 20:06:27.156276 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.156260    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d978f1-gzks4"
Jul 27 20:06:27.158668 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.158642    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-875sf\""
Jul 27 20:06:27.162485 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.162461    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d978f1-gzks4"]
Jul 27 20:06:27.302838 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.302800    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a148d3-490f-4e74-b6a7-5ba1300feba3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d978f1-gzks4\" (UID: \"07a148d3-490f-4e74-b6a7-5ba1300feba3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d978f1-gzks4"
Jul 27 20:06:27.403499 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.403412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a148d3-490f-4e74-b6a7-5ba1300feba3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d978f1-gzks4\" (UID: \"07a148d3-490f-4e74-b6a7-5ba1300feba3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d978f1-gzks4"
Jul 27 20:06:27.403952 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.403934    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a148d3-490f-4e74-b6a7-5ba1300feba3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d978f1-gzks4\" (UID: \"07a148d3-490f-4e74-b6a7-5ba1300feba3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d978f1-gzks4"
Jul 27 20:06:27.468960 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.468929    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d978f1-gzks4"
Jul 27 20:06:27.598272 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.598246    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d978f1-gzks4"]
Jul 27 20:06:27.600693 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:06:27.600662    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a148d3_490f_4e74_b6a7_5ba1300feba3.slice/crio-69acead2b6de92a6a2f67be07e7b1ff99cb837cb672939fbd8f6ad5d0f9f0785 WatchSource:0}: Error finding container 69acead2b6de92a6a2f67be07e7b1ff99cb837cb672939fbd8f6ad5d0f9f0785: Status 404 returned error can't find the container with id 69acead2b6de92a6a2f67be07e7b1ff99cb837cb672939fbd8f6ad5d0f9f0785
Jul 27 20:06:27.819321 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.819287    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d978f1-gzks4" event={"ID":"07a148d3-490f-4e74-b6a7-5ba1300feba3","Type":"ContainerStarted","Data":"e7036fee795e6fb8a5ab0891078acce80da127fc3266eaad6947505c102f2c21"}
Jul 27 20:06:27.819656 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.819346    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d978f1-gzks4" event={"ID":"07a148d3-490f-4e74-b6a7-5ba1300feba3","Type":"ContainerStarted","Data":"69acead2b6de92a6a2f67be07e7b1ff99cb837cb672939fbd8f6ad5d0f9f0785"}
Jul 27 20:06:27.834374 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:27.834328    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d978f1-gzks4" podStartSLOduration=0.834312791 podStartE2EDuration="834.312791ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:06:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:27.832827734 +0000 UTC m=+2404.961191527" watchObservedRunningTime="2026-07-27 20:06:27.834312791 +0000 UTC m=+2404.962676625"
Jul 27 20:06:28.825977 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:28.825941    2578 generic.go:356] "Generic (PLEG): container finished" podID="07a148d3-490f-4e74-b6a7-5ba1300feba3" containerID="e7036fee795e6fb8a5ab0891078acce80da127fc3266eaad6947505c102f2c21" exitCode=0
Jul 27 20:06:28.826415 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:28.825988    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d978f1-gzks4" event={"ID":"07a148d3-490f-4e74-b6a7-5ba1300feba3","Type":"ContainerDied","Data":"e7036fee795e6fb8a5ab0891078acce80da127fc3266eaad6947505c102f2c21"}
Jul 27 20:06:29.959677 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:29.959649    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d978f1-gzks4"
Jul 27 20:06:30.028743 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:30.028708    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a148d3-490f-4e74-b6a7-5ba1300feba3-maas-api-service-ca\") pod \"07a148d3-490f-4e74-b6a7-5ba1300feba3\" (UID: \"07a148d3-490f-4e74-b6a7-5ba1300feba3\") "
Jul 27 20:06:30.029085 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:30.029038    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07a148d3-490f-4e74-b6a7-5ba1300feba3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "07a148d3-490f-4e74-b6a7-5ba1300feba3" (UID: "07a148d3-490f-4e74-b6a7-5ba1300feba3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:06:30.130339 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:30.130253    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a148d3-490f-4e74-b6a7-5ba1300feba3-maas-api-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:06:30.836351 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:30.836320    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d978f1-gzks4"
Jul 27 20:06:30.836351 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:30.836339    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d978f1-gzks4" event={"ID":"07a148d3-490f-4e74-b6a7-5ba1300feba3","Type":"ContainerDied","Data":"69acead2b6de92a6a2f67be07e7b1ff99cb837cb672939fbd8f6ad5d0f9f0785"}
Jul 27 20:06:30.836558 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:30.836385    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69acead2b6de92a6a2f67be07e7b1ff99cb837cb672939fbd8f6ad5d0f9f0785"
Jul 27 20:06:32.031624 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.031597    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:06:32.149286 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.149191    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-data\") pod \"98094f24-0ebb-4b08-ac3b-fa75587cf779\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") "
Jul 27 20:06:32.149286 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.149231    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-workload-certs\") pod \"98094f24-0ebb-4b08-ac3b-fa75587cf779\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") "
Jul 27 20:06:32.149286 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.149260    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmrfs\" (UniqueName: \"kubernetes.io/projected/98094f24-0ebb-4b08-ac3b-fa75587cf779-kube-api-access-dmrfs\") pod \"98094f24-0ebb-4b08-ac3b-fa75587cf779\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") "
Jul 27 20:06:32.149582 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.149300    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-envoy\") pod \"98094f24-0ebb-4b08-ac3b-fa75587cf779\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") "
Jul 27 20:06:32.149582 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.149325    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98094f24-0ebb-4b08-ac3b-fa75587cf779-istiod-ca-cert\") pod \"98094f24-0ebb-4b08-ac3b-fa75587cf779\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") "
Jul 27 20:06:32.149582 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.149363    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-credential-socket\") pod \"98094f24-0ebb-4b08-ac3b-fa75587cf779\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") "
Jul 27 20:06:32.149582 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.149428    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-workload-socket\") pod \"98094f24-0ebb-4b08-ac3b-fa75587cf779\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") "
Jul 27 20:06:32.149582 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.149450    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-podinfo\") pod \"98094f24-0ebb-4b08-ac3b-fa75587cf779\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") "
Jul 27 20:06:32.149582 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.149505    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-token\") pod \"98094f24-0ebb-4b08-ac3b-fa75587cf779\" (UID: \"98094f24-0ebb-4b08-ac3b-fa75587cf779\") "
Jul 27 20:06:32.149894 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.149673    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "98094f24-0ebb-4b08-ac3b-fa75587cf779" (UID: "98094f24-0ebb-4b08-ac3b-fa75587cf779"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:32.149894 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.149688    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "98094f24-0ebb-4b08-ac3b-fa75587cf779" (UID: "98094f24-0ebb-4b08-ac3b-fa75587cf779"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:32.149894 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.149754    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98094f24-0ebb-4b08-ac3b-fa75587cf779-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "98094f24-0ebb-4b08-ac3b-fa75587cf779" (UID: "98094f24-0ebb-4b08-ac3b-fa75587cf779"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:06:32.149894 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.149825    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-credential-socket\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:06:32.149894 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.149844    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-workload-socket\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:06:32.150200 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.150156    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-data" (OuterVolumeSpecName: "istio-data") pod "98094f24-0ebb-4b08-ac3b-fa75587cf779" (UID: "98094f24-0ebb-4b08-ac3b-fa75587cf779"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:32.150364 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.150233    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "98094f24-0ebb-4b08-ac3b-fa75587cf779" (UID: "98094f24-0ebb-4b08-ac3b-fa75587cf779"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:32.151804 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.151776    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-token" (OuterVolumeSpecName: "istio-token") pod "98094f24-0ebb-4b08-ac3b-fa75587cf779" (UID: "98094f24-0ebb-4b08-ac3b-fa75587cf779"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:06:32.151804 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.151792    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98094f24-0ebb-4b08-ac3b-fa75587cf779-kube-api-access-dmrfs" (OuterVolumeSpecName: "kube-api-access-dmrfs") pod "98094f24-0ebb-4b08-ac3b-fa75587cf779" (UID: "98094f24-0ebb-4b08-ac3b-fa75587cf779"). InnerVolumeSpecName "kube-api-access-dmrfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:06:32.151961 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.151825    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "98094f24-0ebb-4b08-ac3b-fa75587cf779" (UID: "98094f24-0ebb-4b08-ac3b-fa75587cf779"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:32.152071 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.152037    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "98094f24-0ebb-4b08-ac3b-fa75587cf779" (UID: "98094f24-0ebb-4b08-ac3b-fa75587cf779"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:06:32.250321 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.250287    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-podinfo\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:06:32.250321 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.250313    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-token\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:06:32.250321 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.250324    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-data\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:06:32.250547 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.250335    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-workload-certs\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:06:32.250547 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.250347    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmrfs\" (UniqueName: \"kubernetes.io/projected/98094f24-0ebb-4b08-ac3b-fa75587cf779-kube-api-access-dmrfs\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:06:32.250547 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.250359    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98094f24-0ebb-4b08-ac3b-fa75587cf779-istio-envoy\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:06:32.250547 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.250369    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98094f24-0ebb-4b08-ac3b-fa75587cf779-istiod-ca-cert\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:06:32.847773 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.847738    2578 generic.go:356] "Generic (PLEG): container finished" podID="98094f24-0ebb-4b08-ac3b-fa75587cf779" containerID="2013b0f1992b6c9638d4c3360ccc9bb46eaa726806b34608b1689fbd8ad7f809" exitCode=0
Jul 27 20:06:32.847956 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.847787    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"
Jul 27 20:06:32.847956 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.847828    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw" event={"ID":"98094f24-0ebb-4b08-ac3b-fa75587cf779","Type":"ContainerDied","Data":"2013b0f1992b6c9638d4c3360ccc9bb46eaa726806b34608b1689fbd8ad7f809"}
Jul 27 20:06:32.847956 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.847891    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw" event={"ID":"98094f24-0ebb-4b08-ac3b-fa75587cf779","Type":"ContainerDied","Data":"ddab878a6dea9853c44bb3f8134417ea7ea398c6693b02abb0d67365de49d484"}
Jul 27 20:06:32.847956 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.847916    2578 scope.go:117] "RemoveContainer" containerID="2013b0f1992b6c9638d4c3360ccc9bb46eaa726806b34608b1689fbd8ad7f809"
Jul 27 20:06:32.857369 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.857351    2578 scope.go:117] "RemoveContainer" containerID="4853bde8b7578805b2b324df718e8c1ad84a2ad90d1e783b2d1c46e6d790c9d2"
Jul 27 20:06:32.865005 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.864987    2578 scope.go:117] "RemoveContainer" containerID="2013b0f1992b6c9638d4c3360ccc9bb46eaa726806b34608b1689fbd8ad7f809"
Jul 27 20:06:32.865284 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:06:32.865267    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2013b0f1992b6c9638d4c3360ccc9bb46eaa726806b34608b1689fbd8ad7f809\": container with ID starting with 2013b0f1992b6c9638d4c3360ccc9bb46eaa726806b34608b1689fbd8ad7f809 not found: ID does not exist" containerID="2013b0f1992b6c9638d4c3360ccc9bb46eaa726806b34608b1689fbd8ad7f809"
Jul 27 20:06:32.865330 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.865292    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2013b0f1992b6c9638d4c3360ccc9bb46eaa726806b34608b1689fbd8ad7f809"} err="failed to get container status \"2013b0f1992b6c9638d4c3360ccc9bb46eaa726806b34608b1689fbd8ad7f809\": rpc error: code = NotFound desc = could not find container \"2013b0f1992b6c9638d4c3360ccc9bb46eaa726806b34608b1689fbd8ad7f809\": container with ID starting with 2013b0f1992b6c9638d4c3360ccc9bb46eaa726806b34608b1689fbd8ad7f809 not found: ID does not exist"
Jul 27 20:06:32.865330 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.865309    2578 scope.go:117] "RemoveContainer" containerID="4853bde8b7578805b2b324df718e8c1ad84a2ad90d1e783b2d1c46e6d790c9d2"
Jul 27 20:06:32.865525 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:06:32.865511    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4853bde8b7578805b2b324df718e8c1ad84a2ad90d1e783b2d1c46e6d790c9d2\": container with ID starting with 4853bde8b7578805b2b324df718e8c1ad84a2ad90d1e783b2d1c46e6d790c9d2 not found: ID does not exist" containerID="4853bde8b7578805b2b324df718e8c1ad84a2ad90d1e783b2d1c46e6d790c9d2"
Jul 27 20:06:32.865561 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.865530    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4853bde8b7578805b2b324df718e8c1ad84a2ad90d1e783b2d1c46e6d790c9d2"} err="failed to get container status \"4853bde8b7578805b2b324df718e8c1ad84a2ad90d1e783b2d1c46e6d790c9d2\": rpc error: code = NotFound desc = could not find container \"4853bde8b7578805b2b324df718e8c1ad84a2ad90d1e783b2d1c46e6d790c9d2\": container with ID starting with 4853bde8b7578805b2b324df718e8c1ad84a2ad90d1e783b2d1c46e6d790c9d2 not found: ID does not exist"
Jul 27 20:06:32.869171 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.869150    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"]
Jul 27 20:06:32.873118 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:32.873097    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-3b36df-openshift-default-5b5fdcdb5b-47xxw"]
Jul 27 20:06:33.388570 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:33.388538    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98094f24-0ebb-4b08-ac3b-fa75587cf779" path="/var/lib/kubelet/pods/98094f24-0ebb-4b08-ac3b-fa75587cf779/volumes"
Jul 27 20:06:42.557480 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.557443    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"]
Jul 27 20:06:42.557997 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.557750    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv" podUID="3fb2aedd-8a05-4f2b-a6b4-0353d974427e" containerName="maas-api" containerID="cri-o://13c2ab2c116f8c71ca45d2bccf3c32c285209214634d8d1cbc03642e4ba0f328" gracePeriod=30
Jul 27 20:06:42.733195 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.733159    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d978f1-gzks4"]
Jul 27 20:06:42.734812 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.734786    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d978f1-gzks4"]
Jul 27 20:06:42.806971 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.806946    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"
Jul 27 20:06:42.895935 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.895842    2578 generic.go:356] "Generic (PLEG): container finished" podID="3fb2aedd-8a05-4f2b-a6b4-0353d974427e" containerID="13c2ab2c116f8c71ca45d2bccf3c32c285209214634d8d1cbc03642e4ba0f328" exitCode=0
Jul 27 20:06:42.895935 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.895903    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"
Jul 27 20:06:42.896154 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.895931    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv" event={"ID":"3fb2aedd-8a05-4f2b-a6b4-0353d974427e","Type":"ContainerDied","Data":"13c2ab2c116f8c71ca45d2bccf3c32c285209214634d8d1cbc03642e4ba0f328"}
Jul 27 20:06:42.896154 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.895988    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv" event={"ID":"3fb2aedd-8a05-4f2b-a6b4-0353d974427e","Type":"ContainerDied","Data":"ea38fd29a618e0c3ec12f76506e46ac3c9463659b663729a787ac8b7b3f2f039"}
Jul 27 20:06:42.896154 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.896011    2578 scope.go:117] "RemoveContainer" containerID="13c2ab2c116f8c71ca45d2bccf3c32c285209214634d8d1cbc03642e4ba0f328"
Jul 27 20:06:42.906297 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.906276    2578 scope.go:117] "RemoveContainer" containerID="13c2ab2c116f8c71ca45d2bccf3c32c285209214634d8d1cbc03642e4ba0f328"
Jul 27 20:06:42.906599 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:06:42.906581    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13c2ab2c116f8c71ca45d2bccf3c32c285209214634d8d1cbc03642e4ba0f328\": container with ID starting with 13c2ab2c116f8c71ca45d2bccf3c32c285209214634d8d1cbc03642e4ba0f328 not found: ID does not exist" containerID="13c2ab2c116f8c71ca45d2bccf3c32c285209214634d8d1cbc03642e4ba0f328"
Jul 27 20:06:42.906651 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.906608    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13c2ab2c116f8c71ca45d2bccf3c32c285209214634d8d1cbc03642e4ba0f328"} err="failed to get container status \"13c2ab2c116f8c71ca45d2bccf3c32c285209214634d8d1cbc03642e4ba0f328\": rpc error: code = NotFound desc = could not find container \"13c2ab2c116f8c71ca45d2bccf3c32c285209214634d8d1cbc03642e4ba0f328\": container with ID starting with 13c2ab2c116f8c71ca45d2bccf3c32c285209214634d8d1cbc03642e4ba0f328 not found: ID does not exist"
Jul 27 20:06:42.950653 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.950604    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-maas-api-tls\") pod \"3fb2aedd-8a05-4f2b-a6b4-0353d974427e\" (UID: \"3fb2aedd-8a05-4f2b-a6b4-0353d974427e\") "
Jul 27 20:06:42.950812 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.950688    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-openshift-service-ca\") pod \"3fb2aedd-8a05-4f2b-a6b4-0353d974427e\" (UID: \"3fb2aedd-8a05-4f2b-a6b4-0353d974427e\") "
Jul 27 20:06:42.950812 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.950728    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhcsg\" (UniqueName: \"kubernetes.io/projected/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-kube-api-access-hhcsg\") pod \"3fb2aedd-8a05-4f2b-a6b4-0353d974427e\" (UID: \"3fb2aedd-8a05-4f2b-a6b4-0353d974427e\") "
Jul 27 20:06:42.951094 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.951045    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3fb2aedd-8a05-4f2b-a6b4-0353d974427e" (UID: "3fb2aedd-8a05-4f2b-a6b4-0353d974427e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:06:42.952909 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.952880    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-kube-api-access-hhcsg" (OuterVolumeSpecName: "kube-api-access-hhcsg") pod "3fb2aedd-8a05-4f2b-a6b4-0353d974427e" (UID: "3fb2aedd-8a05-4f2b-a6b4-0353d974427e"). InnerVolumeSpecName "kube-api-access-hhcsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:06:42.952909 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:42.952894    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3fb2aedd-8a05-4f2b-a6b4-0353d974427e" (UID: "3fb2aedd-8a05-4f2b-a6b4-0353d974427e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:06:43.051835 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:43.051789    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhcsg\" (UniqueName: \"kubernetes.io/projected/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-kube-api-access-hhcsg\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:06:43.051835 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:43.051827    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-maas-api-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:06:43.051835 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:43.051841    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fb2aedd-8a05-4f2b-a6b4-0353d974427e-openshift-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:06:43.217267 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:43.217232    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"]
Jul 27 20:06:43.220807 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:43.220777    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d978f1-5c9bd69d9-t8qxv"]
Jul 27 20:06:43.383122 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:43.383090    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07a148d3-490f-4e74-b6a7-5ba1300feba3" path="/var/lib/kubelet/pods/07a148d3-490f-4e74-b6a7-5ba1300feba3/volumes"
Jul 27 20:06:43.383498 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:43.383485    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fb2aedd-8a05-4f2b-a6b4-0353d974427e" path="/var/lib/kubelet/pods/3fb2aedd-8a05-4f2b-a6b4-0353d974427e/volumes"
Jul 27 20:06:47.669704 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:47.669667    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:06:50.428985 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.428952    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"]
Jul 27 20:06:50.429484 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.429446    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fb2aedd-8a05-4f2b-a6b4-0353d974427e" containerName="maas-api"
Jul 27 20:06:50.429484 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.429465    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fb2aedd-8a05-4f2b-a6b4-0353d974427e" containerName="maas-api"
Jul 27 20:06:50.429600 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.429496    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98094f24-0ebb-4b08-ac3b-fa75587cf779" containerName="istio-proxy"
Jul 27 20:06:50.429600 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.429507    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="98094f24-0ebb-4b08-ac3b-fa75587cf779" containerName="istio-proxy"
Jul 27 20:06:50.429600 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.429527    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07a148d3-490f-4e74-b6a7-5ba1300feba3" containerName="revoke-keys"
Jul 27 20:06:50.429600 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.429538    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="07a148d3-490f-4e74-b6a7-5ba1300feba3" containerName="revoke-keys"
Jul 27 20:06:50.429803 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.429631    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="98094f24-0ebb-4b08-ac3b-fa75587cf779" containerName="istio-proxy"
Jul 27 20:06:50.429803 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.429647    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fb2aedd-8a05-4f2b-a6b4-0353d974427e" containerName="maas-api"
Jul 27 20:06:50.429803 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.429658    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="07a148d3-490f-4e74-b6a7-5ba1300feba3" containerName="revoke-keys"
Jul 27 20:06:50.434152 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.434128    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.436750 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.436730    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-d3c546-openshift-default-dockercfg-fcs8s\""
Jul 27 20:06:50.444536 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.444510    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"]
Jul 27 20:06:50.508355 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.508314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-workload-socket\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.508552 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.508362    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-workload-certs\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.508552 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.508381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-envoy\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.508552 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.508411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-data\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.508552 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.508428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-token\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.508552 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.508448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-podinfo\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.508552 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.508529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-credential-socket\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.508796 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.508564    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8b51fb7-2475-4a76-a8de-9555545f17ce-istiod-ca-cert\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.508796 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.508619    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lksw\" (UniqueName: \"kubernetes.io/projected/a8b51fb7-2475-4a76-a8de-9555545f17ce-kube-api-access-4lksw\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.609431 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.609396    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-workload-certs\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.609431 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.609430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-envoy\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.609699 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.609452    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-data\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.609699 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.609475    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-token\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.609699 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.609502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-podinfo\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.609699 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.609538    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-credential-socket\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.609699 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.609563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8b51fb7-2475-4a76-a8de-9555545f17ce-istiod-ca-cert\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.609699 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.609642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lksw\" (UniqueName: \"kubernetes.io/projected/a8b51fb7-2475-4a76-a8de-9555545f17ce-kube-api-access-4lksw\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.610002 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.609723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-workload-socket\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.610002 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.609966    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-workload-certs\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.610157 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.610015    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-data\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.610157 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.610081    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-credential-socket\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.610281 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.610260    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-workload-socket\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.610460 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.610437    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8b51fb7-2475-4a76-a8de-9555545f17ce-istiod-ca-cert\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.612494 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.612468    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-envoy\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.612685 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.612668    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-podinfo\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.617450 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.617422    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-token\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.617725 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.617703    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lksw\" (UniqueName: \"kubernetes.io/projected/a8b51fb7-2475-4a76-a8de-9555545f17ce-kube-api-access-4lksw\") pod \"e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") " pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.745093 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.744971    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:50.882200 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.882174    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"]
Jul 27 20:06:50.884400 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:06:50.884368    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b51fb7_2475_4a76_a8de_9555545f17ce.slice/crio-1539e8bc7d49411b560daa5ce6783dc91de5fb7bfabf978afe99d4a152203fae WatchSource:0}: Error finding container 1539e8bc7d49411b560daa5ce6783dc91de5fb7bfabf978afe99d4a152203fae: Status 404 returned error can't find the container with id 1539e8bc7d49411b560daa5ce6783dc91de5fb7bfabf978afe99d4a152203fae
Jul 27 20:06:50.886476 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.886446    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:06:50.886553 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.886513    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:06:50.886553 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.886542    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:06:50.937976 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:50.937939    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5" event={"ID":"a8b51fb7-2475-4a76-a8de-9555545f17ce","Type":"ContainerStarted","Data":"1539e8bc7d49411b560daa5ce6783dc91de5fb7bfabf978afe99d4a152203fae"}
Jul 27 20:06:51.944482 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:51.944446    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5" event={"ID":"a8b51fb7-2475-4a76-a8de-9555545f17ce","Type":"ContainerStarted","Data":"66775bb4707cad7285a557137709664edcaa51ba768371d604b3a15ea828a4ba"}
Jul 27 20:06:51.963806 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:51.963742    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5" podStartSLOduration=1.9637227 podStartE2EDuration="1.9637227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:06:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:51.963302709 +0000 UTC m=+2429.091666506" watchObservedRunningTime="2026-07-27 20:06:51.9637227 +0000 UTC m=+2429.092086497"
Jul 27 20:06:52.745413 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:52.745376    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:52.750178 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:52.750153    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:52.950969 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:52.950935    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:52.951881 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:52.951862    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:06:53.936280 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:53.936245    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"]
Jul 27 20:06:53.936595 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:53.936582    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98094f24-0ebb-4b08-ac3b-fa75587cf779" containerName="istio-proxy"
Jul 27 20:06:53.936639 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:53.936596    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="98094f24-0ebb-4b08-ac3b-fa75587cf779" containerName="istio-proxy"
Jul 27 20:06:53.936671 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:53.936652    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="98094f24-0ebb-4b08-ac3b-fa75587cf779" containerName="istio-proxy"
Jul 27 20:06:53.939674 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:53.939655    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"
Jul 27 20:06:53.942351 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:53.942321    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 20:06:53.942505 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:53.942375    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-d3c546-serving-cert\""
Jul 27 20:06:53.943453 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:53.943435    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 20:06:53.943513 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:53.943436    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-86dhg\""
Jul 27 20:06:53.949225 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:53.949194    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"]
Jul 27 20:06:54.042881 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:54.042841    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6s8m\" (UniqueName: \"kubernetes.io/projected/aefef7ba-d470-4799-a7db-a86c4a6a8d96-kube-api-access-w6s8m\") pod \"maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl\" (UID: \"aefef7ba-d470-4799-a7db-a86c4a6a8d96\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"
Jul 27 20:06:54.042881 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:54.042882    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aefef7ba-d470-4799-a7db-a86c4a6a8d96-maas-api-tls\") pod \"maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl\" (UID: \"aefef7ba-d470-4799-a7db-a86c4a6a8d96\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"
Jul 27 20:06:54.043414 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:54.042917    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aefef7ba-d470-4799-a7db-a86c4a6a8d96-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl\" (UID: \"aefef7ba-d470-4799-a7db-a86c4a6a8d96\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"
Jul 27 20:06:54.143934 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:54.143891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6s8m\" (UniqueName: \"kubernetes.io/projected/aefef7ba-d470-4799-a7db-a86c4a6a8d96-kube-api-access-w6s8m\") pod \"maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl\" (UID: \"aefef7ba-d470-4799-a7db-a86c4a6a8d96\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"
Jul 27 20:06:54.143934 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:54.143933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aefef7ba-d470-4799-a7db-a86c4a6a8d96-maas-api-tls\") pod \"maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl\" (UID: \"aefef7ba-d470-4799-a7db-a86c4a6a8d96\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"
Jul 27 20:06:54.144253 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:54.143960    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aefef7ba-d470-4799-a7db-a86c4a6a8d96-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl\" (UID: \"aefef7ba-d470-4799-a7db-a86c4a6a8d96\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"
Jul 27 20:06:54.144253 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:06:54.144079    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-serving-cert: secret "maas-api-e2e-shared-a-d3c546-serving-cert" not found
Jul 27 20:06:54.144253 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:06:54.144155    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aefef7ba-d470-4799-a7db-a86c4a6a8d96-maas-api-tls podName:aefef7ba-d470-4799-a7db-a86c4a6a8d96 nodeName:}" failed. No retries permitted until 2026-07-27 20:06:54.64413568 +0000 UTC m=+2431.772499454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/aefef7ba-d470-4799-a7db-a86c4a6a8d96-maas-api-tls") pod "maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl" (UID: "aefef7ba-d470-4799-a7db-a86c4a6a8d96") : secret "maas-api-e2e-shared-a-d3c546-serving-cert" not found
Jul 27 20:06:54.144562 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:54.144545    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aefef7ba-d470-4799-a7db-a86c4a6a8d96-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl\" (UID: \"aefef7ba-d470-4799-a7db-a86c4a6a8d96\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"
Jul 27 20:06:54.152738 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:54.152706    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6s8m\" (UniqueName: \"kubernetes.io/projected/aefef7ba-d470-4799-a7db-a86c4a6a8d96-kube-api-access-w6s8m\") pod \"maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl\" (UID: \"aefef7ba-d470-4799-a7db-a86c4a6a8d96\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"
Jul 27 20:06:54.647827 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:54.647783    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aefef7ba-d470-4799-a7db-a86c4a6a8d96-maas-api-tls\") pod \"maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl\" (UID: \"aefef7ba-d470-4799-a7db-a86c4a6a8d96\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"
Jul 27 20:06:54.650591 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:54.650567    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aefef7ba-d470-4799-a7db-a86c4a6a8d96-maas-api-tls\") pod \"maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl\" (UID: \"aefef7ba-d470-4799-a7db-a86c4a6a8d96\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"
Jul 27 20:06:54.850687 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:54.850650    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"
Jul 27 20:06:54.994214 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:54.994179    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"]
Jul 27 20:06:54.997322 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:06:54.997294    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaefef7ba_d470_4799_a7db_a86c4a6a8d96.slice/crio-6cb2afb1ab8e8347a87aea4d0e51d9f625b423bb1597ec706b9ac38cb74374f5 WatchSource:0}: Error finding container 6cb2afb1ab8e8347a87aea4d0e51d9f625b423bb1597ec706b9ac38cb74374f5: Status 404 returned error can't find the container with id 6cb2afb1ab8e8347a87aea4d0e51d9f625b423bb1597ec706b9ac38cb74374f5
Jul 27 20:06:55.973988 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:55.973937    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl" event={"ID":"aefef7ba-d470-4799-a7db-a86c4a6a8d96","Type":"ContainerStarted","Data":"d4ea032b52b9e6f25767b6c55d6b10fb663b52fcd4374452341dd167ba042b4b"}
Jul 27 20:06:55.974505 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:55.974084    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"
Jul 27 20:06:55.974505 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:55.974114    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl" event={"ID":"aefef7ba-d470-4799-a7db-a86c4a6a8d96","Type":"ContainerStarted","Data":"6cb2afb1ab8e8347a87aea4d0e51d9f625b423bb1597ec706b9ac38cb74374f5"}
Jul 27 20:06:55.993236 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:55.993175    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl" podStartSLOduration=2.54691769 podStartE2EDuration="2.993158271s" totalImagesPullingTime="446.240581ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:55.991081826 +0000 UTC m=+2433.119445619" watchObservedRunningTime="2026-07-27 20:06:55.993158271 +0000 UTC m=+2433.121522067"
Jul 27 20:06:58.568862 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:06:58.568822    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:07:01.991069 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:01.991006    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"
Jul 27 20:07:02.415668 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:02.415635    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"]
Jul 27 20:07:02.418725 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:02.418703    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"
Jul 27 20:07:02.421263 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:02.421237    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-73ce16-serving-cert\""
Jul 27 20:07:02.429897 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:02.429870    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"]
Jul 27 20:07:02.519820 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:02.519782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl578\" (UniqueName: \"kubernetes.io/projected/62295d0d-4768-4efa-aa0c-938204ecee11-kube-api-access-gl578\") pod \"maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc\" (UID: \"62295d0d-4768-4efa-aa0c-938204ecee11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"
Jul 27 20:07:02.520009 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:02.519854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62295d0d-4768-4efa-aa0c-938204ecee11-openshift-service-ca\") pod \"maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc\" (UID: \"62295d0d-4768-4efa-aa0c-938204ecee11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"
Jul 27 20:07:02.520009 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:02.519894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62295d0d-4768-4efa-aa0c-938204ecee11-maas-api-tls\") pod \"maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc\" (UID: \"62295d0d-4768-4efa-aa0c-938204ecee11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"
Jul 27 20:07:02.621220 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:02.621185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl578\" (UniqueName: \"kubernetes.io/projected/62295d0d-4768-4efa-aa0c-938204ecee11-kube-api-access-gl578\") pod \"maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc\" (UID: \"62295d0d-4768-4efa-aa0c-938204ecee11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"
Jul 27 20:07:02.621423 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:02.621257    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62295d0d-4768-4efa-aa0c-938204ecee11-openshift-service-ca\") pod \"maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc\" (UID: \"62295d0d-4768-4efa-aa0c-938204ecee11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"
Jul 27 20:07:02.621423 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:02.621299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62295d0d-4768-4efa-aa0c-938204ecee11-maas-api-tls\") pod \"maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc\" (UID: \"62295d0d-4768-4efa-aa0c-938204ecee11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"
Jul 27 20:07:02.621423 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:07:02.621414    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-serving-cert: secret "maas-api-e2e-shared-b-73ce16-serving-cert" not found
Jul 27 20:07:02.621553 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:07:02.621475    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62295d0d-4768-4efa-aa0c-938204ecee11-maas-api-tls podName:62295d0d-4768-4efa-aa0c-938204ecee11 nodeName:}" failed. No retries permitted until 2026-07-27 20:07:03.121455351 +0000 UTC m=+2440.249819125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/62295d0d-4768-4efa-aa0c-938204ecee11-maas-api-tls") pod "maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc" (UID: "62295d0d-4768-4efa-aa0c-938204ecee11") : secret "maas-api-e2e-shared-b-73ce16-serving-cert" not found
Jul 27 20:07:02.622015 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:02.621996    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62295d0d-4768-4efa-aa0c-938204ecee11-openshift-service-ca\") pod \"maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc\" (UID: \"62295d0d-4768-4efa-aa0c-938204ecee11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"
Jul 27 20:07:02.632297 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:02.632268    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl578\" (UniqueName: \"kubernetes.io/projected/62295d0d-4768-4efa-aa0c-938204ecee11-kube-api-access-gl578\") pod \"maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc\" (UID: \"62295d0d-4768-4efa-aa0c-938204ecee11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"
Jul 27 20:07:03.126114 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:03.126080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62295d0d-4768-4efa-aa0c-938204ecee11-maas-api-tls\") pod \"maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc\" (UID: \"62295d0d-4768-4efa-aa0c-938204ecee11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"
Jul 27 20:07:03.129095 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:03.129042    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62295d0d-4768-4efa-aa0c-938204ecee11-maas-api-tls\") pod \"maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc\" (UID: \"62295d0d-4768-4efa-aa0c-938204ecee11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"
Jul 27 20:07:03.330227 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:03.330185    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"
Jul 27 20:07:03.720785 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:03.720760    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"]
Jul 27 20:07:03.723821 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:07:03.723793    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62295d0d_4768_4efa_aa0c_938204ecee11.slice/crio-551d6ae6f92826bca092419b110667dd9cba08663ec38c04b0b13f4f2f609967 WatchSource:0}: Error finding container 551d6ae6f92826bca092419b110667dd9cba08663ec38c04b0b13f4f2f609967: Status 404 returned error can't find the container with id 551d6ae6f92826bca092419b110667dd9cba08663ec38c04b0b13f4f2f609967
Jul 27 20:07:04.016554 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:04.016476    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc" event={"ID":"62295d0d-4768-4efa-aa0c-938204ecee11","Type":"ContainerStarted","Data":"551d6ae6f92826bca092419b110667dd9cba08663ec38c04b0b13f4f2f609967"}
Jul 27 20:07:05.024423 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:05.024387    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc" event={"ID":"62295d0d-4768-4efa-aa0c-938204ecee11","Type":"ContainerStarted","Data":"482ab01b7e595d0576d3a90ff129cfda39f50261f5cb7a6a864228e21dd003e0"}
Jul 27 20:07:05.024843 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:05.024586    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"
Jul 27 20:07:05.042731 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:05.042676    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc" podStartSLOduration=2.735111722 podStartE2EDuration="3.042660254s" totalImagesPullingTime="307.548532ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:07:05.040723574 +0000 UTC m=+2442.169087382" watchObservedRunningTime="2026-07-27 20:07:05.042660254 +0000 UTC m=+2442.171024049"
Jul 27 20:07:07.036246 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:07.036212    2578 generic.go:356] "Generic (PLEG): container finished" podID="a8b51fb7-2475-4a76-a8de-9555545f17ce" containerID="66775bb4707cad7285a557137709664edcaa51ba768371d604b3a15ea828a4ba" exitCode=0
Jul 27 20:07:07.036702 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:07.036285    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5" event={"ID":"a8b51fb7-2475-4a76-a8de-9555545f17ce","Type":"ContainerDied","Data":"66775bb4707cad7285a557137709664edcaa51ba768371d604b3a15ea828a4ba"}
Jul 27 20:07:07.036702 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:07.036694    2578 scope.go:117] "RemoveContainer" containerID="66775bb4707cad7285a557137709664edcaa51ba768371d604b3a15ea828a4ba"
Jul 27 20:07:07.037684 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:07.037658    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:07:07.037742 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:07.037723    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:07:07.037777 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:07.037755    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:07:07.951769 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:07.951731    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:07:08.042868 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:08.042830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5" event={"ID":"a8b51fb7-2475-4a76-a8de-9555545f17ce","Type":"ContainerStarted","Data":"5683f97dccd68b654df997d8481f088645f780e4b20c9b60db536d849ca6aa86"}
Jul 27 20:07:08.745370 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:08.745332    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:07:08.746574 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:08.746545    2578 patch_prober.go:28] interesting pod/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 27 20:07:08.746712 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:08.746597    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5" podUID="a8b51fb7-2475-4a76-a8de-9555545f17ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 27 20:07:09.746019 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:09.745986    2578 patch_prober.go:28] interesting pod/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 27 20:07:09.746444 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:09.746039    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5" podUID="a8b51fb7-2475-4a76-a8de-9555545f17ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 27 20:07:10.276151 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:10.276106    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:07:10.745718 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:10.745632    2578 patch_prober.go:28] interesting pod/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 27 20:07:10.745718 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:10.745700    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5" podUID="a8b51fb7-2475-4a76-a8de-9555545f17ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 27 20:07:11.035760 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:11.035732    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"
Jul 27 20:07:11.746115 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:11.746046    2578 patch_prober.go:28] interesting pod/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 27 20:07:11.746304 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:11.746137    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5" podUID="a8b51fb7-2475-4a76-a8de-9555545f17ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 27 20:07:12.749376 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:12.749342    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:07:12.749790 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:12.749636    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:07:12.750309 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:12.750290    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:07:22.773036 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:22.772997    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:07:23.591723 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:23.591685    2578 scope.go:117] "RemoveContainer" containerID="f8b47a4f3c573fcf3bc805ea091e15220d24302ad0e0e101503e3d42c7183a74"
Jul 27 20:07:23.600007 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:23.599985    2578 scope.go:117] "RemoveContainer" containerID="a67cf01643ca0a734d2ee7126d837dbd47677c37417813d2f754584d690fdf25"
Jul 27 20:07:43.175975 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:07:43.175943    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:08:08.469997 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:08:08.469961    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:08:28.175960 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:08:28.175876    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:08:42.569073 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:08:42.569028    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:08:54.968858 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:08:54.968817    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:09:13.569415 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:09:13.569378    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:09:29.370433 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:09:29.370397    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:09:49.484456 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:09:49.484376    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:10:00.877911 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:10:00.877875    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:10:13.073366 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:10:13.073329    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:10:32.174142 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:10:32.174107    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:10:49.382754 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:10:49.382716    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:11:16.576396 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:11:16.576319    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:11:23.652600 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:11:23.652570    2578 scope.go:117] "RemoveContainer" containerID="510750ced40648297eb8a5af6456cdb0081aec7be6a611a0bd0eb28a0ac4fc8a"
Jul 27 20:11:23.660243 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:11:23.660203    2578 scope.go:117] "RemoveContainer" containerID="6e6d9040f87936fa91a7dc9f568bb49e296654e1290c8ce7da72ab5e7ce8b20b"
Jul 27 20:11:28.576864 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:11:28.576822    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:11:51.281302 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:11:51.281264    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:12:06.876248 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:12:06.876211    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:12:14.879228 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:12:14.879192    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:12:23.680198 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:12:23.680164    2578 scope.go:117] "RemoveContainer" containerID="282fbe9764c3dca52d375ac48bd83a43b5cf7b1601ea0087ee231745450f0338"
Jul 27 20:13:09.082756 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:13:09.082723    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:13:23.698860 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:13:23.698825    2578 scope.go:117] "RemoveContainer" containerID="e7036fee795e6fb8a5ab0891078acce80da127fc3266eaad6947505c102f2c21"
Jul 27 20:13:45.184898 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:13:45.184859    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:14:03.573043 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:14:03.573006    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:14:18.777834 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:14:18.777741    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:14:35.877727 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:14:35.877684    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:14:52.268917 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:14:52.268878    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:15:00.159594 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:00.159554    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753055-q9cw8"]
Jul 27 20:15:00.163009 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:00.162986    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-73ce16-29753055-qg2jq"]
Jul 27 20:15:00.163152 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:00.163131    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753055-q9cw8"
Jul 27 20:15:00.166034 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:00.166014    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d3c546-29753055-zqp4g"]
Jul 27 20:15:00.166164 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:00.166143    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-73ce16-29753055-qg2jq"
Jul 27 20:15:00.167422 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:00.167397    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-875sf\""
Jul 27 20:15:00.169243 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:00.169221    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d3c546-29753055-zqp4g"
Jul 27 20:15:00.173490 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:00.173461    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753055-q9cw8"]
Jul 27 20:15:00.175327 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:00.175304    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753055-q9cw8"
Jul 27 20:15:00.179582 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:00.179563    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-73ce16-29753055-qg2jq"]
Jul 27 20:15:00.181798 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:00.181770    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d3c546-29753055-zqp4g"]
Jul 27 20:15:00.187824 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:00.187793    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-73ce16-29753055-qg2jq"
Jul 27 20:15:00.222304 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:00.221979    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d3c546-29753055-zqp4g"
Jul 27 20:15:00.355205 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:00.355179    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753055-q9cw8"]
Jul 27 20:15:00.357204 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:15:00.357151    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ac1b93_2b2a_4559_9ca5_5ceeb1474f6f.slice/crio-5232bdfc7085e1e31c84bffeb927caf26c427d0b14272e354bd9c9b96e89371b WatchSource:0}: Error finding container 5232bdfc7085e1e31c84bffeb927caf26c427d0b14272e354bd9c9b96e89371b: Status 404 returned error can't find the container with id 5232bdfc7085e1e31c84bffeb927caf26c427d0b14272e354bd9c9b96e89371b
Jul 27 20:15:00.377832 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:00.377805    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-73ce16-29753055-qg2jq"]
Jul 27 20:15:00.380479 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:15:00.380451    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0be507e_b74c_42b4_ae41_aecd8181c3b2.slice/crio-6d808a43d86ae3c7fa5d82a17eed5452a0924f3ea865e9c0832fa21ab8aff23d WatchSource:0}: Error finding container 6d808a43d86ae3c7fa5d82a17eed5452a0924f3ea865e9c0832fa21ab8aff23d: Status 404 returned error can't find the container with id 6d808a43d86ae3c7fa5d82a17eed5452a0924f3ea865e9c0832fa21ab8aff23d
Jul 27 20:15:00.407277 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:00.407254    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d3c546-29753055-zqp4g"]
Jul 27 20:15:00.409066 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:15:00.409027    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ce9349_eb1c_4cde_a3b5_faa181d30d1c.slice/crio-10e99a07b23b87c96df3a49e66e60d70d170ed9db4760432d0ac46c91a357f95 WatchSource:0}: Error finding container 10e99a07b23b87c96df3a49e66e60d70d170ed9db4760432d0ac46c91a357f95: Status 404 returned error can't find the container with id 10e99a07b23b87c96df3a49e66e60d70d170ed9db4760432d0ac46c91a357f95
Jul 27 20:15:01.226426 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:01.226388    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d3c546-29753055-zqp4g" event={"ID":"15ce9349-eb1c-4cde-a3b5-faa181d30d1c","Type":"ContainerStarted","Data":"59ad8c998f7561d9e93f9ced0044ee0a22be7ee5d8136971fe0c3d4d199c2189"}
Jul 27 20:15:01.226913 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:01.226447    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d3c546-29753055-zqp4g" event={"ID":"15ce9349-eb1c-4cde-a3b5-faa181d30d1c","Type":"ContainerStarted","Data":"10e99a07b23b87c96df3a49e66e60d70d170ed9db4760432d0ac46c91a357f95"}
Jul 27 20:15:01.227860 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:01.227836    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-73ce16-29753055-qg2jq" event={"ID":"e0be507e-b74c-42b4-ae41-aecd8181c3b2","Type":"ContainerStarted","Data":"67168e0c53c7a8251c38251d4231611b5b9b68c8f152e99ec95a7497734dac8b"}
Jul 27 20:15:01.227989 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:01.227880    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-73ce16-29753055-qg2jq" event={"ID":"e0be507e-b74c-42b4-ae41-aecd8181c3b2","Type":"ContainerStarted","Data":"6d808a43d86ae3c7fa5d82a17eed5452a0924f3ea865e9c0832fa21ab8aff23d"}
Jul 27 20:15:01.229195 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:01.229177    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753055-q9cw8" event={"ID":"00ac1b93-2b2a-4559-9ca5-5ceeb1474f6f","Type":"ContainerStarted","Data":"4fe1811102b8e767cafb6d917d71c5f30042b2851fef905a95e69ebcea187bae"}
Jul 27 20:15:01.229279 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:01.229218    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753055-q9cw8" event={"ID":"00ac1b93-2b2a-4559-9ca5-5ceeb1474f6f","Type":"ContainerStarted","Data":"5232bdfc7085e1e31c84bffeb927caf26c427d0b14272e354bd9c9b96e89371b"}
Jul 27 20:15:01.243146 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:01.243098    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d3c546-29753055-zqp4g" podStartSLOduration=1.243084702 podStartE2EDuration="1.243084702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:15:01.241640961 +0000 UTC m=+2918.370004759" watchObservedRunningTime="2026-07-27 20:15:01.243084702 +0000 UTC m=+2918.371448492"
Jul 27 20:15:01.254739 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:01.254686    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753055-q9cw8" podStartSLOduration=1.254669311 podStartE2EDuration="1.254669311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:15:01.254507637 +0000 UTC m=+2918.382871436" watchObservedRunningTime="2026-07-27 20:15:01.254669311 +0000 UTC m=+2918.383033106"
Jul 27 20:15:01.268103 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:01.268039    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-73ce16-29753055-qg2jq" podStartSLOduration=1.267997418 podStartE2EDuration="1.267997418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:15:01.267323118 +0000 UTC m=+2918.395686915" watchObservedRunningTime="2026-07-27 20:15:01.267997418 +0000 UTC m=+2918.396361205"
Jul 27 20:15:02.234967 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:02.234935    2578 generic.go:356] "Generic (PLEG): container finished" podID="e0be507e-b74c-42b4-ae41-aecd8181c3b2" containerID="67168e0c53c7a8251c38251d4231611b5b9b68c8f152e99ec95a7497734dac8b" exitCode=0
Jul 27 20:15:02.235442 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:02.235011    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-73ce16-29753055-qg2jq" event={"ID":"e0be507e-b74c-42b4-ae41-aecd8181c3b2","Type":"ContainerDied","Data":"67168e0c53c7a8251c38251d4231611b5b9b68c8f152e99ec95a7497734dac8b"}
Jul 27 20:15:02.236459 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:02.236428    2578 generic.go:356] "Generic (PLEG): container finished" podID="00ac1b93-2b2a-4559-9ca5-5ceeb1474f6f" containerID="4fe1811102b8e767cafb6d917d71c5f30042b2851fef905a95e69ebcea187bae" exitCode=0
Jul 27 20:15:02.236609 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:02.236470    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753055-q9cw8" event={"ID":"00ac1b93-2b2a-4559-9ca5-5ceeb1474f6f","Type":"ContainerDied","Data":"4fe1811102b8e767cafb6d917d71c5f30042b2851fef905a95e69ebcea187bae"}
Jul 27 20:15:02.237864 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:02.237846    2578 generic.go:356] "Generic (PLEG): container finished" podID="15ce9349-eb1c-4cde-a3b5-faa181d30d1c" containerID="59ad8c998f7561d9e93f9ced0044ee0a22be7ee5d8136971fe0c3d4d199c2189" exitCode=0
Jul 27 20:15:02.237948 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:02.237871    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d3c546-29753055-zqp4g" event={"ID":"15ce9349-eb1c-4cde-a3b5-faa181d30d1c","Type":"ContainerDied","Data":"59ad8c998f7561d9e93f9ced0044ee0a22be7ee5d8136971fe0c3d4d199c2189"}
Jul 27 20:15:03.391865 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:03.391836    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d3c546-29753055-zqp4g"
Jul 27 20:15:03.439624 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:03.439594    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-73ce16-29753055-qg2jq"
Jul 27 20:15:03.442756 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:03.442736    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753055-q9cw8"
Jul 27 20:15:04.248088 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:04.248043    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d3c546-29753055-zqp4g"
Jul 27 20:15:04.248088 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:04.248078    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d3c546-29753055-zqp4g" event={"ID":"15ce9349-eb1c-4cde-a3b5-faa181d30d1c","Type":"ContainerDied","Data":"10e99a07b23b87c96df3a49e66e60d70d170ed9db4760432d0ac46c91a357f95"}
Jul 27 20:15:04.248348 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:04.248128    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10e99a07b23b87c96df3a49e66e60d70d170ed9db4760432d0ac46c91a357f95"
Jul 27 20:15:04.249332 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:04.249315    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-73ce16-29753055-qg2jq"
Jul 27 20:15:04.249432 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:04.249320    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-73ce16-29753055-qg2jq" event={"ID":"e0be507e-b74c-42b4-ae41-aecd8181c3b2","Type":"ContainerDied","Data":"6d808a43d86ae3c7fa5d82a17eed5452a0924f3ea865e9c0832fa21ab8aff23d"}
Jul 27 20:15:04.249432 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:04.249418    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d808a43d86ae3c7fa5d82a17eed5452a0924f3ea865e9c0832fa21ab8aff23d"
Jul 27 20:15:04.250537 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:04.250511    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753055-q9cw8" event={"ID":"00ac1b93-2b2a-4559-9ca5-5ceeb1474f6f","Type":"ContainerDied","Data":"5232bdfc7085e1e31c84bffeb927caf26c427d0b14272e354bd9c9b96e89371b"}
Jul 27 20:15:04.250537 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:04.250536    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753055-q9cw8"
Jul 27 20:15:04.250661 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:04.250553    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5232bdfc7085e1e31c84bffeb927caf26c427d0b14272e354bd9c9b96e89371b"
Jul 27 20:15:22.289160 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:22.289116    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:15:37.376849 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:37.376807    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:15:51.369288 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:15:51.369195    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:16:05.468382 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:05.468347    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:16:20.285823 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.285784    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"]
Jul 27 20:16:20.286311 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.286150    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00ac1b93-2b2a-4559-9ca5-5ceeb1474f6f" containerName="cleanup"
Jul 27 20:16:20.286311 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.286161    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="00ac1b93-2b2a-4559-9ca5-5ceeb1474f6f" containerName="cleanup"
Jul 27 20:16:20.286311 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.286193    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0be507e-b74c-42b4-ae41-aecd8181c3b2" containerName="cleanup"
Jul 27 20:16:20.286311 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.286198    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0be507e-b74c-42b4-ae41-aecd8181c3b2" containerName="cleanup"
Jul 27 20:16:20.286311 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.286211    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ce9349-eb1c-4cde-a3b5-faa181d30d1c" containerName="cleanup"
Jul 27 20:16:20.286311 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.286217    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ce9349-eb1c-4cde-a3b5-faa181d30d1c" containerName="cleanup"
Jul 27 20:16:20.286311 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.286272    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="00ac1b93-2b2a-4559-9ca5-5ceeb1474f6f" containerName="cleanup"
Jul 27 20:16:20.286311 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.286283    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0be507e-b74c-42b4-ae41-aecd8181c3b2" containerName="cleanup"
Jul 27 20:16:20.286311 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.286289    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ce9349-eb1c-4cde-a3b5-faa181d30d1c" containerName="cleanup"
Jul 27 20:16:20.289403 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.289386    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"
Jul 27 20:16:20.291776 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.291756    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-018406-serving-cert\""
Jul 27 20:16:20.301313 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.301287    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"]
Jul 27 20:16:20.344303 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.344264    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz2lm\" (UniqueName: \"kubernetes.io/projected/dafbb8df-19a1-46da-98f0-70f76c875f49-kube-api-access-sz2lm\") pod \"maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw\" (UID: \"dafbb8df-19a1-46da-98f0-70f76c875f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"
Jul 27 20:16:20.344506 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.344349    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dafbb8df-19a1-46da-98f0-70f76c875f49-maas-api-tls\") pod \"maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw\" (UID: \"dafbb8df-19a1-46da-98f0-70f76c875f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"
Jul 27 20:16:20.344506 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.344446    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dafbb8df-19a1-46da-98f0-70f76c875f49-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw\" (UID: \"dafbb8df-19a1-46da-98f0-70f76c875f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"
Jul 27 20:16:20.445494 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.445451    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dafbb8df-19a1-46da-98f0-70f76c875f49-maas-api-tls\") pod \"maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw\" (UID: \"dafbb8df-19a1-46da-98f0-70f76c875f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"
Jul 27 20:16:20.445789 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.445751    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dafbb8df-19a1-46da-98f0-70f76c875f49-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw\" (UID: \"dafbb8df-19a1-46da-98f0-70f76c875f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"
Jul 27 20:16:20.445932 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.445895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz2lm\" (UniqueName: \"kubernetes.io/projected/dafbb8df-19a1-46da-98f0-70f76c875f49-kube-api-access-sz2lm\") pod \"maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw\" (UID: \"dafbb8df-19a1-46da-98f0-70f76c875f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"
Jul 27 20:16:20.446403 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.446380    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dafbb8df-19a1-46da-98f0-70f76c875f49-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw\" (UID: \"dafbb8df-19a1-46da-98f0-70f76c875f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"
Jul 27 20:16:20.448229 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.448211    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dafbb8df-19a1-46da-98f0-70f76c875f49-maas-api-tls\") pod \"maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw\" (UID: \"dafbb8df-19a1-46da-98f0-70f76c875f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"
Jul 27 20:16:20.454223 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.454202    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz2lm\" (UniqueName: \"kubernetes.io/projected/dafbb8df-19a1-46da-98f0-70f76c875f49-kube-api-access-sz2lm\") pod \"maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw\" (UID: \"dafbb8df-19a1-46da-98f0-70f76c875f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"
Jul 27 20:16:20.599199 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.599045    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"
Jul 27 20:16:20.766226 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.766193    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"]
Jul 27 20:16:20.767215 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:16:20.767189    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddafbb8df_19a1_46da_98f0_70f76c875f49.slice/crio-bad0ccd6c67b038a417b6729df557e73a862af651f71e54c03bb943d638a1440 WatchSource:0}: Error finding container bad0ccd6c67b038a417b6729df557e73a862af651f71e54c03bb943d638a1440: Status 404 returned error can't find the container with id bad0ccd6c67b038a417b6729df557e73a862af651f71e54c03bb943d638a1440
Jul 27 20:16:20.768540 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:20.768523    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:16:21.626687 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:21.626640    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw" event={"ID":"dafbb8df-19a1-46da-98f0-70f76c875f49","Type":"ContainerStarted","Data":"8c1968dfba947e74d2278c9ab04211ef2ecf906b640037c3ad7ce24c05db4959"}
Jul 27 20:16:21.627159 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:21.626700    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw" event={"ID":"dafbb8df-19a1-46da-98f0-70f76c875f49","Type":"ContainerStarted","Data":"bad0ccd6c67b038a417b6729df557e73a862af651f71e54c03bb943d638a1440"}
Jul 27 20:16:21.627159 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:21.626770    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"
Jul 27 20:16:21.645073 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:21.644998    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw" podStartSLOduration=1.162461891 podStartE2EDuration="1.644980186s" totalImagesPullingTime="482.518295ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:16:21.642667578 +0000 UTC m=+2998.771031374" watchObservedRunningTime="2026-07-27 20:16:21.644980186 +0000 UTC m=+2998.773344038"
Jul 27 20:16:27.636882 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:27.636853    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"
Jul 27 20:16:30.372964 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:30.372922    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:16:35.835211 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:35.835170    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"]
Jul 27 20:16:35.839042 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:35.839022    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:35.841543 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:35.841523    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-933254-openshift-default-dockercfg-596xf\""
Jul 27 20:16:35.848014 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:35.847990    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"]
Jul 27 20:16:35.987750 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:35.987704    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-data\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:35.987750 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:35.987757    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dfdc3df-ce6b-44d1-a67c-83170520a907-istiod-ca-cert\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:35.987979 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:35.987827    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-workload-certs\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:35.987979 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:35.987889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-credential-socket\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:35.987979 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:35.987932    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dwjv\" (UniqueName: \"kubernetes.io/projected/0dfdc3df-ce6b-44d1-a67c-83170520a907-kube-api-access-4dwjv\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:35.987979 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:35.987959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-workload-socket\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:35.988325 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:35.987981    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-token\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:35.988325 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:35.988010    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-envoy\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:35.988325 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:35.988025    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-podinfo\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.089334 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.089241    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dwjv\" (UniqueName: \"kubernetes.io/projected/0dfdc3df-ce6b-44d1-a67c-83170520a907-kube-api-access-4dwjv\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.089334 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.089292    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-workload-socket\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.089334 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.089312    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-token\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.089654 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.089340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-envoy\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.089654 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.089358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-podinfo\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.089654 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.089430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-data\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.089654 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.089461    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dfdc3df-ce6b-44d1-a67c-83170520a907-istiod-ca-cert\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.089654 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.089488    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-workload-certs\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.089654 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.089524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-credential-socket\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.089980 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.089906    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-workload-socket\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.089980 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.089961    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-data\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.090093 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.090003    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-credential-socket\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.090093 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.090036    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-workload-certs\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.090254 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.090234    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dfdc3df-ce6b-44d1-a67c-83170520a907-istiod-ca-cert\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.091916 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.091892    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-envoy\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.092134 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.092116    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-podinfo\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.102413 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.102384    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dwjv\" (UniqueName: \"kubernetes.io/projected/0dfdc3df-ce6b-44d1-a67c-83170520a907-kube-api-access-4dwjv\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.103856 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.103828    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-token\") pod \"e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") " pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.150470 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.150440    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:36.284861 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.284833    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"]
Jul 27 20:16:36.286860 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:16:36.286832    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dfdc3df_ce6b_44d1_a67c_83170520a907.slice/crio-5597718a0a6041b05f206c3e93f35e02e63579af027edd3eb6fb39df4e708d38 WatchSource:0}: Error finding container 5597718a0a6041b05f206c3e93f35e02e63579af027edd3eb6fb39df4e708d38: Status 404 returned error can't find the container with id 5597718a0a6041b05f206c3e93f35e02e63579af027edd3eb6fb39df4e708d38
Jul 27 20:16:36.288991 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.288963    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:16:36.289099 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.289026    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:16:36.289099 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.289077    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:16:36.700591 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.700497    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5" event={"ID":"0dfdc3df-ce6b-44d1-a67c-83170520a907","Type":"ContainerStarted","Data":"96472fb5661490dd55c453016807f667ad448538d844a7b3b25bccd314b844f7"}
Jul 27 20:16:36.700591 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.700590    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5" event={"ID":"0dfdc3df-ce6b-44d1-a67c-83170520a907","Type":"ContainerStarted","Data":"5597718a0a6041b05f206c3e93f35e02e63579af027edd3eb6fb39df4e708d38"}
Jul 27 20:16:36.721908 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:36.721849    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5" podStartSLOduration=1.721834528 podStartE2EDuration="1.721834528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:16:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:16:36.719251019 +0000 UTC m=+3013.847614814" watchObservedRunningTime="2026-07-27 20:16:36.721834528 +0000 UTC m=+3013.850198402"
Jul 27 20:16:37.151184 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:37.151142    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:37.156484 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:37.156454    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:37.706713 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:37.706678    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:37.707835 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:37.707811    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:38.821498 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:38.821463    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"]
Jul 27 20:16:38.825700 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:38.825676    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"
Jul 27 20:16:38.828088 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:38.828038    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-933254-serving-cert\""
Jul 27 20:16:38.832976 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:38.832949    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"]
Jul 27 20:16:38.914526 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:38.914490    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acbcdeb4-1ff5-415f-91ba-9a75849707b4-maas-api-tls\") pod \"maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn\" (UID: \"acbcdeb4-1ff5-415f-91ba-9a75849707b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"
Jul 27 20:16:38.914709 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:38.914542    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbrlv\" (UniqueName: \"kubernetes.io/projected/acbcdeb4-1ff5-415f-91ba-9a75849707b4-kube-api-access-rbrlv\") pod \"maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn\" (UID: \"acbcdeb4-1ff5-415f-91ba-9a75849707b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"
Jul 27 20:16:38.914709 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:38.914582    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acbcdeb4-1ff5-415f-91ba-9a75849707b4-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn\" (UID: \"acbcdeb4-1ff5-415f-91ba-9a75849707b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"
Jul 27 20:16:39.015309 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:39.015263    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acbcdeb4-1ff5-415f-91ba-9a75849707b4-maas-api-tls\") pod \"maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn\" (UID: \"acbcdeb4-1ff5-415f-91ba-9a75849707b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"
Jul 27 20:16:39.015503 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:39.015313    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbrlv\" (UniqueName: \"kubernetes.io/projected/acbcdeb4-1ff5-415f-91ba-9a75849707b4-kube-api-access-rbrlv\") pod \"maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn\" (UID: \"acbcdeb4-1ff5-415f-91ba-9a75849707b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"
Jul 27 20:16:39.015503 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:39.015346    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acbcdeb4-1ff5-415f-91ba-9a75849707b4-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn\" (UID: \"acbcdeb4-1ff5-415f-91ba-9a75849707b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"
Jul 27 20:16:39.015503 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:16:39.015417    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-serving-cert: secret "maas-api-e2e-ipp-b-933254-serving-cert" not found
Jul 27 20:16:39.015503 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:16:39.015495    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acbcdeb4-1ff5-415f-91ba-9a75849707b4-maas-api-tls podName:acbcdeb4-1ff5-415f-91ba-9a75849707b4 nodeName:}" failed. No retries permitted until 2026-07-27 20:16:39.515475331 +0000 UTC m=+3016.643839125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/acbcdeb4-1ff5-415f-91ba-9a75849707b4-maas-api-tls") pod "maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn" (UID: "acbcdeb4-1ff5-415f-91ba-9a75849707b4") : secret "maas-api-e2e-ipp-b-933254-serving-cert" not found
Jul 27 20:16:39.016046 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:39.016026    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acbcdeb4-1ff5-415f-91ba-9a75849707b4-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn\" (UID: \"acbcdeb4-1ff5-415f-91ba-9a75849707b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"
Jul 27 20:16:39.023998 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:39.023965    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbrlv\" (UniqueName: \"kubernetes.io/projected/acbcdeb4-1ff5-415f-91ba-9a75849707b4-kube-api-access-rbrlv\") pod \"maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn\" (UID: \"acbcdeb4-1ff5-415f-91ba-9a75849707b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"
Jul 27 20:16:39.520756 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:39.520719    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acbcdeb4-1ff5-415f-91ba-9a75849707b4-maas-api-tls\") pod \"maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn\" (UID: \"acbcdeb4-1ff5-415f-91ba-9a75849707b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"
Jul 27 20:16:39.523381 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:39.523355    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acbcdeb4-1ff5-415f-91ba-9a75849707b4-maas-api-tls\") pod \"maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn\" (UID: \"acbcdeb4-1ff5-415f-91ba-9a75849707b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"
Jul 27 20:16:39.739171 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:39.739139    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"
Jul 27 20:16:39.873623 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:39.873584    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"]
Jul 27 20:16:39.875667 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:16:39.875636    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacbcdeb4_1ff5_415f_91ba_9a75849707b4.slice/crio-dbe7d2e4133402296134f73c2f419ed7ee20e664407235727e3442b9814d6b63 WatchSource:0}: Error finding container dbe7d2e4133402296134f73c2f419ed7ee20e664407235727e3442b9814d6b63: Status 404 returned error can't find the container with id dbe7d2e4133402296134f73c2f419ed7ee20e664407235727e3442b9814d6b63
Jul 27 20:16:40.722412 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:40.722364    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn" event={"ID":"acbcdeb4-1ff5-415f-91ba-9a75849707b4","Type":"ContainerStarted","Data":"e25a22b2743811e48fbac84cf3556dbbaac8d86bc3920d688c421895c7d87a3c"}
Jul 27 20:16:40.722587 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:40.722425    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn" event={"ID":"acbcdeb4-1ff5-415f-91ba-9a75849707b4","Type":"ContainerStarted","Data":"dbe7d2e4133402296134f73c2f419ed7ee20e664407235727e3442b9814d6b63"}
Jul 27 20:16:40.722587 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:40.722456    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"
Jul 27 20:16:40.740228 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:40.740184    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn" podStartSLOduration=2.412725976 podStartE2EDuration="2.74016947s" totalImagesPullingTime="327.443494ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:16:40.738254364 +0000 UTC m=+3017.866618161" watchObservedRunningTime="2026-07-27 20:16:40.74016947 +0000 UTC m=+3017.868533265"
Jul 27 20:16:46.274662 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:46.274620    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:16:46.735348 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:46.735320    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"
Jul 27 20:16:53.748241 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:53.748194    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 20:16:53.748681 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:53.748272    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5" podUID="0dfdc3df-ce6b-44d1-a67c-83170520a907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 20:16:54.817000 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:54.816964    2578 generic.go:356] "Generic (PLEG): container finished" podID="0dfdc3df-ce6b-44d1-a67c-83170520a907" containerID="96472fb5661490dd55c453016807f667ad448538d844a7b3b25bccd314b844f7" exitCode=0
Jul 27 20:16:54.817488 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:54.817032    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5" event={"ID":"0dfdc3df-ce6b-44d1-a67c-83170520a907","Type":"ContainerDied","Data":"96472fb5661490dd55c453016807f667ad448538d844a7b3b25bccd314b844f7"}
Jul 27 20:16:54.817488 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:54.817428    2578 scope.go:117] "RemoveContainer" containerID="96472fb5661490dd55c453016807f667ad448538d844a7b3b25bccd314b844f7"
Jul 27 20:16:54.818523 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:54.818496    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:16:54.818586 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:54.818563    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:16:54.818622 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:54.818597    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:16:55.824186 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:55.824152    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5" event={"ID":"0dfdc3df-ce6b-44d1-a67c-83170520a907","Type":"ContainerStarted","Data":"cc2e08b6e1b12aa62c1c2df3a76eab400aab6e5589def6f10c0e293b93b7ccc2"}
Jul 27 20:16:56.151359 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:56.151266    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:16:56.151521 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:56.151462    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 27 20:16:56.151569 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:56.151521    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5" podUID="0dfdc3df-ce6b-44d1-a67c-83170520a907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 27 20:16:57.151827 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:57.151788    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 27 20:16:57.152224 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:57.151859    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5" podUID="0dfdc3df-ce6b-44d1-a67c-83170520a907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 27 20:16:58.151136 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:58.151096    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 27 20:16:58.151331 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:58.151165    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5" podUID="0dfdc3df-ce6b-44d1-a67c-83170520a907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 27 20:16:59.151156 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:59.151115    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 27 20:16:59.151582 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:16:59.151184    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5" podUID="0dfdc3df-ce6b-44d1-a67c-83170520a907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 27 20:17:00.154198 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:00.154166    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:17:00.154602 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:00.154501    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:17:00.155225 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:00.155205    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:17:06.672359 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:06.672321    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:17:39.775123 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:39.775022    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:17:53.920344 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:53.920305    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"]
Jul 27 20:17:53.924130 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:53.924106    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"
Jul 27 20:17:53.926437 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:53.926415    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-394c6a-serving-cert\""
Jul 27 20:17:53.933767 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:53.933741    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"]
Jul 27 20:17:54.037287 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:54.037248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5grx\" (UniqueName: \"kubernetes.io/projected/c16a617f-7df3-4f33-b4c1-f7e78b211c63-kube-api-access-c5grx\") pod \"maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv\" (UID: \"c16a617f-7df3-4f33-b4c1-f7e78b211c63\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"
Jul 27 20:17:54.037489 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:54.037332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c16a617f-7df3-4f33-b4c1-f7e78b211c63-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv\" (UID: \"c16a617f-7df3-4f33-b4c1-f7e78b211c63\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"
Jul 27 20:17:54.037489 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:54.037449    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c16a617f-7df3-4f33-b4c1-f7e78b211c63-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv\" (UID: \"c16a617f-7df3-4f33-b4c1-f7e78b211c63\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"
Jul 27 20:17:54.138588 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:54.138545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c16a617f-7df3-4f33-b4c1-f7e78b211c63-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv\" (UID: \"c16a617f-7df3-4f33-b4c1-f7e78b211c63\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"
Jul 27 20:17:54.138810 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:54.138612    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5grx\" (UniqueName: \"kubernetes.io/projected/c16a617f-7df3-4f33-b4c1-f7e78b211c63-kube-api-access-c5grx\") pod \"maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv\" (UID: \"c16a617f-7df3-4f33-b4c1-f7e78b211c63\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"
Jul 27 20:17:54.138810 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:54.138676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c16a617f-7df3-4f33-b4c1-f7e78b211c63-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv\" (UID: \"c16a617f-7df3-4f33-b4c1-f7e78b211c63\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"
Jul 27 20:17:54.138810 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:17:54.138718    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-serving-cert: secret "maas-api-e2e-ipp-cleanup-394c6a-serving-cert" not found
Jul 27 20:17:54.138810 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:17:54.138802    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c16a617f-7df3-4f33-b4c1-f7e78b211c63-maas-api-tls podName:c16a617f-7df3-4f33-b4c1-f7e78b211c63 nodeName:}" failed. No retries permitted until 2026-07-27 20:17:54.638777726 +0000 UTC m=+3091.767141503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c16a617f-7df3-4f33-b4c1-f7e78b211c63-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv" (UID: "c16a617f-7df3-4f33-b4c1-f7e78b211c63") : secret "maas-api-e2e-ipp-cleanup-394c6a-serving-cert" not found
Jul 27 20:17:54.139427 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:54.139407    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c16a617f-7df3-4f33-b4c1-f7e78b211c63-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv\" (UID: \"c16a617f-7df3-4f33-b4c1-f7e78b211c63\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"
Jul 27 20:17:54.147791 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:54.147756    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5grx\" (UniqueName: \"kubernetes.io/projected/c16a617f-7df3-4f33-b4c1-f7e78b211c63-kube-api-access-c5grx\") pod \"maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv\" (UID: \"c16a617f-7df3-4f33-b4c1-f7e78b211c63\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"
Jul 27 20:17:54.643404 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:54.643363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c16a617f-7df3-4f33-b4c1-f7e78b211c63-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv\" (UID: \"c16a617f-7df3-4f33-b4c1-f7e78b211c63\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"
Jul 27 20:17:54.645987 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:54.645958    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c16a617f-7df3-4f33-b4c1-f7e78b211c63-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv\" (UID: \"c16a617f-7df3-4f33-b4c1-f7e78b211c63\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"
Jul 27 20:17:54.836223 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:54.836179    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"
Jul 27 20:17:54.972747 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:54.972721    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"]
Jul 27 20:17:54.975175 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:17:54.975135    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc16a617f_7df3_4f33_b4c1_f7e78b211c63.slice/crio-0282617ffa6a21efdc7038a617e79a7d3dbac08944cec784c3b7d53cf21bf30b WatchSource:0}: Error finding container 0282617ffa6a21efdc7038a617e79a7d3dbac08944cec784c3b7d53cf21bf30b: Status 404 returned error can't find the container with id 0282617ffa6a21efdc7038a617e79a7d3dbac08944cec784c3b7d53cf21bf30b
Jul 27 20:17:55.122172 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:55.122131    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv" event={"ID":"c16a617f-7df3-4f33-b4c1-f7e78b211c63","Type":"ContainerStarted","Data":"0282617ffa6a21efdc7038a617e79a7d3dbac08944cec784c3b7d53cf21bf30b"}
Jul 27 20:17:56.129520 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:56.129481    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv" event={"ID":"c16a617f-7df3-4f33-b4c1-f7e78b211c63","Type":"ContainerStarted","Data":"31a70f2a3b129bb2731a762c52e65f25849af77c0a88bbba33f8e116057a7988"}
Jul 27 20:17:56.129940 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:56.129543    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"
Jul 27 20:17:56.150229 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:56.150165    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv" podStartSLOduration=2.710188049 podStartE2EDuration="3.150148818s" totalImagesPullingTime="439.960769ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:17:56.147412806 +0000 UTC m=+3093.275776639" watchObservedRunningTime="2026-07-27 20:17:56.150148818 +0000 UTC m=+3093.278512626"
Jul 27 20:17:58.682021 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:17:58.681979    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:18:02.141385 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:02.141351    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"
Jul 27 20:18:19.440126 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:19.440086    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"]
Jul 27 20:18:19.440668 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:19.440355    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv" podUID="c16a617f-7df3-4f33-b4c1-f7e78b211c63" containerName="maas-api" containerID="cri-o://31a70f2a3b129bb2731a762c52e65f25849af77c0a88bbba33f8e116057a7988" gracePeriod=30
Jul 27 20:18:19.698300 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:19.698234    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"
Jul 27 20:18:19.780868 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:19.780826    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c16a617f-7df3-4f33-b4c1-f7e78b211c63-openshift-service-ca\") pod \"c16a617f-7df3-4f33-b4c1-f7e78b211c63\" (UID: \"c16a617f-7df3-4f33-b4c1-f7e78b211c63\") "
Jul 27 20:18:19.781097 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:19.780878    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5grx\" (UniqueName: \"kubernetes.io/projected/c16a617f-7df3-4f33-b4c1-f7e78b211c63-kube-api-access-c5grx\") pod \"c16a617f-7df3-4f33-b4c1-f7e78b211c63\" (UID: \"c16a617f-7df3-4f33-b4c1-f7e78b211c63\") "
Jul 27 20:18:19.781097 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:19.780979    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c16a617f-7df3-4f33-b4c1-f7e78b211c63-maas-api-tls\") pod \"c16a617f-7df3-4f33-b4c1-f7e78b211c63\" (UID: \"c16a617f-7df3-4f33-b4c1-f7e78b211c63\") "
Jul 27 20:18:19.781314 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:19.781279    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c16a617f-7df3-4f33-b4c1-f7e78b211c63-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c16a617f-7df3-4f33-b4c1-f7e78b211c63" (UID: "c16a617f-7df3-4f33-b4c1-f7e78b211c63"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:18:19.783235 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:19.783209    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c16a617f-7df3-4f33-b4c1-f7e78b211c63-kube-api-access-c5grx" (OuterVolumeSpecName: "kube-api-access-c5grx") pod "c16a617f-7df3-4f33-b4c1-f7e78b211c63" (UID: "c16a617f-7df3-4f33-b4c1-f7e78b211c63"). InnerVolumeSpecName "kube-api-access-c5grx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:18:19.783235 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:19.783227    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c16a617f-7df3-4f33-b4c1-f7e78b211c63-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c16a617f-7df3-4f33-b4c1-f7e78b211c63" (UID: "c16a617f-7df3-4f33-b4c1-f7e78b211c63"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:18:19.882751 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:19.882713    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c16a617f-7df3-4f33-b4c1-f7e78b211c63-maas-api-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:18:19.882751 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:19.882744    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c16a617f-7df3-4f33-b4c1-f7e78b211c63-openshift-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:18:19.882751 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:19.882753    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5grx\" (UniqueName: \"kubernetes.io/projected/c16a617f-7df3-4f33-b4c1-f7e78b211c63-kube-api-access-c5grx\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:18:20.250311 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:20.250270    2578 generic.go:356] "Generic (PLEG): container finished" podID="c16a617f-7df3-4f33-b4c1-f7e78b211c63" containerID="31a70f2a3b129bb2731a762c52e65f25849af77c0a88bbba33f8e116057a7988" exitCode=0
Jul 27 20:18:20.250490 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:20.250336    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"
Jul 27 20:18:20.250490 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:20.250354    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv" event={"ID":"c16a617f-7df3-4f33-b4c1-f7e78b211c63","Type":"ContainerDied","Data":"31a70f2a3b129bb2731a762c52e65f25849af77c0a88bbba33f8e116057a7988"}
Jul 27 20:18:20.250490 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:20.250439    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv" event={"ID":"c16a617f-7df3-4f33-b4c1-f7e78b211c63","Type":"ContainerDied","Data":"0282617ffa6a21efdc7038a617e79a7d3dbac08944cec784c3b7d53cf21bf30b"}
Jul 27 20:18:20.250490 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:20.250466    2578 scope.go:117] "RemoveContainer" containerID="31a70f2a3b129bb2731a762c52e65f25849af77c0a88bbba33f8e116057a7988"
Jul 27 20:18:20.259994 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:20.259974    2578 scope.go:117] "RemoveContainer" containerID="31a70f2a3b129bb2731a762c52e65f25849af77c0a88bbba33f8e116057a7988"
Jul 27 20:18:20.260360 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:18:20.260339    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31a70f2a3b129bb2731a762c52e65f25849af77c0a88bbba33f8e116057a7988\": container with ID starting with 31a70f2a3b129bb2731a762c52e65f25849af77c0a88bbba33f8e116057a7988 not found: ID does not exist" containerID="31a70f2a3b129bb2731a762c52e65f25849af77c0a88bbba33f8e116057a7988"
Jul 27 20:18:20.260449 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:20.260372    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a70f2a3b129bb2731a762c52e65f25849af77c0a88bbba33f8e116057a7988"} err="failed to get container status \"31a70f2a3b129bb2731a762c52e65f25849af77c0a88bbba33f8e116057a7988\": rpc error: code = NotFound desc = could not find container \"31a70f2a3b129bb2731a762c52e65f25849af77c0a88bbba33f8e116057a7988\": container with ID starting with 31a70f2a3b129bb2731a762c52e65f25849af77c0a88bbba33f8e116057a7988 not found: ID does not exist"
Jul 27 20:18:20.271003 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:20.270957    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"]
Jul 27 20:18:20.274420 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:20.274388    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-394c6a-7f75f89f47-hj6tv"]
Jul 27 20:18:21.382907 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:21.382872    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c16a617f-7df3-4f33-b4c1-f7e78b211c63" path="/var/lib/kubelet/pods/c16a617f-7df3-4f33-b4c1-f7e78b211c63/volumes"
Jul 27 20:18:24.173854 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:24.173817    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:18:29.705033 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:29.704998    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp"]
Jul 27 20:18:29.705539 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:29.705410    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c16a617f-7df3-4f33-b4c1-f7e78b211c63" containerName="maas-api"
Jul 27 20:18:29.705539 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:29.705423    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c16a617f-7df3-4f33-b4c1-f7e78b211c63" containerName="maas-api"
Jul 27 20:18:29.705539 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:29.705511    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c16a617f-7df3-4f33-b4c1-f7e78b211c63" containerName="maas-api"
Jul 27 20:18:29.710515 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:29.710495    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp"
Jul 27 20:18:29.713268 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:29.713244    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-875sf\""
Jul 27 20:18:29.714890 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:29.714850    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp"]
Jul 27 20:18:29.777999 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:29.777956    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6628edf-b29c-4909-a349-9d14bab3c8e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp\" (UID: \"d6628edf-b29c-4909-a349-9d14bab3c8e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp"
Jul 27 20:18:29.878989 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:29.878943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6628edf-b29c-4909-a349-9d14bab3c8e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp\" (UID: \"d6628edf-b29c-4909-a349-9d14bab3c8e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp"
Jul 27 20:18:29.879639 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:29.879619    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6628edf-b29c-4909-a349-9d14bab3c8e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp\" (UID: \"d6628edf-b29c-4909-a349-9d14bab3c8e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp"
Jul 27 20:18:30.022629 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:30.022539    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp"
Jul 27 20:18:30.162410 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:30.162384    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp"]
Jul 27 20:18:30.164926 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:18:30.164895    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6628edf_b29c_4909_a349_9d14bab3c8e8.slice/crio-ab7614cb160370725d852a31cf3e83b589d961591eec2af2e9d4a6b8362219ea WatchSource:0}: Error finding container ab7614cb160370725d852a31cf3e83b589d961591eec2af2e9d4a6b8362219ea: Status 404 returned error can't find the container with id ab7614cb160370725d852a31cf3e83b589d961591eec2af2e9d4a6b8362219ea
Jul 27 20:18:30.304246 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:30.304210    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp" event={"ID":"d6628edf-b29c-4909-a349-9d14bab3c8e8","Type":"ContainerStarted","Data":"ab7614cb160370725d852a31cf3e83b589d961591eec2af2e9d4a6b8362219ea"}
Jul 27 20:18:31.311370 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:31.311330    2578 generic.go:356] "Generic (PLEG): container finished" podID="d6628edf-b29c-4909-a349-9d14bab3c8e8" containerID="5ebfc01e2877517d552faf80e3a1f2faadc307516b78977ad1b03caddb5bfbd4" exitCode=0
Jul 27 20:18:31.311768 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:31.311445    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp" event={"ID":"d6628edf-b29c-4909-a349-9d14bab3c8e8","Type":"ContainerDied","Data":"5ebfc01e2877517d552faf80e3a1f2faadc307516b78977ad1b03caddb5bfbd4"}
Jul 27 20:18:32.448613 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:32.448583    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp"
Jul 27 20:18:32.604737 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:32.604645    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6628edf-b29c-4909-a349-9d14bab3c8e8-maas-api-service-ca\") pod \"d6628edf-b29c-4909-a349-9d14bab3c8e8\" (UID: \"d6628edf-b29c-4909-a349-9d14bab3c8e8\") "
Jul 27 20:18:32.604997 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:32.604974    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6628edf-b29c-4909-a349-9d14bab3c8e8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d6628edf-b29c-4909-a349-9d14bab3c8e8" (UID: "d6628edf-b29c-4909-a349-9d14bab3c8e8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:18:32.706197 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:32.706155    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6628edf-b29c-4909-a349-9d14bab3c8e8-maas-api-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:18:33.323299 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:33.323261    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp" event={"ID":"d6628edf-b29c-4909-a349-9d14bab3c8e8","Type":"ContainerDied","Data":"ab7614cb160370725d852a31cf3e83b589d961591eec2af2e9d4a6b8362219ea"}
Jul 27 20:18:33.323473 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:33.323313    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab7614cb160370725d852a31cf3e83b589d961591eec2af2e9d4a6b8362219ea"
Jul 27 20:18:33.323473 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:33.323275    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp"
Jul 27 20:18:43.981539 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:43.981457    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:18:45.124806 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:45.124765    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"]
Jul 27 20:18:45.125325 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:45.125070    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw" podUID="dafbb8df-19a1-46da-98f0-70f76c875f49" containerName="maas-api" containerID="cri-o://8c1968dfba947e74d2278c9ab04211ef2ecf906b640037c3ad7ce24c05db4959" gracePeriod=30
Jul 27 20:18:45.305956 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:45.305915    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp"]
Jul 27 20:18:45.307903 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:45.307877    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-018406-pkgmp"]
Jul 27 20:18:45.383599 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:45.383513    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6628edf-b29c-4909-a349-9d14bab3c8e8" path="/var/lib/kubelet/pods/d6628edf-b29c-4909-a349-9d14bab3c8e8/volumes"
Jul 27 20:18:45.584123 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:45.584101    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"
Jul 27 20:18:45.629570 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:45.629540    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz2lm\" (UniqueName: \"kubernetes.io/projected/dafbb8df-19a1-46da-98f0-70f76c875f49-kube-api-access-sz2lm\") pod \"dafbb8df-19a1-46da-98f0-70f76c875f49\" (UID: \"dafbb8df-19a1-46da-98f0-70f76c875f49\") "
Jul 27 20:18:45.629745 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:45.629604    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dafbb8df-19a1-46da-98f0-70f76c875f49-openshift-service-ca\") pod \"dafbb8df-19a1-46da-98f0-70f76c875f49\" (UID: \"dafbb8df-19a1-46da-98f0-70f76c875f49\") "
Jul 27 20:18:45.629745 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:45.629649    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dafbb8df-19a1-46da-98f0-70f76c875f49-maas-api-tls\") pod \"dafbb8df-19a1-46da-98f0-70f76c875f49\" (UID: \"dafbb8df-19a1-46da-98f0-70f76c875f49\") "
Jul 27 20:18:45.629982 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:45.629957    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dafbb8df-19a1-46da-98f0-70f76c875f49-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dafbb8df-19a1-46da-98f0-70f76c875f49" (UID: "dafbb8df-19a1-46da-98f0-70f76c875f49"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:18:45.632048 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:45.632021    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dafbb8df-19a1-46da-98f0-70f76c875f49-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dafbb8df-19a1-46da-98f0-70f76c875f49" (UID: "dafbb8df-19a1-46da-98f0-70f76c875f49"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:18:45.632517 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:45.632500    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dafbb8df-19a1-46da-98f0-70f76c875f49-kube-api-access-sz2lm" (OuterVolumeSpecName: "kube-api-access-sz2lm") pod "dafbb8df-19a1-46da-98f0-70f76c875f49" (UID: "dafbb8df-19a1-46da-98f0-70f76c875f49"). InnerVolumeSpecName "kube-api-access-sz2lm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:18:45.731098 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:45.731046    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz2lm\" (UniqueName: \"kubernetes.io/projected/dafbb8df-19a1-46da-98f0-70f76c875f49-kube-api-access-sz2lm\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:18:45.731098 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:45.731090    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dafbb8df-19a1-46da-98f0-70f76c875f49-openshift-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:18:45.731098 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:45.731100    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dafbb8df-19a1-46da-98f0-70f76c875f49-maas-api-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:18:46.393999 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:46.393967    2578 generic.go:356] "Generic (PLEG): container finished" podID="dafbb8df-19a1-46da-98f0-70f76c875f49" containerID="8c1968dfba947e74d2278c9ab04211ef2ecf906b640037c3ad7ce24c05db4959" exitCode=0
Jul 27 20:18:46.394428 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:46.394015    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"
Jul 27 20:18:46.394428 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:46.394068    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw" event={"ID":"dafbb8df-19a1-46da-98f0-70f76c875f49","Type":"ContainerDied","Data":"8c1968dfba947e74d2278c9ab04211ef2ecf906b640037c3ad7ce24c05db4959"}
Jul 27 20:18:46.394428 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:46.394118    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw" event={"ID":"dafbb8df-19a1-46da-98f0-70f76c875f49","Type":"ContainerDied","Data":"bad0ccd6c67b038a417b6729df557e73a862af651f71e54c03bb943d638a1440"}
Jul 27 20:18:46.394428 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:46.394140    2578 scope.go:117] "RemoveContainer" containerID="8c1968dfba947e74d2278c9ab04211ef2ecf906b640037c3ad7ce24c05db4959"
Jul 27 20:18:46.403107 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:46.403087    2578 scope.go:117] "RemoveContainer" containerID="8c1968dfba947e74d2278c9ab04211ef2ecf906b640037c3ad7ce24c05db4959"
Jul 27 20:18:46.403393 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:18:46.403375    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c1968dfba947e74d2278c9ab04211ef2ecf906b640037c3ad7ce24c05db4959\": container with ID starting with 8c1968dfba947e74d2278c9ab04211ef2ecf906b640037c3ad7ce24c05db4959 not found: ID does not exist" containerID="8c1968dfba947e74d2278c9ab04211ef2ecf906b640037c3ad7ce24c05db4959"
Jul 27 20:18:46.403439 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:46.403402    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c1968dfba947e74d2278c9ab04211ef2ecf906b640037c3ad7ce24c05db4959"} err="failed to get container status \"8c1968dfba947e74d2278c9ab04211ef2ecf906b640037c3ad7ce24c05db4959\": rpc error: code = NotFound desc = could not find container \"8c1968dfba947e74d2278c9ab04211ef2ecf906b640037c3ad7ce24c05db4959\": container with ID starting with 8c1968dfba947e74d2278c9ab04211ef2ecf906b640037c3ad7ce24c05db4959 not found: ID does not exist"
Jul 27 20:18:46.414930 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:46.414907    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"]
Jul 27 20:18:46.418441 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:46.418421    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-018406-57d8bc88c5-jdlfw"]
Jul 27 20:18:47.383979 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:47.383940    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dafbb8df-19a1-46da-98f0-70f76c875f49" path="/var/lib/kubelet/pods/dafbb8df-19a1-46da-98f0-70f76c875f49/volumes"
Jul 27 20:18:54.774263 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:18:54.774226    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:19:50.949159 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:50.949125    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"]
Jul 27 20:19:50.949765 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:50.949356    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn" podUID="acbcdeb4-1ff5-415f-91ba-9a75849707b4" containerName="maas-api" containerID="cri-o://e25a22b2743811e48fbac84cf3556dbbaac8d86bc3920d688c421895c7d87a3c" gracePeriod=30
Jul 27 20:19:51.204447 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.204379    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"
Jul 27 20:19:51.303850 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.303822    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbrlv\" (UniqueName: \"kubernetes.io/projected/acbcdeb4-1ff5-415f-91ba-9a75849707b4-kube-api-access-rbrlv\") pod \"acbcdeb4-1ff5-415f-91ba-9a75849707b4\" (UID: \"acbcdeb4-1ff5-415f-91ba-9a75849707b4\") "
Jul 27 20:19:51.304002 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.303878    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acbcdeb4-1ff5-415f-91ba-9a75849707b4-openshift-service-ca\") pod \"acbcdeb4-1ff5-415f-91ba-9a75849707b4\" (UID: \"acbcdeb4-1ff5-415f-91ba-9a75849707b4\") "
Jul 27 20:19:51.304002 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.303924    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acbcdeb4-1ff5-415f-91ba-9a75849707b4-maas-api-tls\") pod \"acbcdeb4-1ff5-415f-91ba-9a75849707b4\" (UID: \"acbcdeb4-1ff5-415f-91ba-9a75849707b4\") "
Jul 27 20:19:51.304211 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.304190    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acbcdeb4-1ff5-415f-91ba-9a75849707b4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "acbcdeb4-1ff5-415f-91ba-9a75849707b4" (UID: "acbcdeb4-1ff5-415f-91ba-9a75849707b4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:19:51.306117 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.306081    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acbcdeb4-1ff5-415f-91ba-9a75849707b4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "acbcdeb4-1ff5-415f-91ba-9a75849707b4" (UID: "acbcdeb4-1ff5-415f-91ba-9a75849707b4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:19:51.306245 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.306149    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acbcdeb4-1ff5-415f-91ba-9a75849707b4-kube-api-access-rbrlv" (OuterVolumeSpecName: "kube-api-access-rbrlv") pod "acbcdeb4-1ff5-415f-91ba-9a75849707b4" (UID: "acbcdeb4-1ff5-415f-91ba-9a75849707b4"). InnerVolumeSpecName "kube-api-access-rbrlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:19:51.405401 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.405369    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acbcdeb4-1ff5-415f-91ba-9a75849707b4-maas-api-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:19:51.405401 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.405403    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbrlv\" (UniqueName: \"kubernetes.io/projected/acbcdeb4-1ff5-415f-91ba-9a75849707b4-kube-api-access-rbrlv\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:19:51.405401 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.405412    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acbcdeb4-1ff5-415f-91ba-9a75849707b4-openshift-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:19:51.717963 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.717924    2578 generic.go:356] "Generic (PLEG): container finished" podID="acbcdeb4-1ff5-415f-91ba-9a75849707b4" containerID="e25a22b2743811e48fbac84cf3556dbbaac8d86bc3920d688c421895c7d87a3c" exitCode=0
Jul 27 20:19:51.718147 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.717983    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"
Jul 27 20:19:51.718147 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.717996    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn" event={"ID":"acbcdeb4-1ff5-415f-91ba-9a75849707b4","Type":"ContainerDied","Data":"e25a22b2743811e48fbac84cf3556dbbaac8d86bc3920d688c421895c7d87a3c"}
Jul 27 20:19:51.718147 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.718039    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn" event={"ID":"acbcdeb4-1ff5-415f-91ba-9a75849707b4","Type":"ContainerDied","Data":"dbe7d2e4133402296134f73c2f419ed7ee20e664407235727e3442b9814d6b63"}
Jul 27 20:19:51.718147 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.718075    2578 scope.go:117] "RemoveContainer" containerID="e25a22b2743811e48fbac84cf3556dbbaac8d86bc3920d688c421895c7d87a3c"
Jul 27 20:19:51.726476 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.726460    2578 scope.go:117] "RemoveContainer" containerID="e25a22b2743811e48fbac84cf3556dbbaac8d86bc3920d688c421895c7d87a3c"
Jul 27 20:19:51.726722 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:19:51.726702    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e25a22b2743811e48fbac84cf3556dbbaac8d86bc3920d688c421895c7d87a3c\": container with ID starting with e25a22b2743811e48fbac84cf3556dbbaac8d86bc3920d688c421895c7d87a3c not found: ID does not exist" containerID="e25a22b2743811e48fbac84cf3556dbbaac8d86bc3920d688c421895c7d87a3c"
Jul 27 20:19:51.726765 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.726735    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e25a22b2743811e48fbac84cf3556dbbaac8d86bc3920d688c421895c7d87a3c"} err="failed to get container status \"e25a22b2743811e48fbac84cf3556dbbaac8d86bc3920d688c421895c7d87a3c\": rpc error: code = NotFound desc = could not find container \"e25a22b2743811e48fbac84cf3556dbbaac8d86bc3920d688c421895c7d87a3c\": container with ID starting with e25a22b2743811e48fbac84cf3556dbbaac8d86bc3920d688c421895c7d87a3c not found: ID does not exist"
Jul 27 20:19:51.733417 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.733366    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"]
Jul 27 20:19:51.735148 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:51.735127    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-933254-57bb8b87d9-dq4tn"]
Jul 27 20:19:53.383044 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:53.383010    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acbcdeb4-1ff5-415f-91ba-9a75849707b4" path="/var/lib/kubelet/pods/acbcdeb4-1ff5-415f-91ba-9a75849707b4/volumes"
Jul 27 20:19:54.467990 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:54.467952    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:19:57.980039 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:57.980006    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"]
Jul 27 20:19:57.980538 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:19:57.980261    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5" podUID="0dfdc3df-ce6b-44d1-a67c-83170520a907" containerName="istio-proxy" containerID="cri-o://cc2e08b6e1b12aa62c1c2df3a76eab400aab6e5589def6f10c0e293b93b7ccc2" gracePeriod=30
Jul 27 20:20:00.156655 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:00.156613    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 20:20:00.157030 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:00.156692    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5" podUID="0dfdc3df-ce6b-44d1-a67c-83170520a907" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 20:20:03.242044 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.241985    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:20:03.309507 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.309475    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dfdc3df-ce6b-44d1-a67c-83170520a907-istiod-ca-cert\") pod \"0dfdc3df-ce6b-44d1-a67c-83170520a907\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") "
Jul 27 20:20:03.309507 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.309508    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-token\") pod \"0dfdc3df-ce6b-44d1-a67c-83170520a907\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") "
Jul 27 20:20:03.309831 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.309548    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-envoy\") pod \"0dfdc3df-ce6b-44d1-a67c-83170520a907\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") "
Jul 27 20:20:03.309831 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.309650    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dwjv\" (UniqueName: \"kubernetes.io/projected/0dfdc3df-ce6b-44d1-a67c-83170520a907-kube-api-access-4dwjv\") pod \"0dfdc3df-ce6b-44d1-a67c-83170520a907\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") "
Jul 27 20:20:03.309831 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.309746    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-workload-certs\") pod \"0dfdc3df-ce6b-44d1-a67c-83170520a907\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") "
Jul 27 20:20:03.309831 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.309787    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-credential-socket\") pod \"0dfdc3df-ce6b-44d1-a67c-83170520a907\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") "
Jul 27 20:20:03.310087 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.309844    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-data\") pod \"0dfdc3df-ce6b-44d1-a67c-83170520a907\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") "
Jul 27 20:20:03.310087 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.309868    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-podinfo\") pod \"0dfdc3df-ce6b-44d1-a67c-83170520a907\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") "
Jul 27 20:20:03.310087 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.309922    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-workload-socket\") pod \"0dfdc3df-ce6b-44d1-a67c-83170520a907\" (UID: \"0dfdc3df-ce6b-44d1-a67c-83170520a907\") "
Jul 27 20:20:03.310087 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.309858    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dfdc3df-ce6b-44d1-a67c-83170520a907-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0dfdc3df-ce6b-44d1-a67c-83170520a907" (UID: "0dfdc3df-ce6b-44d1-a67c-83170520a907"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:20:03.310087 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.310014    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0dfdc3df-ce6b-44d1-a67c-83170520a907" (UID: "0dfdc3df-ce6b-44d1-a67c-83170520a907"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:03.310363 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.310208    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0dfdc3df-ce6b-44d1-a67c-83170520a907" (UID: "0dfdc3df-ce6b-44d1-a67c-83170520a907"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:03.310363 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.310325    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0dfdc3df-ce6b-44d1-a67c-83170520a907" (UID: "0dfdc3df-ce6b-44d1-a67c-83170520a907"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:03.310363 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.310320    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-workload-certs\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:03.310699 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.310433    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-workload-socket\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:03.310699 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.310512    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dfdc3df-ce6b-44d1-a67c-83170520a907-istiod-ca-cert\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:03.310699 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.310620    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-data" (OuterVolumeSpecName: "istio-data") pod "0dfdc3df-ce6b-44d1-a67c-83170520a907" (UID: "0dfdc3df-ce6b-44d1-a67c-83170520a907"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:03.311942 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.311919    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-token" (OuterVolumeSpecName: "istio-token") pod "0dfdc3df-ce6b-44d1-a67c-83170520a907" (UID: "0dfdc3df-ce6b-44d1-a67c-83170520a907"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:20:03.312045 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.312011    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dfdc3df-ce6b-44d1-a67c-83170520a907-kube-api-access-4dwjv" (OuterVolumeSpecName: "kube-api-access-4dwjv") pod "0dfdc3df-ce6b-44d1-a67c-83170520a907" (UID: "0dfdc3df-ce6b-44d1-a67c-83170520a907"). InnerVolumeSpecName "kube-api-access-4dwjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:20:03.312403 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.312381    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0dfdc3df-ce6b-44d1-a67c-83170520a907" (UID: "0dfdc3df-ce6b-44d1-a67c-83170520a907"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:03.312500 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.312389    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0dfdc3df-ce6b-44d1-a67c-83170520a907" (UID: "0dfdc3df-ce6b-44d1-a67c-83170520a907"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:20:03.411390 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.411365    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-envoy\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:03.411390 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.411390    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dwjv\" (UniqueName: \"kubernetes.io/projected/0dfdc3df-ce6b-44d1-a67c-83170520a907-kube-api-access-4dwjv\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:03.411560 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.411400    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-credential-socket\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:03.411560 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.411409    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-data\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:03.411560 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.411417    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-podinfo\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:03.411560 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.411425    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dfdc3df-ce6b-44d1-a67c-83170520a907-istio-token\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:03.777223 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.777192    2578 generic.go:356] "Generic (PLEG): container finished" podID="0dfdc3df-ce6b-44d1-a67c-83170520a907" containerID="cc2e08b6e1b12aa62c1c2df3a76eab400aab6e5589def6f10c0e293b93b7ccc2" exitCode=0
Jul 27 20:20:03.777398 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.777257    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"
Jul 27 20:20:03.777398 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.777274    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5" event={"ID":"0dfdc3df-ce6b-44d1-a67c-83170520a907","Type":"ContainerDied","Data":"cc2e08b6e1b12aa62c1c2df3a76eab400aab6e5589def6f10c0e293b93b7ccc2"}
Jul 27 20:20:03.777398 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.777359    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5" event={"ID":"0dfdc3df-ce6b-44d1-a67c-83170520a907","Type":"ContainerDied","Data":"5597718a0a6041b05f206c3e93f35e02e63579af027edd3eb6fb39df4e708d38"}
Jul 27 20:20:03.777504 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.777398    2578 scope.go:117] "RemoveContainer" containerID="cc2e08b6e1b12aa62c1c2df3a76eab400aab6e5589def6f10c0e293b93b7ccc2"
Jul 27 20:20:03.786384 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.786327    2578 scope.go:117] "RemoveContainer" containerID="96472fb5661490dd55c453016807f667ad448538d844a7b3b25bccd314b844f7"
Jul 27 20:20:03.795290 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.795268    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"]
Jul 27 20:20:03.795513 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.795500    2578 scope.go:117] "RemoveContainer" containerID="cc2e08b6e1b12aa62c1c2df3a76eab400aab6e5589def6f10c0e293b93b7ccc2"
Jul 27 20:20:03.795760 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:20:03.795740    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc2e08b6e1b12aa62c1c2df3a76eab400aab6e5589def6f10c0e293b93b7ccc2\": container with ID starting with cc2e08b6e1b12aa62c1c2df3a76eab400aab6e5589def6f10c0e293b93b7ccc2 not found: ID does not exist" containerID="cc2e08b6e1b12aa62c1c2df3a76eab400aab6e5589def6f10c0e293b93b7ccc2"
Jul 27 20:20:03.795834 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.795773    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc2e08b6e1b12aa62c1c2df3a76eab400aab6e5589def6f10c0e293b93b7ccc2"} err="failed to get container status \"cc2e08b6e1b12aa62c1c2df3a76eab400aab6e5589def6f10c0e293b93b7ccc2\": rpc error: code = NotFound desc = could not find container \"cc2e08b6e1b12aa62c1c2df3a76eab400aab6e5589def6f10c0e293b93b7ccc2\": container with ID starting with cc2e08b6e1b12aa62c1c2df3a76eab400aab6e5589def6f10c0e293b93b7ccc2 not found: ID does not exist"
Jul 27 20:20:03.795834 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.795797    2578 scope.go:117] "RemoveContainer" containerID="96472fb5661490dd55c453016807f667ad448538d844a7b3b25bccd314b844f7"
Jul 27 20:20:03.796026 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:20:03.796007    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96472fb5661490dd55c453016807f667ad448538d844a7b3b25bccd314b844f7\": container with ID starting with 96472fb5661490dd55c453016807f667ad448538d844a7b3b25bccd314b844f7 not found: ID does not exist" containerID="96472fb5661490dd55c453016807f667ad448538d844a7b3b25bccd314b844f7"
Jul 27 20:20:03.796082 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.796033    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96472fb5661490dd55c453016807f667ad448538d844a7b3b25bccd314b844f7"} err="failed to get container status \"96472fb5661490dd55c453016807f667ad448538d844a7b3b25bccd314b844f7\": rpc error: code = NotFound desc = could not find container \"96472fb5661490dd55c453016807f667ad448538d844a7b3b25bccd314b844f7\": container with ID starting with 96472fb5661490dd55c453016807f667ad448538d844a7b3b25bccd314b844f7 not found: ID does not exist"
Jul 27 20:20:03.799120 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:03.799094    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-933254-openshift-default-5487f77964-q4dh5"]
Jul 27 20:20:05.382616 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:05.382586    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dfdc3df-ce6b-44d1-a67c-83170520a907" path="/var/lib/kubelet/pods/0dfdc3df-ce6b-44d1-a67c-83170520a907/volumes"
Jul 27 20:20:08.762420 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:08.762388    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"]
Jul 27 20:20:08.762916 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:08.762632    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl" podUID="aefef7ba-d470-4799-a7db-a86c4a6a8d96" containerName="maas-api" containerID="cri-o://d4ea032b52b9e6f25767b6c55d6b10fb663b52fcd4374452341dd167ba042b4b" gracePeriod=30
Jul 27 20:20:08.789713 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:08.789686    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d3c546-29753055-zqp4g"]
Jul 27 20:20:08.793804 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:08.793782    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d3c546-29753055-zqp4g"]
Jul 27 20:20:09.012139 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.012117    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"
Jul 27 20:20:09.163160 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.163127    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aefef7ba-d470-4799-a7db-a86c4a6a8d96-maas-api-tls\") pod \"aefef7ba-d470-4799-a7db-a86c4a6a8d96\" (UID: \"aefef7ba-d470-4799-a7db-a86c4a6a8d96\") "
Jul 27 20:20:09.163313 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.163181    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aefef7ba-d470-4799-a7db-a86c4a6a8d96-openshift-service-ca\") pod \"aefef7ba-d470-4799-a7db-a86c4a6a8d96\" (UID: \"aefef7ba-d470-4799-a7db-a86c4a6a8d96\") "
Jul 27 20:20:09.163313 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.163258    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6s8m\" (UniqueName: \"kubernetes.io/projected/aefef7ba-d470-4799-a7db-a86c4a6a8d96-kube-api-access-w6s8m\") pod \"aefef7ba-d470-4799-a7db-a86c4a6a8d96\" (UID: \"aefef7ba-d470-4799-a7db-a86c4a6a8d96\") "
Jul 27 20:20:09.163569 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.163541    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aefef7ba-d470-4799-a7db-a86c4a6a8d96-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aefef7ba-d470-4799-a7db-a86c4a6a8d96" (UID: "aefef7ba-d470-4799-a7db-a86c4a6a8d96"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:20:09.165408 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.165384    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aefef7ba-d470-4799-a7db-a86c4a6a8d96-kube-api-access-w6s8m" (OuterVolumeSpecName: "kube-api-access-w6s8m") pod "aefef7ba-d470-4799-a7db-a86c4a6a8d96" (UID: "aefef7ba-d470-4799-a7db-a86c4a6a8d96"). InnerVolumeSpecName "kube-api-access-w6s8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:20:09.165488 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.165471    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aefef7ba-d470-4799-a7db-a86c4a6a8d96-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aefef7ba-d470-4799-a7db-a86c4a6a8d96" (UID: "aefef7ba-d470-4799-a7db-a86c4a6a8d96"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:20:09.264382 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.264348    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aefef7ba-d470-4799-a7db-a86c4a6a8d96-maas-api-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:09.264382 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.264376    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aefef7ba-d470-4799-a7db-a86c4a6a8d96-openshift-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:09.264382 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.264387    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6s8m\" (UniqueName: \"kubernetes.io/projected/aefef7ba-d470-4799-a7db-a86c4a6a8d96-kube-api-access-w6s8m\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:09.382693 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.382658    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15ce9349-eb1c-4cde-a3b5-faa181d30d1c" path="/var/lib/kubelet/pods/15ce9349-eb1c-4cde-a3b5-faa181d30d1c/volumes"
Jul 27 20:20:09.811526 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.811492    2578 generic.go:356] "Generic (PLEG): container finished" podID="aefef7ba-d470-4799-a7db-a86c4a6a8d96" containerID="d4ea032b52b9e6f25767b6c55d6b10fb663b52fcd4374452341dd167ba042b4b" exitCode=0
Jul 27 20:20:09.811996 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.811564    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"
Jul 27 20:20:09.811996 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.811607    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl" event={"ID":"aefef7ba-d470-4799-a7db-a86c4a6a8d96","Type":"ContainerDied","Data":"d4ea032b52b9e6f25767b6c55d6b10fb663b52fcd4374452341dd167ba042b4b"}
Jul 27 20:20:09.811996 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.811675    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl" event={"ID":"aefef7ba-d470-4799-a7db-a86c4a6a8d96","Type":"ContainerDied","Data":"6cb2afb1ab8e8347a87aea4d0e51d9f625b423bb1597ec706b9ac38cb74374f5"}
Jul 27 20:20:09.811996 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.811698    2578 scope.go:117] "RemoveContainer" containerID="d4ea032b52b9e6f25767b6c55d6b10fb663b52fcd4374452341dd167ba042b4b"
Jul 27 20:20:09.820565 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.820535    2578 scope.go:117] "RemoveContainer" containerID="d4ea032b52b9e6f25767b6c55d6b10fb663b52fcd4374452341dd167ba042b4b"
Jul 27 20:20:09.820808 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:20:09.820790    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4ea032b52b9e6f25767b6c55d6b10fb663b52fcd4374452341dd167ba042b4b\": container with ID starting with d4ea032b52b9e6f25767b6c55d6b10fb663b52fcd4374452341dd167ba042b4b not found: ID does not exist" containerID="d4ea032b52b9e6f25767b6c55d6b10fb663b52fcd4374452341dd167ba042b4b"
Jul 27 20:20:09.820869 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.820820    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4ea032b52b9e6f25767b6c55d6b10fb663b52fcd4374452341dd167ba042b4b"} err="failed to get container status \"d4ea032b52b9e6f25767b6c55d6b10fb663b52fcd4374452341dd167ba042b4b\": rpc error: code = NotFound desc = could not find container \"d4ea032b52b9e6f25767b6c55d6b10fb663b52fcd4374452341dd167ba042b4b\": container with ID starting with d4ea032b52b9e6f25767b6c55d6b10fb663b52fcd4374452341dd167ba042b4b not found: ID does not exist"
Jul 27 20:20:09.827345 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.827321    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"]
Jul 27 20:20:09.830787 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:09.830767    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d3c546-5c796665f-b9wxl"]
Jul 27 20:20:11.383210 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:11.383179    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aefef7ba-d470-4799-a7db-a86c4a6a8d96" path="/var/lib/kubelet/pods/aefef7ba-d470-4799-a7db-a86c4a6a8d96/volumes"
Jul 27 20:20:11.675358 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:11.675277    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:20:15.744471 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:15.744377    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"]
Jul 27 20:20:15.744922 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:15.744622    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5" podUID="a8b51fb7-2475-4a76-a8de-9555545f17ce" containerName="istio-proxy" containerID="cri-o://5683f97dccd68b654df997d8481f088645f780e4b20c9b60db536d849ca6aa86" gracePeriod=30
Jul 27 20:20:16.095458 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095427    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh"]
Jul 27 20:20:16.095805 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095792    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acbcdeb4-1ff5-415f-91ba-9a75849707b4" containerName="maas-api"
Jul 27 20:20:16.095851 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095807    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="acbcdeb4-1ff5-415f-91ba-9a75849707b4" containerName="maas-api"
Jul 27 20:20:16.095851 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095817    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6628edf-b29c-4909-a349-9d14bab3c8e8" containerName="revoke-keys"
Jul 27 20:20:16.095851 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095822    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6628edf-b29c-4909-a349-9d14bab3c8e8" containerName="revoke-keys"
Jul 27 20:20:16.095851 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095834    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dafbb8df-19a1-46da-98f0-70f76c875f49" containerName="maas-api"
Jul 27 20:20:16.095851 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095843    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dafbb8df-19a1-46da-98f0-70f76c875f49" containerName="maas-api"
Jul 27 20:20:16.096004 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095859    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dfdc3df-ce6b-44d1-a67c-83170520a907" containerName="istio-proxy"
Jul 27 20:20:16.096004 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095865    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dfdc3df-ce6b-44d1-a67c-83170520a907" containerName="istio-proxy"
Jul 27 20:20:16.096004 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095872    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dfdc3df-ce6b-44d1-a67c-83170520a907" containerName="istio-proxy"
Jul 27 20:20:16.096004 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095877    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dfdc3df-ce6b-44d1-a67c-83170520a907" containerName="istio-proxy"
Jul 27 20:20:16.096004 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095886    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aefef7ba-d470-4799-a7db-a86c4a6a8d96" containerName="maas-api"
Jul 27 20:20:16.096004 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095892    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aefef7ba-d470-4799-a7db-a86c4a6a8d96" containerName="maas-api"
Jul 27 20:20:16.096004 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095950    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="acbcdeb4-1ff5-415f-91ba-9a75849707b4" containerName="maas-api"
Jul 27 20:20:16.096004 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095957    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6628edf-b29c-4909-a349-9d14bab3c8e8" containerName="revoke-keys"
Jul 27 20:20:16.096004 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095962    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dafbb8df-19a1-46da-98f0-70f76c875f49" containerName="maas-api"
Jul 27 20:20:16.096004 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095969    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dfdc3df-ce6b-44d1-a67c-83170520a907" containerName="istio-proxy"
Jul 27 20:20:16.096004 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095974    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dfdc3df-ce6b-44d1-a67c-83170520a907" containerName="istio-proxy"
Jul 27 20:20:16.096004 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.095981    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aefef7ba-d470-4799-a7db-a86c4a6a8d96" containerName="maas-api"
Jul 27 20:20:16.100387 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.100367    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh"
Jul 27 20:20:16.102703 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.102680    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-875sf\""
Jul 27 20:20:16.106240 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.106217    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh"]
Jul 27 20:20:16.231571 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.231540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f639a5d9-2cd8-48ba-a5a4-a9a247e053e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh\" (UID: \"f639a5d9-2cd8-48ba-a5a4-a9a247e053e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh"
Jul 27 20:20:16.332368 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.332329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f639a5d9-2cd8-48ba-a5a4-a9a247e053e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh\" (UID: \"f639a5d9-2cd8-48ba-a5a4-a9a247e053e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh"
Jul 27 20:20:16.332955 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.332929    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f639a5d9-2cd8-48ba-a5a4-a9a247e053e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh\" (UID: \"f639a5d9-2cd8-48ba-a5a4-a9a247e053e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh"
Jul 27 20:20:16.411757 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.411682    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh"
Jul 27 20:20:16.541206 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.541177    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh"]
Jul 27 20:20:16.543683 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:20:16.543641    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf639a5d9_2cd8_48ba_a5a4_a9a247e053e0.slice/crio-beda083efef427804cacd2d256751c0128dc1ba03fb084941482b4d10954b550 WatchSource:0}: Error finding container beda083efef427804cacd2d256751c0128dc1ba03fb084941482b4d10954b550: Status 404 returned error can't find the container with id beda083efef427804cacd2d256751c0128dc1ba03fb084941482b4d10954b550
Jul 27 20:20:16.847388 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:16.847352    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh" event={"ID":"f639a5d9-2cd8-48ba-a5a4-a9a247e053e0","Type":"ContainerStarted","Data":"beda083efef427804cacd2d256751c0128dc1ba03fb084941482b4d10954b550"}
Jul 27 20:20:17.853347 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:17.853309    2578 generic.go:356] "Generic (PLEG): container finished" podID="f639a5d9-2cd8-48ba-a5a4-a9a247e053e0" containerID="1d8f0a122823d6f1825cae6649f7a34de96d9a2b71fb5df1c01026b6d0319b59" exitCode=0
Jul 27 20:20:17.853732 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:17.853388    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh" event={"ID":"f639a5d9-2cd8-48ba-a5a4-a9a247e053e0","Type":"ContainerDied","Data":"1d8f0a122823d6f1825cae6649f7a34de96d9a2b71fb5df1c01026b6d0319b59"}
Jul 27 20:20:18.983582 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:18.983558    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh"
Jul 27 20:20:19.156360 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:19.156284    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f639a5d9-2cd8-48ba-a5a4-a9a247e053e0-maas-api-service-ca\") pod \"f639a5d9-2cd8-48ba-a5a4-a9a247e053e0\" (UID: \"f639a5d9-2cd8-48ba-a5a4-a9a247e053e0\") "
Jul 27 20:20:19.156618 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:19.156596    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f639a5d9-2cd8-48ba-a5a4-a9a247e053e0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f639a5d9-2cd8-48ba-a5a4-a9a247e053e0" (UID: "f639a5d9-2cd8-48ba-a5a4-a9a247e053e0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:20:19.257537 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:19.257506    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f639a5d9-2cd8-48ba-a5a4-a9a247e053e0-maas-api-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:19.863977 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:19.863942    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh"
Jul 27 20:20:19.863977 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:19.863973    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh" event={"ID":"f639a5d9-2cd8-48ba-a5a4-a9a247e053e0","Type":"ContainerDied","Data":"beda083efef427804cacd2d256751c0128dc1ba03fb084941482b4d10954b550"}
Jul 27 20:20:19.864224 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:19.864019    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="beda083efef427804cacd2d256751c0128dc1ba03fb084941482b4d10954b550"
Jul 27 20:20:20.871317 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:20.871277    2578 generic.go:356] "Generic (PLEG): container finished" podID="a8b51fb7-2475-4a76-a8de-9555545f17ce" containerID="5683f97dccd68b654df997d8481f088645f780e4b20c9b60db536d849ca6aa86" exitCode=0
Jul 27 20:20:20.871676 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:20.871342    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5" event={"ID":"a8b51fb7-2475-4a76-a8de-9555545f17ce","Type":"ContainerDied","Data":"5683f97dccd68b654df997d8481f088645f780e4b20c9b60db536d849ca6aa86"}
Jul 27 20:20:20.871676 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:20.871432    2578 scope.go:117] "RemoveContainer" containerID="66775bb4707cad7285a557137709664edcaa51ba768371d604b3a15ea828a4ba"
Jul 27 20:20:20.998479 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:20.998455    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:20:21.172359 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.172306    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-token\") pod \"a8b51fb7-2475-4a76-a8de-9555545f17ce\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") "
Jul 27 20:20:21.172359 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.172360    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-workload-certs\") pod \"a8b51fb7-2475-4a76-a8de-9555545f17ce\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") "
Jul 27 20:20:21.172625 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.172383    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-podinfo\") pod \"a8b51fb7-2475-4a76-a8de-9555545f17ce\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") "
Jul 27 20:20:21.172625 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.172552    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lksw\" (UniqueName: \"kubernetes.io/projected/a8b51fb7-2475-4a76-a8de-9555545f17ce-kube-api-access-4lksw\") pod \"a8b51fb7-2475-4a76-a8de-9555545f17ce\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") "
Jul 27 20:20:21.172625 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.172621    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-envoy\") pod \"a8b51fb7-2475-4a76-a8de-9555545f17ce\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") "
Jul 27 20:20:21.172788 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.172635    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a8b51fb7-2475-4a76-a8de-9555545f17ce" (UID: "a8b51fb7-2475-4a76-a8de-9555545f17ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:21.172788 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.172663    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8b51fb7-2475-4a76-a8de-9555545f17ce-istiod-ca-cert\") pod \"a8b51fb7-2475-4a76-a8de-9555545f17ce\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") "
Jul 27 20:20:21.172788 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.172714    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-workload-socket\") pod \"a8b51fb7-2475-4a76-a8de-9555545f17ce\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") "
Jul 27 20:20:21.172788 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.172739    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-data\") pod \"a8b51fb7-2475-4a76-a8de-9555545f17ce\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") "
Jul 27 20:20:21.172989 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.172811    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-credential-socket\") pod \"a8b51fb7-2475-4a76-a8de-9555545f17ce\" (UID: \"a8b51fb7-2475-4a76-a8de-9555545f17ce\") "
Jul 27 20:20:21.173405 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.173116    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a8b51fb7-2475-4a76-a8de-9555545f17ce" (UID: "a8b51fb7-2475-4a76-a8de-9555545f17ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:21.173405 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.173127    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-workload-certs\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:21.173405 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.173224    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8b51fb7-2475-4a76-a8de-9555545f17ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a8b51fb7-2475-4a76-a8de-9555545f17ce" (UID: "a8b51fb7-2475-4a76-a8de-9555545f17ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:20:21.173666 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.173312    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a8b51fb7-2475-4a76-a8de-9555545f17ce" (UID: "a8b51fb7-2475-4a76-a8de-9555545f17ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:21.173912 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.173881    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "a8b51fb7-2475-4a76-a8de-9555545f17ce" (UID: "a8b51fb7-2475-4a76-a8de-9555545f17ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:21.174759 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.174727    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "a8b51fb7-2475-4a76-a8de-9555545f17ce" (UID: "a8b51fb7-2475-4a76-a8de-9555545f17ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:20:21.174861 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.174836    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8b51fb7-2475-4a76-a8de-9555545f17ce-kube-api-access-4lksw" (OuterVolumeSpecName: "kube-api-access-4lksw") pod "a8b51fb7-2475-4a76-a8de-9555545f17ce" (UID: "a8b51fb7-2475-4a76-a8de-9555545f17ce"). InnerVolumeSpecName "kube-api-access-4lksw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:20:21.174910 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.174877    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a8b51fb7-2475-4a76-a8de-9555545f17ce" (UID: "a8b51fb7-2475-4a76-a8de-9555545f17ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:20:21.174957 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.174943    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a8b51fb7-2475-4a76-a8de-9555545f17ce" (UID: "a8b51fb7-2475-4a76-a8de-9555545f17ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:20:21.273663 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.273618    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-credential-socket\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:21.273663 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.273659    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-token\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:21.273663 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.273668    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-podinfo\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:21.273663 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.273677    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lksw\" (UniqueName: \"kubernetes.io/projected/a8b51fb7-2475-4a76-a8de-9555545f17ce-kube-api-access-4lksw\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:21.273926 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.273686    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-envoy\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:21.273926 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.273694    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8b51fb7-2475-4a76-a8de-9555545f17ce-istiod-ca-cert\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:21.273926 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.273702    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-workload-socket\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:21.273926 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.273709    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8b51fb7-2475-4a76-a8de-9555545f17ce-istio-data\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:21.877153 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.877124    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"
Jul 27 20:20:21.877607 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.877121    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5" event={"ID":"a8b51fb7-2475-4a76-a8de-9555545f17ce","Type":"ContainerDied","Data":"1539e8bc7d49411b560daa5ce6783dc91de5fb7bfabf978afe99d4a152203fae"}
Jul 27 20:20:21.877607 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.877258    2578 scope.go:117] "RemoveContainer" containerID="5683f97dccd68b654df997d8481f088645f780e4b20c9b60db536d849ca6aa86"
Jul 27 20:20:21.894333 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.894302    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"]
Jul 27 20:20:21.899300 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:21.899275    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-d3c546-openshift-default-7989484756-cmjn5"]
Jul 27 20:20:23.383195 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:23.383163    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8b51fb7-2475-4a76-a8de-9555545f17ce" path="/var/lib/kubelet/pods/a8b51fb7-2475-4a76-a8de-9555545f17ce/volumes"
Jul 27 20:20:26.467982 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.467951    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"]
Jul 27 20:20:26.468460 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.468256    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc" podUID="62295d0d-4768-4efa-aa0c-938204ecee11" containerName="maas-api" containerID="cri-o://482ab01b7e595d0576d3a90ff129cfda39f50261f5cb7a6a864228e21dd003e0" gracePeriod=30
Jul 27 20:20:26.494211 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.494134    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-73ce16-29753055-qg2jq"]
Jul 27 20:20:26.499132 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.496576    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-73ce16-29753055-qg2jq"]
Jul 27 20:20:26.659215 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.659174    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh"]
Jul 27 20:20:26.660746 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.660719    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-73ce16-ddfbh"]
Jul 27 20:20:26.716067 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.716028    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"
Jul 27 20:20:26.814118 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.814094    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62295d0d-4768-4efa-aa0c-938204ecee11-openshift-service-ca\") pod \"62295d0d-4768-4efa-aa0c-938204ecee11\" (UID: \"62295d0d-4768-4efa-aa0c-938204ecee11\") "
Jul 27 20:20:26.814305 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.814129    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl578\" (UniqueName: \"kubernetes.io/projected/62295d0d-4768-4efa-aa0c-938204ecee11-kube-api-access-gl578\") pod \"62295d0d-4768-4efa-aa0c-938204ecee11\" (UID: \"62295d0d-4768-4efa-aa0c-938204ecee11\") "
Jul 27 20:20:26.814305 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.814197    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62295d0d-4768-4efa-aa0c-938204ecee11-maas-api-tls\") pod \"62295d0d-4768-4efa-aa0c-938204ecee11\" (UID: \"62295d0d-4768-4efa-aa0c-938204ecee11\") "
Jul 27 20:20:26.814482 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.814454    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62295d0d-4768-4efa-aa0c-938204ecee11-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "62295d0d-4768-4efa-aa0c-938204ecee11" (UID: "62295d0d-4768-4efa-aa0c-938204ecee11"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:20:26.816446 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.816416    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62295d0d-4768-4efa-aa0c-938204ecee11-kube-api-access-gl578" (OuterVolumeSpecName: "kube-api-access-gl578") pod "62295d0d-4768-4efa-aa0c-938204ecee11" (UID: "62295d0d-4768-4efa-aa0c-938204ecee11"). InnerVolumeSpecName "kube-api-access-gl578". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:20:26.816576 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.816476    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62295d0d-4768-4efa-aa0c-938204ecee11-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "62295d0d-4768-4efa-aa0c-938204ecee11" (UID: "62295d0d-4768-4efa-aa0c-938204ecee11"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:20:26.901737 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.901707    2578 generic.go:356] "Generic (PLEG): container finished" podID="62295d0d-4768-4efa-aa0c-938204ecee11" containerID="482ab01b7e595d0576d3a90ff129cfda39f50261f5cb7a6a864228e21dd003e0" exitCode=0
Jul 27 20:20:26.901927 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.901751    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"
Jul 27 20:20:26.901927 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.901757    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc" event={"ID":"62295d0d-4768-4efa-aa0c-938204ecee11","Type":"ContainerDied","Data":"482ab01b7e595d0576d3a90ff129cfda39f50261f5cb7a6a864228e21dd003e0"}
Jul 27 20:20:26.901927 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.901825    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc" event={"ID":"62295d0d-4768-4efa-aa0c-938204ecee11","Type":"ContainerDied","Data":"551d6ae6f92826bca092419b110667dd9cba08663ec38c04b0b13f4f2f609967"}
Jul 27 20:20:26.901927 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.901847    2578 scope.go:117] "RemoveContainer" containerID="482ab01b7e595d0576d3a90ff129cfda39f50261f5cb7a6a864228e21dd003e0"
Jul 27 20:20:26.910919 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.910901    2578 scope.go:117] "RemoveContainer" containerID="482ab01b7e595d0576d3a90ff129cfda39f50261f5cb7a6a864228e21dd003e0"
Jul 27 20:20:26.911245 ip-10-0-142-24 kubenswrapper[2578]: E0727 20:20:26.911225    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"482ab01b7e595d0576d3a90ff129cfda39f50261f5cb7a6a864228e21dd003e0\": container with ID starting with 482ab01b7e595d0576d3a90ff129cfda39f50261f5cb7a6a864228e21dd003e0 not found: ID does not exist" containerID="482ab01b7e595d0576d3a90ff129cfda39f50261f5cb7a6a864228e21dd003e0"
Jul 27 20:20:26.911300 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.911252    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"482ab01b7e595d0576d3a90ff129cfda39f50261f5cb7a6a864228e21dd003e0"} err="failed to get container status \"482ab01b7e595d0576d3a90ff129cfda39f50261f5cb7a6a864228e21dd003e0\": rpc error: code = NotFound desc = could not find container \"482ab01b7e595d0576d3a90ff129cfda39f50261f5cb7a6a864228e21dd003e0\": container with ID starting with 482ab01b7e595d0576d3a90ff129cfda39f50261f5cb7a6a864228e21dd003e0 not found: ID does not exist"
Jul 27 20:20:26.915562 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.915543    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62295d0d-4768-4efa-aa0c-938204ecee11-maas-api-tls\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:26.915619 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.915566    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62295d0d-4768-4efa-aa0c-938204ecee11-openshift-service-ca\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:26.915619 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.915575    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl578\" (UniqueName: \"kubernetes.io/projected/62295d0d-4768-4efa-aa0c-938204ecee11-kube-api-access-gl578\") on node \"ip-10-0-142-24.ec2.internal\" DevicePath \"\""
Jul 27 20:20:26.922570 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.922547    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"]
Jul 27 20:20:26.925894 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:26.925872    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-73ce16-65f9888d8b-v68jc"]
Jul 27 20:20:27.383043 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:27.382998    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62295d0d-4768-4efa-aa0c-938204ecee11" path="/var/lib/kubelet/pods/62295d0d-4768-4efa-aa0c-938204ecee11/volumes"
Jul 27 20:20:27.383391 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:27.383372    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0be507e-b74c-42b4-ae41-aecd8181c3b2" path="/var/lib/kubelet/pods/e0be507e-b74c-42b4-ae41-aecd8181c3b2/volumes"
Jul 27 20:20:27.383681 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:27.383664    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f639a5d9-2cd8-48ba-a5a4-a9a247e053e0" path="/var/lib/kubelet/pods/f639a5d9-2cd8-48ba-a5a4-a9a247e053e0/volumes"
Jul 27 20:20:29.474496 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:29.474467    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c84hg"]
Jul 27 20:20:40.019815 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:40.019785    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz_041583f0-545e-47f7-b7c1-e885851f4aed/copy-manifests/0.log"
Jul 27 20:20:40.027542 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:40.027520    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz_041583f0-545e-47f7-b7c1-e885851f4aed/manager/0.log"
Jul 27 20:20:40.593182 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:40.593154    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29753025-9t9nd_fd90b24b-3a32-4277-9690-a51b20a24dbf/cleanup/0.log"
Jul 27 20:20:40.702000 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:40.701971    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29753040-xvs6v_6fa57c2e-da35-4080-bb29-d3d7792de8c2/cleanup/0.log"
Jul 27 20:20:40.809887 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:40.809860    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29753055-q9cw8_00ac1b93-2b2a-4559-9ca5-5ceeb1474f6f/cleanup/0.log"
Jul 27 20:20:42.859630 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:42.859600    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-c84hg_e90712a2-b471-44e0-b347-91de18834100/limitador/0.log"
Jul 27 20:20:43.303050 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:43.303021    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c58mpl_f4aafb2c-fd20-4885-a53e-9d59ec2dbc91/istio-proxy/0.log"
Jul 27 20:20:43.416860 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:43.416828    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mp89s_3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47/discovery/0.log"
Jul 27 20:20:44.633243 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:44.633212    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-mkcgm_8fb13281-5105-4025-a107-cbec9d821391/main/0.log"
Jul 27 20:20:52.688333 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:52.688302    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-m8s7m_4493ab60-935e-4993-800b-a69eccd1cc16/global-pull-secret-syncer/0.log"
Jul 27 20:20:52.797861 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:52.797828    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xgzv4_e3ca0d2d-d38c-46cb-9d80-ad52098df555/konnectivity-agent/0.log"
Jul 27 20:20:52.861202 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:52.861173    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-24.ec2.internal_162f7fc2d5317b26ca4e84b4b15f251a/haproxy/0.log"
Jul 27 20:20:57.790546 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:57.790514    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-c84hg_e90712a2-b471-44e0-b347-91de18834100/limitador/0.log"
Jul 27 20:20:59.802441 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:59.802411    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-j4msg_a444eefb-5d50-42fc-acd1-4b8b9abbfd03/monitoring-plugin/0.log"
Jul 27 20:20:59.987039 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:20:59.987011    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bnfmx_594976e9-e6d8-4118-95fb-8bbae2d55acc/node-exporter/0.log"
Jul 27 20:21:00.009407 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.009385    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bnfmx_594976e9-e6d8-4118-95fb-8bbae2d55acc/kube-rbac-proxy/0.log"
Jul 27 20:21:00.037203 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.037181    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bnfmx_594976e9-e6d8-4118-95fb-8bbae2d55acc/init-textfile/0.log"
Jul 27 20:21:00.218334 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.218266    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0bdd7d2a-00f3-4510-a374-d902d1a896e2/prometheus/0.log"
Jul 27 20:21:00.268340 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.268315    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0bdd7d2a-00f3-4510-a374-d902d1a896e2/config-reloader/0.log"
Jul 27 20:21:00.311288 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.311266    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0bdd7d2a-00f3-4510-a374-d902d1a896e2/thanos-sidecar/0.log"
Jul 27 20:21:00.336499 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.336478    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0bdd7d2a-00f3-4510-a374-d902d1a896e2/kube-rbac-proxy-web/0.log"
Jul 27 20:21:00.360485 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.360468    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0bdd7d2a-00f3-4510-a374-d902d1a896e2/kube-rbac-proxy/0.log"
Jul 27 20:21:00.393305 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.393288    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0bdd7d2a-00f3-4510-a374-d902d1a896e2/kube-rbac-proxy-thanos/0.log"
Jul 27 20:21:00.418158 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.418136    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0bdd7d2a-00f3-4510-a374-d902d1a896e2/init-config-reloader/0.log"
Jul 27 20:21:00.452377 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.452360    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-xss9h_d5e5df61-b8ea-4b5f-b5c0-10547092c7db/prometheus-operator/0.log"
Jul 27 20:21:00.480008 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.474507    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-xss9h_d5e5df61-b8ea-4b5f-b5c0-10547092c7db/kube-rbac-proxy/0.log"
Jul 27 20:21:00.506991 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.506969    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-rvj29_36983a9d-bbf0-436a-8fe5-cf4449eb48d3/prometheus-operator-admission-webhook/0.log"
Jul 27 20:21:00.636532 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.636500    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c95bcd6f-gqv4r_1f3e6471-c7f3-4141-8e73-c2cc89759296/thanos-query/0.log"
Jul 27 20:21:00.660608 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.660580    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c95bcd6f-gqv4r_1f3e6471-c7f3-4141-8e73-c2cc89759296/kube-rbac-proxy-web/0.log"
Jul 27 20:21:00.679839 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.679816    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c95bcd6f-gqv4r_1f3e6471-c7f3-4141-8e73-c2cc89759296/kube-rbac-proxy/0.log"
Jul 27 20:21:00.702678 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.702664    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c95bcd6f-gqv4r_1f3e6471-c7f3-4141-8e73-c2cc89759296/prom-label-proxy/0.log"
Jul 27 20:21:00.732936 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.732882    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c95bcd6f-gqv4r_1f3e6471-c7f3-4141-8e73-c2cc89759296/kube-rbac-proxy-rules/0.log"
Jul 27 20:21:00.759714 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:00.759691    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c95bcd6f-gqv4r_1f3e6471-c7f3-4141-8e73-c2cc89759296/kube-rbac-proxy-metrics/0.log"
Jul 27 20:21:03.415438 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.415409    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"]
Jul 27 20:21:03.415802 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.415707    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8b51fb7-2475-4a76-a8de-9555545f17ce" containerName="istio-proxy"
Jul 27 20:21:03.415802 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.415717    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8b51fb7-2475-4a76-a8de-9555545f17ce" containerName="istio-proxy"
Jul 27 20:21:03.415802 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.415724    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f639a5d9-2cd8-48ba-a5a4-a9a247e053e0" containerName="revoke-keys"
Jul 27 20:21:03.415802 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.415729    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f639a5d9-2cd8-48ba-a5a4-a9a247e053e0" containerName="revoke-keys"
Jul 27 20:21:03.415802 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.415750    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62295d0d-4768-4efa-aa0c-938204ecee11" containerName="maas-api"
Jul 27 20:21:03.415802 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.415755    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="62295d0d-4768-4efa-aa0c-938204ecee11" containerName="maas-api"
Jul 27 20:21:03.415802 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.415797    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="62295d0d-4768-4efa-aa0c-938204ecee11" containerName="maas-api"
Jul 27 20:21:03.415802 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.415804    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8b51fb7-2475-4a76-a8de-9555545f17ce" containerName="istio-proxy"
Jul 27 20:21:03.416090 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.415811    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8b51fb7-2475-4a76-a8de-9555545f17ce" containerName="istio-proxy"
Jul 27 20:21:03.416090 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.415819    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f639a5d9-2cd8-48ba-a5a4-a9a247e053e0" containerName="revoke-keys"
Jul 27 20:21:03.419251 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.419233    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:03.421624 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.421598    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gzr5q\"/\"kube-root-ca.crt\""
Jul 27 20:21:03.421752 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.421732    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gzr5q\"/\"openshift-service-ca.crt\""
Jul 27 20:21:03.422596 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.422580    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gzr5q\"/\"default-dockercfg-x6f4j\""
Jul 27 20:21:03.425905 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.425879    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"]
Jul 27 20:21:03.522826 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.522805    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb6d84f7-68c4-4a01-a6a2-39ca52a42253-sys\") pod \"perf-node-gather-daemonset-mcjct\" (UID: \"bb6d84f7-68c4-4a01-a6a2-39ca52a42253\") " pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:03.522925 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.522843    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb6d84f7-68c4-4a01-a6a2-39ca52a42253-lib-modules\") pod \"perf-node-gather-daemonset-mcjct\" (UID: \"bb6d84f7-68c4-4a01-a6a2-39ca52a42253\") " pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:03.522925 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.522858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb6d84f7-68c4-4a01-a6a2-39ca52a42253-proc\") pod \"perf-node-gather-daemonset-mcjct\" (UID: \"bb6d84f7-68c4-4a01-a6a2-39ca52a42253\") " pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:03.522925 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.522881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb6d84f7-68c4-4a01-a6a2-39ca52a42253-podres\") pod \"perf-node-gather-daemonset-mcjct\" (UID: \"bb6d84f7-68c4-4a01-a6a2-39ca52a42253\") " pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:03.522925 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.522896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9mw9\" (UniqueName: \"kubernetes.io/projected/bb6d84f7-68c4-4a01-a6a2-39ca52a42253-kube-api-access-f9mw9\") pod \"perf-node-gather-daemonset-mcjct\" (UID: \"bb6d84f7-68c4-4a01-a6a2-39ca52a42253\") " pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:03.623776 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.623753    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb6d84f7-68c4-4a01-a6a2-39ca52a42253-sys\") pod \"perf-node-gather-daemonset-mcjct\" (UID: \"bb6d84f7-68c4-4a01-a6a2-39ca52a42253\") " pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:03.623871 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.623792    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb6d84f7-68c4-4a01-a6a2-39ca52a42253-lib-modules\") pod \"perf-node-gather-daemonset-mcjct\" (UID: \"bb6d84f7-68c4-4a01-a6a2-39ca52a42253\") " pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:03.623871 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.623810    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb6d84f7-68c4-4a01-a6a2-39ca52a42253-proc\") pod \"perf-node-gather-daemonset-mcjct\" (UID: \"bb6d84f7-68c4-4a01-a6a2-39ca52a42253\") " pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:03.623871 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.623833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb6d84f7-68c4-4a01-a6a2-39ca52a42253-podres\") pod \"perf-node-gather-daemonset-mcjct\" (UID: \"bb6d84f7-68c4-4a01-a6a2-39ca52a42253\") " pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:03.623871 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.623854    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9mw9\" (UniqueName: \"kubernetes.io/projected/bb6d84f7-68c4-4a01-a6a2-39ca52a42253-kube-api-access-f9mw9\") pod \"perf-node-gather-daemonset-mcjct\" (UID: \"bb6d84f7-68c4-4a01-a6a2-39ca52a42253\") " pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:03.624000 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.623873    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb6d84f7-68c4-4a01-a6a2-39ca52a42253-sys\") pod \"perf-node-gather-daemonset-mcjct\" (UID: \"bb6d84f7-68c4-4a01-a6a2-39ca52a42253\") " pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:03.624000 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.623903    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb6d84f7-68c4-4a01-a6a2-39ca52a42253-proc\") pod \"perf-node-gather-daemonset-mcjct\" (UID: \"bb6d84f7-68c4-4a01-a6a2-39ca52a42253\") " pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:03.624000 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.623928    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb6d84f7-68c4-4a01-a6a2-39ca52a42253-lib-modules\") pod \"perf-node-gather-daemonset-mcjct\" (UID: \"bb6d84f7-68c4-4a01-a6a2-39ca52a42253\") " pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:03.624000 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.623943    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb6d84f7-68c4-4a01-a6a2-39ca52a42253-podres\") pod \"perf-node-gather-daemonset-mcjct\" (UID: \"bb6d84f7-68c4-4a01-a6a2-39ca52a42253\") " pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:03.631853 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.631826    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9mw9\" (UniqueName: \"kubernetes.io/projected/bb6d84f7-68c4-4a01-a6a2-39ca52a42253-kube-api-access-f9mw9\") pod \"perf-node-gather-daemonset-mcjct\" (UID: \"bb6d84f7-68c4-4a01-a6a2-39ca52a42253\") " pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:03.730441 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.730372    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:03.858694 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:03.858666    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"]
Jul 27 20:21:03.861683 ip-10-0-142-24 kubenswrapper[2578]: W0727 20:21:03.861657    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbb6d84f7_68c4_4a01_a6a2_39ca52a42253.slice/crio-171747c46fe9a7d9bd56ae9dd212e715a1ab949a99fbb77529c910946095f394 WatchSource:0}: Error finding container 171747c46fe9a7d9bd56ae9dd212e715a1ab949a99fbb77529c910946095f394: Status 404 returned error can't find the container with id 171747c46fe9a7d9bd56ae9dd212e715a1ab949a99fbb77529c910946095f394
Jul 27 20:21:04.078482 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:04.078457    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct" event={"ID":"bb6d84f7-68c4-4a01-a6a2-39ca52a42253","Type":"ContainerStarted","Data":"fab5688734bc1b632307a275115fb2d13df9c883288fea73a5911c79c0793046"}
Jul 27 20:21:04.078619 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:04.078504    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct" event={"ID":"bb6d84f7-68c4-4a01-a6a2-39ca52a42253","Type":"ContainerStarted","Data":"171747c46fe9a7d9bd56ae9dd212e715a1ab949a99fbb77529c910946095f394"}
Jul 27 20:21:04.078619 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:04.078559    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:04.095529 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:04.095486    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct" podStartSLOduration=1.095473959 podStartE2EDuration="1.095473959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:21:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:21:04.094738853 +0000 UTC m=+3281.223102650" watchObservedRunningTime="2026-07-27 20:21:04.095473959 +0000 UTC m=+3281.223837755"
Jul 27 20:21:05.244752 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:05.244721    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dzkf2_963533dc-5ae0-4aa4-8fbe-6dbe15042d3a/dns/0.log"
Jul 27 20:21:05.265576 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:05.265532    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dzkf2_963533dc-5ae0-4aa4-8fbe-6dbe15042d3a/kube-rbac-proxy/0.log"
Jul 27 20:21:05.358320 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:05.358292    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9hjwq_8f664404-7594-4137-8e24-27ff3689a210/dns-node-resolver/0.log"
Jul 27 20:21:05.943290 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:05.943260    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f495f497f-b7t2c_cdb068f0-bd71-4791-a9ae-34fda6ee0656/registry/0.log"
Jul 27 20:21:05.964700 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:05.964675    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5jr4b_90259da6-ff35-437b-a596-853d2a96bc12/node-ca/0.log"
Jul 27 20:21:06.909886 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:06.909855    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c58mpl_f4aafb2c-fd20-4885-a53e-9d59ec2dbc91/istio-proxy/0.log"
Jul 27 20:21:07.054506 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:07.054477    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mp89s_3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47/discovery/0.log"
Jul 27 20:21:08.045416 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:08.045386    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hhhqg_f0c2d6ea-0e98-401a-a5d9-ca95c9fdbef9/serve-healthcheck-canary/0.log"
Jul 27 20:21:08.551937 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:08.551912    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7cqw8_34cc68b2-cc96-4a1a-965e-0bec23b02330/kube-rbac-proxy/0.log"
Jul 27 20:21:08.571445 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:08.571425    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7cqw8_34cc68b2-cc96-4a1a-965e-0bec23b02330/exporter/0.log"
Jul 27 20:21:08.591398 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:08.591375    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7cqw8_34cc68b2-cc96-4a1a-965e-0bec23b02330/extractor/0.log"
Jul 27 20:21:10.092451 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:10.092421    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gzr5q/perf-node-gather-daemonset-mcjct"
Jul 27 20:21:11.387459 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:11.387432    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz_041583f0-545e-47f7-b7c1-e885851f4aed/manager/0.log"
Jul 27 20:21:11.407496 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:11.407472    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c9f4fc9b4-vjsrz_041583f0-545e-47f7-b7c1-e885851f4aed/copy-manifests/0.log"
Jul 27 20:21:12.841140 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:12.841109    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-86d698cc8c-7zwbc_d466da4f-694e-4458-9e35-55f2ba44beb0/manager/0.log"
Jul 27 20:21:12.892440 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:12.892414    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-mqnpr_a0d34c7d-b446-4c6c-90d5-3502de2c0ab6/openshift-lws-operator/0.log"
Jul 27 20:21:13.600020 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:13.599992    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c58mpl_f4aafb2c-fd20-4885-a53e-9d59ec2dbc91/istio-proxy/0.log"
Jul 27 20:21:13.743073 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:13.742988    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mp89s_3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47/discovery/0.log"
Jul 27 20:21:15.331706 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:15.331635    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c58mpl_f4aafb2c-fd20-4885-a53e-9d59ec2dbc91/istio-proxy/0.log"
Jul 27 20:21:15.475944 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:15.475918    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mp89s_3bf5c1ef-4da1-4f6b-8fe1-6530ba9f5f47/discovery/0.log"
Jul 27 20:21:18.194684 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:18.194655    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-6rzvp_d80c125a-4f06-413e-9f36-5c223ff55f80/migrator/0.log"
Jul 27 20:21:18.213569 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:18.213541    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-6rzvp_d80c125a-4f06-413e-9f36-5c223ff55f80/graceful-termination/0.log"
Jul 27 20:21:19.692407 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:19.692378    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4ljfw_9a14be9a-be34-4ab7-b669-e84cf323d3db/kube-multus/0.log"
Jul 27 20:21:19.863246 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:19.863223    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9zv9c_2fa7739f-0905-421b-89b3-857fee7c68d9/kube-multus-additional-cni-plugins/0.log"
Jul 27 20:21:19.883000 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:19.882975    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9zv9c_2fa7739f-0905-421b-89b3-857fee7c68d9/egress-router-binary-copy/0.log"
Jul 27 20:21:19.902375 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:19.902356    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9zv9c_2fa7739f-0905-421b-89b3-857fee7c68d9/cni-plugins/0.log"
Jul 27 20:21:19.922232 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:19.922212    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9zv9c_2fa7739f-0905-421b-89b3-857fee7c68d9/bond-cni-plugin/0.log"
Jul 27 20:21:19.941100 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:19.941078    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9zv9c_2fa7739f-0905-421b-89b3-857fee7c68d9/routeoverride-cni/0.log"
Jul 27 20:21:19.961601 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:19.961544    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9zv9c_2fa7739f-0905-421b-89b3-857fee7c68d9/whereabouts-cni-bincopy/0.log"
Jul 27 20:21:19.980411 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:19.980390    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9zv9c_2fa7739f-0905-421b-89b3-857fee7c68d9/whereabouts-cni/0.log"
Jul 27 20:21:20.237392 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:20.237331    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-drqtg_a635d151-c940-4f0c-bd3c-69e8fdf67942/network-metrics-daemon/0.log"
Jul 27 20:21:20.254914 ip-10-0-142-24 kubenswrapper[2578]: I0727 20:21:20.254892    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-drqtg_a635d151-c940-4f0c-bd3c-69e8fdf67942/kube-rbac-proxy/0.log"