Jul 08 21:04:05.435802 ip-10-0-142-255 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 21:04:05.435816 ip-10-0-142-255 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 21:04:05.435826 ip-10-0-142-255 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 21:04:05.436142 ip-10-0-142-255 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 21:04:15.576236 ip-10-0-142-255 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 21:04:15.576256 ip-10-0-142-255 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5f11841f06db49f9bfdee8b5330e9bb8 --
Jul 08 21:06:15.252860 ip-10-0-142-255 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 21:06:15.679465 ip-10-0-142-255 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 21:06:15.679465 ip-10-0-142-255 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 21:06:15.679465 ip-10-0-142-255 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 21:06:15.679465 ip-10-0-142-255 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 21:06:15.679465 ip-10-0-142-255 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 21:06:15.680171 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.679514    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 21:06:15.686387 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686361    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:06:15.686508 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686498    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:06:15.686508 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686508    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:06:15.686577 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686513    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:06:15.686577 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686518    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:06:15.686577 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686523    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:06:15.686577 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686561    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:06:15.686577 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686565    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:06:15.686577 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686568    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:06:15.686577 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686572    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:06:15.686577 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686575    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:06:15.686577 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686578    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:06:15.686577 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686581    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686584    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686587    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686590    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686593    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686596    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686598    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686601    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686604    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686607    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686609    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686611    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686614    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686618    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686621    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686625    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686627    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686630    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686633    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:06:15.686834 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686635    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686638    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686641    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686644    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686648    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686651    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686654    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686656    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686659    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686662    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686664    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686667    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686670    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686673    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686676    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686679    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686682    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686684    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686687    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686690    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:06:15.687302 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686692    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686695    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686697    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686700    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686702    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686705    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686707    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686710    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686713    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686715    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686718    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686720    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686723    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686725    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686728    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686731    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686734    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686737    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686740    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:06:15.687814 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686742    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686745    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686747    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686751    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686754    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686756    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686759    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686762    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686765    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686767    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686770    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686773    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686775    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686779    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686781    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686784    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686787    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686789    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686791    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686794    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:06:15.688280 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686797    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686799    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686802    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686804    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686807    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686810    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686813    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686815    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.686818    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687514    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687521    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687524    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687527    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687531    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687534    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687538    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687540    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687543    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687546    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687568    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:06:15.688766 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687572    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687575    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687578    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687581    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687584    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687586    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687590    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687593    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687595    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687598    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687600    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687603    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687605    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687608    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687611    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687614    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687616    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687619    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687621    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687624    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:06:15.689264 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687627    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687630    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687632    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687635    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687637    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687642    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687646    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687648    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687651    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687653    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687656    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687659    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687662    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687665    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687667    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687670    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687673    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687675    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687678    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:06:15.689796 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687680    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687683    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687686    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687688    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687691    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687693    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687696    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687699    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687701    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687704    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687707    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687710    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687712    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687715    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687717    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687720    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687723    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687725    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687728    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687731    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:06:15.690245 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687733    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687736    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687739    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687741    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687745    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687749    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687752    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687755    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687759    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687763    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687766    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687768    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687771    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687775    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687778    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687780    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687784    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687787    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687789    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:06:15.690758 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687792    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687795    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687797    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687800    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687802    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687805    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687808    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687810    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687813    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.687815    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688191    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688196    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688199    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688202    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688205    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688208    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688211    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688214    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688217    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:06:15.691210 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688220    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688224    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688227    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688230    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688233    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688236    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688238    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688241    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688244    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688246    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688249    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688251    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688254    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688258    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688262    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688265    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688268    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688270    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688273    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:06:15.691672 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688276    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688278    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688281    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688284    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688287    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688289    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688293    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688295    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688298    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688300    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688303    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688305    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688308    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688310    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688313    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688315    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688318    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688320    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688323    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688325    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:06:15.692146 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688328    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688331    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688333    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688336    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688338    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688341    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688344    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688347    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688350    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688353    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688355    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688358    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688360    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688363    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688365    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688368    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688372    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688376    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688379    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:06:15.692640 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688382    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688385    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688387    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688390    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688392    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688395    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688397    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688400    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688402    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688405    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688407    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688410    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688412    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688415    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688417    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688420    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688422    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688425    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688428    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688431    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:06:15.693095 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688434    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688436    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688439    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688441    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688444    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688446    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688448    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688451    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688453    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688456    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688458    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.688460    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688522    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688529    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688535    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688545    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688563    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688569    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688575    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688581    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688585    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 21:06:15.693582 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688588    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688591    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688595    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688598    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688601    2583 flags.go:64] FLAG: --cgroup-root=""
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688603    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688606    2583 flags.go:64] FLAG: --client-ca-file=""
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688610    2583 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688613    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688617    2583 flags.go:64] FLAG: --cluster-domain=""
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688620    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688623    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688627    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688630    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688634    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688637    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688645    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688648    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688652    2583 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688655    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688657    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688661    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688663    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688667    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 21:06:15.694086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688670    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688673    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688676    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688679    2583 flags.go:64] FLAG: --enable-server="true"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688682    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688686    2583 flags.go:64] FLAG: --event-burst="100"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688689    2583 flags.go:64] FLAG: --event-qps="50"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688692    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688695    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688698    2583 flags.go:64] FLAG: --eviction-hard=""
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688702    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688705    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688707    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688710    2583 flags.go:64] FLAG: --eviction-soft=""
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688713    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688716    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688720    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688723    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688726    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688729    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688732    2583 flags.go:64] FLAG: --feature-gates=""
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688735    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688738    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688741    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688744    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688747    2583 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 21:06:15.694675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688750    2583 flags.go:64] FLAG: --help="false"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688753    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-142-255.ec2.internal"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688756    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688758    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688761    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688764    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688768    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688771    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688774    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688777    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688780    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688782    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688786    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688788    2583 flags.go:64] FLAG: --kube-reserved=""
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688791    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688794    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688797    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688799    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688802    2583 flags.go:64] FLAG: --lock-file=""
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688805    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688808    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688811    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688816    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 21:06:15.695353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688819    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688824    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688827    2583 flags.go:64] FLAG: --logging-format="text"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688830    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688833    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688835    2583 flags.go:64] FLAG: --manifest-url=""
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688838    2583 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688842    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688845    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688849    2583 flags.go:64] FLAG: --max-pods="110"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688851    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688854    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688857    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688860    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688862    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688865    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688868    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688875    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688878    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688880    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688883    2583 flags.go:64] FLAG: --pod-cidr=""
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688886    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688892    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688895    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 21:06:15.695922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688898    2583 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688901    2583 flags.go:64] FLAG: --port="10250"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688904    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688907    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02f92dbb3817c3589"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688910    2583 flags.go:64] FLAG: --qos-reserved=""
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688912    2583 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688915    2583 flags.go:64] FLAG: --register-node="true"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688919    2583 flags.go:64] FLAG: --register-with-taints=""
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688923    2583 flags.go:64] FLAG: --registry-burst="10"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688928    2583 flags.go:64] FLAG: --registry-qps="5"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688931    2583 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688933    2583 flags.go:64] FLAG: --reserved-memory=""
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688937    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688940    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688943    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688946    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688948    2583 flags.go:64] FLAG: --runonce="false"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688951    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688954    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688957    2583 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688960    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688962    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688965    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688969    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688972    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688974    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 21:06:15.696511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688977    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688980    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688982    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688985    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688988    2583 flags.go:64] FLAG: --system-cgroups=""
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688991    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688996    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.688999    2583 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.689001    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.689005    2583 flags.go:64] FLAG: --tls-min-version=""
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.689008    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.689011    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.689013    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.689017    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.689020    2583 flags.go:64] FLAG: --v="2"
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.689025    2583 flags.go:64] FLAG: --version="false"
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.689029    2583 flags.go:64] FLAG: --vmodule=""
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.689033    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.689036    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689155    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689159    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689163    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689165    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689168    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:06:15.697152 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689171    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689174    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689177    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689179    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689182    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689185    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689188    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689190    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689193    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689196    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689199    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689202    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689204    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689207    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689209    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689212    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689215    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689217    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689219    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689222    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:06:15.697739 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689225    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689229    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689232    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689236    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689238    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689242    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689245    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689248    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689250    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689253    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689255    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689259    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689263    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689266    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689268    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689271    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689274    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689277    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689280    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:06:15.698255 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689282    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689285    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689287    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689290    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689292    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689295    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689299    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689302    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689305    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689308    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689311    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689314    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689316    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689319    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689323    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689326    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689330    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689333    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689335    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:06:15.698857 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689339    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689341    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689344    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689346    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689349    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689351    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689354    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689357    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689359    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689362    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689364    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689367    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689369    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689372    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689374    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689377    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689379    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689383    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689387    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:06:15.699310 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689390    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:06:15.699773 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689392    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:06:15.699773 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689395    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:06:15.699773 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689398    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:06:15.699773 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689400    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:06:15.699773 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689403    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:06:15.699773 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689406    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:06:15.699773 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689408    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:06:15.699773 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689412    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:06:15.699773 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689415    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:06:15.699773 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689419    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:06:15.699773 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689422    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:06:15.699773 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689424    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:06:15.699773 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689427    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:06:15.699773 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689430    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:06:15.699773 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689433    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:06:15.699773 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.689435    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:06:15.700173 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.690718    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 21:06:15.700173 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.697199    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 21:06:15.700173 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.697213    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 21:06:15.700173 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.697226    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 21:06:15.700173 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.697232    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 21:06:15.700173 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697286    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:06:15.700173 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697291    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:06:15.700173 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697295    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:06:15.700173 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697298    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:06:15.700173 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697302    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:06:15.700173 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697304    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:06:15.700173 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697307    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:06:15.700173 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697310    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:06:15.700173 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697312    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697314    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697317    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697320    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697322    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697325    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697327    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697330    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697332    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697335    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697338    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697341    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697343    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697346    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697348    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697351    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697353    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697356    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697358    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697361    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:06:15.700520 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697363    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697368    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697371    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697373    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697377    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697380    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697383    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697385    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697388    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697391    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697393    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697397    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697401    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697403    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697406    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697409    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697412    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697414    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697417    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:06:15.701012 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697420    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697422    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697425    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697428    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697431    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697434    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697436    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697439    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697442    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697445    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697447    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697450    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697453    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697455    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697458    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697461    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697464    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697466    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697469    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697472    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:06:15.701462 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697474    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697476    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697479    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697482    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697484    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697487    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697489    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697492    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697495    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697497    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697500    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697502    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697505    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697507    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697510    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697513    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697515    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697518    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697520    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697523    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:06:15.701970 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697526    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:06:15.702431 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697529    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:06:15.702431 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697531    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:06:15.702431 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697534    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:06:15.702431 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697536    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:06:15.702431 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697539    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:06:15.702431 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697542    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:06:15.702431 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697544    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:06:15.702431 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697547    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:06:15.702431 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697563    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:06:15.702431 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697565    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:06:15.702431 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697568    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:06:15.702431 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.697574    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 21:06:15.702431 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697680    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:06:15.702431 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697685    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:06:15.702431 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697688    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697690    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697693    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697696    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697699    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697702    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697705    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697708    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697710    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697713    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697716    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697718    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697721    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697723    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697726    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697728    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697731    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697733    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697736    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697738    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:06:15.702832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697741    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697744    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697747    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697750    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697753    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697756    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697759    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697761    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697764    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697766    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697769    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697772    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697774    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697776    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697779    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697781    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697784    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697786    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697788    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697791    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:06:15.703313 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697793    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697796    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697798    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697800    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697803    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697805    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697808    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697810    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697812    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697815    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697817    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697820    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697823    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697827    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697830    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697833    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697836    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697840    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697843    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:06:15.703886 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697846    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697849    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697852    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697855    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697858    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697861    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697863    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697866    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697869    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697871    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697874    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697876    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697879    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697881    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697884    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697886    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697888    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697891    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697893    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697896    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:06:15.704347 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697898    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:06:15.704832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697901    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:06:15.704832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697903    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:06:15.704832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697905    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:06:15.704832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697908    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:06:15.704832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697910    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:06:15.704832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697913    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:06:15.704832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697915    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:06:15.704832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697918    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:06:15.704832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697920    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:06:15.704832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697923    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:06:15.704832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697925    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:06:15.704832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697927    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:06:15.704832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697930    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:06:15.704832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697933    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:06:15.704832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697935    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:06:15.704832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697937    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:06:15.704832 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:15.697940    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:06:15.705245 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.697944    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 21:06:15.705245 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.698036    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 21:06:15.705245 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.701024    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 21:06:15.705245 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.702440    2583 server.go:1019] "Starting client certificate rotation"
Jul 08 21:06:15.705245 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.702540    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 21:06:15.705245 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.702594    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 21:06:15.705539 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.705525    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 21:06:15.707413 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.707400    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 21:06:15.717416 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.717397    2583 log.go:25] "Validated CRI v1 runtime API"
Jul 08 21:06:15.719771 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.719757    2583 log.go:25] "Validated CRI v1 image API"
Jul 08 21:06:15.720483 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.720471    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 21:06:15.724819 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.724803    2583 fs.go:135] Filesystem UUIDs: map[1db77320-adb8-4ed6-afd9-b3d007dc8aa2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f51673d7-09ad-4d83-95b3-ea9232659fbe:/dev/nvme0n1p4]
Jul 08 21:06:15.724869 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.724820    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 21:06:15.730746 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.730631    2583 manager.go:216] Machine: {Timestamp:2026-07-08 21:06:15.729273633 +0000 UTC m=+0.357110009 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099544 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d7f170721e8da2d6d6a7c1d8d09c3 SystemUUID:ec2d7f17-0721-e8da-2d6d-6a7c1d8d09c3 BootID:5f11841f-06db-49f9-bfde-e8b5330e9bb8 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4f:99:b2:56:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4f:99:b2:56:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:dc:be:26:02:ad Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 21:06:15.730746 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.730734    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 21:06:15.730877 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.730815    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 21:06:15.731747 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.731731    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 21:06:15.733818 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.733789    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 21:06:15.733949 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.733821    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-255.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 21:06:15.734593 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.734584    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 21:06:15.734632 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.734595    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 21:06:15.734632 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.734603    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 21:06:15.735142 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.735132    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 21:06:15.736466 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.736456    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 21:06:15.739640 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.739628    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 21:06:15.739754 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.739744    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 21:06:15.739800 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.739773    2583 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 21:06:15.739800 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.739783    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 21:06:15.739800 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.739793    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 21:06:15.739905 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.739802    2583 kubelet.go:398] "Adding apiserver pod source"
Jul 08 21:06:15.739905 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.739813    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 21:06:15.740178 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.740166    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 21:06:15.740211 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.740185    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 21:06:15.742602 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.742585    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 21:06:15.744874 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.744861    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 21:06:15.744914 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.744896    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 21:06:15.746113 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.746101    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 21:06:15.746158 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.746118    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 21:06:15.746158 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.746124    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 21:06:15.746158 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.746129    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 21:06:15.746158 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.746138    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 21:06:15.746158 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.746143    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 21:06:15.746158 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.746154    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 21:06:15.746308 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.746162    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 21:06:15.746308 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.746168    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 21:06:15.746308 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.746174    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 21:06:15.746308 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.746186    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 21:06:15.746308 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.746192    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 21:06:15.747514 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.747503    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 21:06:15.747514 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.747514    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 21:06:15.751025 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.751011    2583 server.go:1268] "Started kubelet"
Jul 08 21:06:15.751618 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:15.751224    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 21:06:15.751618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.751119    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 21:06:15.751618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.751289    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 21:06:15.751618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.751438    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-255.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 21:06:15.751618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.751266    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 21:06:15.751618 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:15.751516    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-255.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 21:06:15.752115 ip-10-0-142-255 systemd[1]: Started Kubernetes Kubelet.
Jul 08 21:06:15.753818 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.753800    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 21:06:15.758032 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.758016    2583 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 21:06:15.758329 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:15.758310    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 21:06:15.758693 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.758678    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jpnwm"
Jul 08 21:06:15.760599 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.760585    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 21:06:15.760684 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.760665    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 21:06:15.760836 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:15.760819    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found"
Jul 08 21:06:15.761197 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.761178    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 21:06:15.761275 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.761193    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 21:06:15.761275 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.761220    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 21:06:15.761392 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.761295    2583 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 21:06:15.761392 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.761304    2583 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 21:06:15.761473 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:15.759966    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-255.ec2.internal.18c06c861fa424b1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-255.ec2.internal,UID:ip-10-0-142-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-255.ec2.internal,},FirstTimestamp:2026-07-08 21:06:15.750984881 +0000 UTC m=+0.378821256,LastTimestamp:2026-07-08 21:06:15.750984881 +0000 UTC m=+0.378821256,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-255.ec2.internal,}"
Jul 08 21:06:15.761563 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.761534    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 21:06:15.761612 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.761569    2583 factory.go:55] Registering systemd factory
Jul 08 21:06:15.761612 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.761579    2583 factory.go:223] Registration of the systemd container factory successfully
Jul 08 21:06:15.761796 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.761784    2583 factory.go:153] Registering CRI-O factory
Jul 08 21:06:15.761849 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.761800    2583 factory.go:223] Registration of the crio container factory successfully
Jul 08 21:06:15.761849 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.761821    2583 factory.go:103] Registering Raw factory
Jul 08 21:06:15.761849 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.761835    2583 manager.go:1196] Started watching for new ooms in manager
Jul 08 21:06:15.762184 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.762174    2583 manager.go:349] Starting recovery of all containers
Jul 08 21:06:15.765454 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.765433    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jpnwm"
Jul 08 21:06:15.768020 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:15.767960    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-255.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 21:06:15.768147 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:15.768126    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 21:06:15.773777 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.773645    2583 manager.go:354] Recovery completed
Jul 08 21:06:15.779093 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.779073    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:06:15.781886 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.781869    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:06:15.781947 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.781900    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:06:15.781947 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.781913    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:06:15.782420 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.782404    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 21:06:15.782420 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.782417    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 21:06:15.782420 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.782420    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:06:15.782571 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.782432    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 21:06:15.783139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.783125    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:06:15.783195 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.783149    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:06:15.783195 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.783159    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:06:15.783960 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.783946    2583 policy_none.go:49] "None policy: Start"
Jul 08 21:06:15.784002 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.783969    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 21:06:15.784002 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:15.783986    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 21:06:17.320178 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.319919    2583 policy_none.go:47] "Start"
Jul 08 21:06:17.350114 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.350099    2583 manager.go:337] "Starting Device Plugin manager"
Jul 08 21:06:17.350207 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:17.350128    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 21:06:17.350207 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.350137    2583 server.go:87] "Starting device plugin registration server"
Jul 08 21:06:17.350388 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.350375    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 21:06:17.350434 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.350390    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 21:06:17.350497 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.350473    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 21:06:17.350604 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.350552    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 21:06:17.350604 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.350560    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 21:06:17.351097 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:17.351077    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 21:06:17.351186 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:17.351123    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-255.ec2.internal\" not found"
Jul 08 21:06:17.422594 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.422558    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 21:06:17.423836 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.423712    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 21:06:17.423836 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.423760    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 21:06:17.423836 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.423784    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 21:06:17.423977 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:17.423834    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 21:06:17.425994 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.425968    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:06:17.450882 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.450843    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:06:17.452053 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.452037    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:06:17.452149 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.452067    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:06:17.452149 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.452077    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:06:17.452149 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.452119    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-255.ec2.internal"
Jul 08 21:06:17.459335 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.459318    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-255.ec2.internal"
Jul 08 21:06:17.459425 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:17.459340    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-255.ec2.internal\": node \"ip-10-0-142-255.ec2.internal\" not found"
Jul 08 21:06:17.471845 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:17.471790    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found"
Jul 08 21:06:17.524463 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.524434    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal"]
Jul 08 21:06:17.524569 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.524499    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:06:17.526197 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.526182    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:06:17.526280 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.526215    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:06:17.526280 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.526231    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:06:17.527763 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.527748    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:06:17.527875 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.527861    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal"
Jul 08 21:06:17.527924 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.527891    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:06:17.528821 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.528807    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:06:17.528885 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.528829    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:06:17.528885 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.528850    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:06:17.528885 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.528859    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:06:17.528974 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.528834    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:06:17.528974 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.528919    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:06:17.530236 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.530223    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal"
Jul 08 21:06:17.530297 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.530247    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:06:17.531089 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.531075    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:06:17.531177 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.531100    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:06:17.531177 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.531112    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:06:17.545118 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:17.545099    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-255.ec2.internal\" not found" node="ip-10-0-142-255.ec2.internal"
Jul 08 21:06:17.548874 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:17.548861    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-255.ec2.internal\" not found" node="ip-10-0-142-255.ec2.internal"
Jul 08 21:06:17.572330 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:17.572312    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found"
Jul 08 21:06:17.597017 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.596975    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fad7ab4e8604dec7835d117ad532794c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal\" (UID: \"fad7ab4e8604dec7835d117ad532794c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal"
Jul 08 21:06:17.597114 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.597028    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fad7ab4e8604dec7835d117ad532794c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal\" (UID: \"fad7ab4e8604dec7835d117ad532794c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal"
Jul 08 21:06:17.597114 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.597055    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/acd4d634ee249d4b487dddc3a283d199-config\") pod \"kube-apiserver-proxy-ip-10-0-142-255.ec2.internal\" (UID: \"acd4d634ee249d4b487dddc3a283d199\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal"
Jul 08 21:06:17.673106 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:17.673084    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found"
Jul 08 21:06:17.697478 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.697450    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fad7ab4e8604dec7835d117ad532794c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal\" (UID: \"fad7ab4e8604dec7835d117ad532794c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal"
Jul 08 21:06:17.697544 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.697481    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fad7ab4e8604dec7835d117ad532794c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal\" (UID: \"fad7ab4e8604dec7835d117ad532794c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal"
Jul 08 21:06:17.697544 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.697507    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fad7ab4e8604dec7835d117ad532794c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal\" (UID: \"fad7ab4e8604dec7835d117ad532794c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal"
Jul 08 21:06:17.697544 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.697535    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/acd4d634ee249d4b487dddc3a283d199-config\") pod \"kube-apiserver-proxy-ip-10-0-142-255.ec2.internal\" (UID: \"acd4d634ee249d4b487dddc3a283d199\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal"
Jul 08 21:06:17.697741 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.697574    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/acd4d634ee249d4b487dddc3a283d199-config\") pod \"kube-apiserver-proxy-ip-10-0-142-255.ec2.internal\" (UID: \"acd4d634ee249d4b487dddc3a283d199\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal"
Jul 08 21:06:17.697741 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.697648    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fad7ab4e8604dec7835d117ad532794c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal\" (UID: \"fad7ab4e8604dec7835d117ad532794c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal"
Jul 08 21:06:17.773817 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:17.773754    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found"
Jul 08 21:06:17.848402 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.848364    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal"
Jul 08 21:06:17.852557 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:17.852424    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal"
Jul 08 21:06:17.873921 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:17.873896    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found"
Jul 08 21:06:17.974484 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:17.974455    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found"
Jul 08 21:06:18.074979 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:18.074905    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found"
Jul 08 21:06:18.175470 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:18.175432    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found"
Jul 08 21:06:18.235850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:18.235825    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 21:06:18.236369 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:18.235986    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 21:06:18.276280 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:18.276257    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found"
Jul 08 21:06:18.301391 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:18.301360    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 21:01:17 +0000 UTC" deadline="2027-12-15 19:42:45.244339842 +0000 UTC"
Jul 08 21:06:18.301391 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:18.301385    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12598h36m26.942957531s"
Jul 08 21:06:18.376779 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:18.376711    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found"
Jul 08 21:06:18.477125 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:18.477094    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found"
Jul 08 21:06:18.574145 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:18.574098    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfad7ab4e8604dec7835d117ad532794c.slice/crio-bc9224beb9e68e0318e866cc4fd012f81cec6889b941f679cc8e0a91e2f088d1 WatchSource:0}: Error finding container bc9224beb9e68e0318e866cc4fd012f81cec6889b941f679cc8e0a91e2f088d1: Status 404 returned error can't find the container with id bc9224beb9e68e0318e866cc4fd012f81cec6889b941f679cc8e0a91e2f088d1
Jul 08 21:06:18.574353 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:18.574330    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd4d634ee249d4b487dddc3a283d199.slice/crio-a6fed98388765cb43274e2c026df55127749d3eedd713d5b09d66af28518ac81 WatchSource:0}: Error finding container a6fed98388765cb43274e2c026df55127749d3eedd713d5b09d66af28518ac81: Status 404 returned error can't find the container with id a6fed98388765cb43274e2c026df55127749d3eedd713d5b09d66af28518ac81
Jul 08 21:06:18.577494 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:18.577470    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found"
Jul 08 21:06:18.581322 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:18.581308    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:06:18.678356 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:18.678267    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found"
Jul 08 21:06:18.690742 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:18.690722    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:06:18.779269 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:18.779219    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found"
Jul 08 21:06:18.821574 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:18.821528    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:06:18.852673 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:18.852645    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:06:18.895642 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:18.895608    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal"
Jul 08 21:06:18.904896 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:18.904873    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 21:06:18.906328 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:18.906316    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal"
Jul 08 21:06:18.914441 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:18.914426    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 21:06:19.274500 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.274467    2583 apiserver.go:52] "Watching apiserver"
Jul 08 21:06:19.280842 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.280807    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 21:06:19.281340 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.281314    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-2bfh8","openshift-multus/multus-additional-cni-plugins-lz4xt","openshift-network-diagnostics/network-check-target-ss6w5","openshift-network-operator/iptables-alerter-sz2z5","kube-system/global-pull-secret-syncer-58wxg","kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww","openshift-cluster-node-tuning-operator/tuned-p9st5","openshift-dns/node-resolver-8fkbn","openshift-multus/network-metrics-daemon-qjpwc","openshift-ovn-kubernetes/ovnkube-node-pwjgn","kube-system/konnectivity-agent-stmvp","openshift-image-registry/node-ca-jmxt4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal"]
Jul 08 21:06:19.283037 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.283015    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.284528 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.284349    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jmxt4"
Jul 08 21:06:19.285264 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.285239    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dbk4q\""
Jul 08 21:06:19.285390 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.285374    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 21:06:19.285663 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.285645    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 21:06:19.285841 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.285823    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 21:06:19.286028 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.286010    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:19.286113 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.286085    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:19.286891 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.286681    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 21:06:19.286891 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.286696    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 21:06:19.286891 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.286711    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dchgh\""
Jul 08 21:06:19.286891 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.286886    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 21:06:19.287275 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.287255    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sz2z5"
Jul 08 21:06:19.289070 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.289054    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:19.289182 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.289112    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:19.289432 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.289385    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:06:19.289580 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.289563    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vghwf\""
Jul 08 21:06:19.289763 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.289712    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 21:06:19.289877 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.289863    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 21:06:19.290455 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.290437    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.292046 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.291909    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8fkbn"
Jul 08 21:06:19.292721 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.292702    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 21:06:19.292902 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.292702    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jns75\""
Jul 08 21:06:19.292902 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.292708    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:06:19.293640 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.293206    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.294012 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.293928    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 21:06:19.294113 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.294021    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-984pn\""
Jul 08 21:06:19.294189 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.294171    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 21:06:19.294635 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.294607    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.295271 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.295244    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 21:06:19.295768 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.295749    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 21:06:19.296084 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.296061    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 21:06:19.296182 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.296107    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 21:06:19.296306 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.296279    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 21:06:19.296387 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.296325    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8447c\""
Jul 08 21:06:19.296873 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.296766    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 21:06:19.301862 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.297628    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:19.301862 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.301085    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:19.301862 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.301113    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9fthh\""
Jul 08 21:06:19.301862 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.301556    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 21:06:19.303150 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.303133    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.304739 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.304708    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-stmvp"
Jul 08 21:06:19.305415 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.305392    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 21:06:19.305980 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.305961    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 21:06:19.306081 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306072    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 21:06:19.306149 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306104    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 21:06:19.306149 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306143    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 21:06:19.306276 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306181    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-27rm9\""
Jul 08 21:06:19.306334 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306289    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59f1bd39-6d31-460e-99be-5bb083479ba8-cnibin\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.306334 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306317    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-kubernetes\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.306334 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306330    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 21:06:19.306440 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306341    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a76885ac-b10f-40cd-aa28-4b274d95c017-kubelet-config\") pod \"global-pull-secret-syncer-58wxg\" (UID: \"a76885ac-b10f-40cd-aa28-4b274d95c017\") " pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:19.306440 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306368    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret\") pod \"global-pull-secret-syncer-58wxg\" (UID: \"a76885ac-b10f-40cd-aa28-4b274d95c017\") " pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:19.306440 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306392    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-var-lib-cni-bin\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.306440 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306413    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-etc-selinux\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.306440 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d7a538d-6907-487e-b67f-c68e86d0e043-host\") pod \"node-ca-jmxt4\" (UID: \"7d7a538d-6907-487e-b67f-c68e86d0e043\") " pod="openshift-image-registry/node-ca-jmxt4"
Jul 08 21:06:19.306718 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306456    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9bvf\" (UniqueName: \"kubernetes.io/projected/7d7a538d-6907-487e-b67f-c68e86d0e043-kube-api-access-c9bvf\") pod \"node-ca-jmxt4\" (UID: \"7d7a538d-6907-487e-b67f-c68e86d0e043\") " pod="openshift-image-registry/node-ca-jmxt4"
Jul 08 21:06:19.306718 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306485    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-modprobe-d\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.306718 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306527    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59f1bd39-6d31-460e-99be-5bb083479ba8-system-cni-dir\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.306718 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306550    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8ltn\" (UniqueName: \"kubernetes.io/projected/7a084819-c4bf-41ef-ae06-5e982935c4b4-kube-api-access-z8ltn\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.306718 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306572    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/35d39013-c4de-41ad-9f73-d009a2207661-hosts-file\") pod \"node-resolver-8fkbn\" (UID: \"35d39013-c4de-41ad-9f73-d009a2207661\") " pod="openshift-dns/node-resolver-8fkbn"
Jul 08 21:06:19.306718 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306611    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-multus-daemon-config\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.306718 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306635    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59f1bd39-6d31-460e-99be-5bb083479ba8-cni-binary-copy\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.306718 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306679    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59f1bd39-6d31-460e-99be-5bb083479ba8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.306718 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306704    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdhxc\" (UniqueName: \"kubernetes.io/projected/59f1bd39-6d31-460e-99be-5bb083479ba8-kube-api-access-bdhxc\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.307139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306727    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-sysctl-conf\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.307139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306745    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 21:06:19.307139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306747    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-sys\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.307139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306805    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-tuned\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.307139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306830    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-os-release\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.307139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306853    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-multus-socket-dir-parent\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.307139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306884    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59f1bd39-6d31-460e-99be-5bb083479ba8-os-release\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.307139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306921    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-socket-dir\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.307139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306943    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-sysctl-d\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.307139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.306966    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-systemd\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.307139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307000    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-var-lib-cni-multus\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.307139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307023    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59f1bd39-6d31-460e-99be-5bb083479ba8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.307139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307046    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-var-lib-kubelet\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.307139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307068    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-etc-kubernetes\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.307139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307090    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs\") pod \"network-metrics-daemon-qjpwc\" (UID: \"b2421404-0026-4094-bf86-2f36fc0b21ea\") " pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:19.307139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307130    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-sys-fs\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307160    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c500e88-9c68-4236-90da-59716c65e58a-host-slash\") pod \"iptables-alerter-sz2z5\" (UID: \"7c500e88-9c68-4236-90da-59716c65e58a\") " pod="openshift-network-operator/iptables-alerter-sz2z5"
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307185    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb5np\" (UniqueName: \"kubernetes.io/projected/7c500e88-9c68-4236-90da-59716c65e58a-kube-api-access-gb5np\") pod \"iptables-alerter-sz2z5\" (UID: \"7c500e88-9c68-4236-90da-59716c65e58a\") " pod="openshift-network-operator/iptables-alerter-sz2z5"
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307204    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t46bn\""
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307261    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307207    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a76885ac-b10f-40cd-aa28-4b274d95c017-dbus\") pod \"global-pull-secret-syncer-58wxg\" (UID: \"a76885ac-b10f-40cd-aa28-4b274d95c017\") " pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307333    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-hostroot\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307353    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d7a538d-6907-487e-b67f-c68e86d0e043-serviceca\") pod \"node-ca-jmxt4\" (UID: \"7d7a538d-6907-487e-b67f-c68e86d0e043\") " pod="openshift-image-registry/node-ca-jmxt4"
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307402    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgqvt\" (UniqueName: \"kubernetes.io/projected/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-kube-api-access-lgqvt\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307437    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-sysconfig\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307467    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-multus-cni-dir\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307494    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfkzz\" (UniqueName: \"kubernetes.io/projected/b2421404-0026-4094-bf86-2f36fc0b21ea-kube-api-access-gfkzz\") pod \"network-metrics-daemon-qjpwc\" (UID: \"b2421404-0026-4094-bf86-2f36fc0b21ea\") " pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307545    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-host\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307568    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-system-cni-dir\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307614    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-run-multus-certs\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307637    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-var-lib-kubelet\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307658    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8crl\" (UniqueName: \"kubernetes.io/projected/35d39013-c4de-41ad-9f73-d009a2207661-kube-api-access-h8crl\") pod \"node-resolver-8fkbn\" (UID: \"35d39013-c4de-41ad-9f73-d009a2207661\") " pod="openshift-dns/node-resolver-8fkbn"
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307688    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-cnibin\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.307923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307718    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-device-dir\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.308850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307756    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35d39013-c4de-41ad-9f73-d009a2207661-tmp-dir\") pod \"node-resolver-8fkbn\" (UID: \"35d39013-c4de-41ad-9f73-d009a2207661\") " pod="openshift-dns/node-resolver-8fkbn"
Jul 08 21:06:19.308850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307782    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57nx5\" (UniqueName: \"kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5\") pod \"network-check-target-ss6w5\" (UID: \"7dce3e47-c290-418d-ac0e-d723eaf6d93d\") " pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:19.308850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307807    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-run-netns\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.308850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307834    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-multus-conf-dir\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.308850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307859    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59f1bd39-6d31-460e-99be-5bb083479ba8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.308850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307882    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.308850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307905    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-registration-dir\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.308850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307928    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh4j2\" (UniqueName: \"kubernetes.io/projected/17adb24a-07f7-4f46-8c15-09eeb45d9b85-kube-api-access-hh4j2\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.308850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307954    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-run\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.308850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307975    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-lib-modules\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.308850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.307995    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a084819-c4bf-41ef-ae06-5e982935c4b4-tmp\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.308850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.308018    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c500e88-9c68-4236-90da-59716c65e58a-iptables-alerter-script\") pod \"iptables-alerter-sz2z5\" (UID: \"7c500e88-9c68-4236-90da-59716c65e58a\") " pod="openshift-network-operator/iptables-alerter-sz2z5"
Jul 08 21:06:19.308850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.308040    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-cni-binary-copy\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.308850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.308060    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-run-k8s-cni-cncf-io\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.308850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.308437    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 21:06:19.342023 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.342000    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pqdl4"
Jul 08 21:06:19.350662 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.349557    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pqdl4"
Jul 08 21:06:19.383214 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.383190    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:06:19.396856 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.396787    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 21:06:19.408650 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.408616    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-slash\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.408775 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.408664    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-run-systemd\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.408775 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.408697    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrdpg\" (UniqueName: \"kubernetes.io/projected/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-kube-api-access-qrdpg\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.408775 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.408734    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-multus-cni-dir\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.408775 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.408759    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfkzz\" (UniqueName: \"kubernetes.io/projected/b2421404-0026-4094-bf86-2f36fc0b21ea-kube-api-access-gfkzz\") pod \"network-metrics-daemon-qjpwc\" (UID: \"b2421404-0026-4094-bf86-2f36fc0b21ea\") " pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:19.408986 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.408782    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-host\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.408986 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.408812    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-system-cni-dir\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.408986 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.408841    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-run-multus-certs\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.408986 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.408843    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-multus-cni-dir\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.408986 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.408865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-var-lib-kubelet\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.408986 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.408889    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-etc-openvswitch\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.408986 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.408927    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-system-cni-dir\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.408986 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.408934    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8crl\" (UniqueName: \"kubernetes.io/projected/35d39013-c4de-41ad-9f73-d009a2207661-kube-api-access-h8crl\") pod \"node-resolver-8fkbn\" (UID: \"35d39013-c4de-41ad-9f73-d009a2207661\") " pod="openshift-dns/node-resolver-8fkbn"
Jul 08 21:06:19.408986 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.408951    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-cnibin\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.408986 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.408981    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-device-dir\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.409431 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409013    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/594ec0f6-ccb6-4125-81f0-4ccf9115682b-konnectivity-ca\") pod \"konnectivity-agent-stmvp\" (UID: \"594ec0f6-ccb6-4125-81f0-4ccf9115682b\") " pod="kube-system/konnectivity-agent-stmvp"
Jul 08 21:06:19.409431 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409030    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.409431 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409047    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-env-overrides\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.409431 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35d39013-c4de-41ad-9f73-d009a2207661-tmp-dir\") pod \"node-resolver-8fkbn\" (UID: \"35d39013-c4de-41ad-9f73-d009a2207661\") " pod="openshift-dns/node-resolver-8fkbn"
Jul 08 21:06:19.409431 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409135    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57nx5\" (UniqueName: \"kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5\") pod \"network-check-target-ss6w5\" (UID: \"7dce3e47-c290-418d-ac0e-d723eaf6d93d\") " pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:19.409431 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-run-netns\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.409431 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409243    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-multus-conf-dir\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.409431 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409329    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-device-dir\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.409431 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409341    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-run-multus-certs\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.409431 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409340    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59f1bd39-6d31-460e-99be-5bb083479ba8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.409918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409418    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.409918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409487    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-registration-dir\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.409918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409513    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh4j2\" (UniqueName: \"kubernetes.io/projected/17adb24a-07f7-4f46-8c15-09eeb45d9b85-kube-api-access-hh4j2\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.409918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409576    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-run-openvswitch\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.409918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409623    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-log-socket\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.409918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409623    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59f1bd39-6d31-460e-99be-5bb083479ba8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.409918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-run\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.409918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409688    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-host\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.409918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409716    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-registration-dir\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.409918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409738    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-multus-conf-dir\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.409918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409752    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-run-netns\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.409918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409758    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-lib-modules\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.409918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409810    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-cnibin\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.409918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409831    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a084819-c4bf-41ef-ae06-5e982935c4b4-tmp\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.409918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409869    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-lib-modules\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.409918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409884    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-systemd-units\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.409918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409920    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-run\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.410693 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409928    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.410693 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409946    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35d39013-c4de-41ad-9f73-d009a2207661-tmp-dir\") pod \"node-resolver-8fkbn\" (UID: \"35d39013-c4de-41ad-9f73-d009a2207661\") " pod="openshift-dns/node-resolver-8fkbn"
Jul 08 21:06:19.410693 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.410370    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 21:06:19.410693 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.409960    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-ovnkube-config\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.410888 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.410727    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-var-lib-kubelet\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.410888 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.410776    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c500e88-9c68-4236-90da-59716c65e58a-iptables-alerter-script\") pod \"iptables-alerter-sz2z5\" (UID: \"7c500e88-9c68-4236-90da-59716c65e58a\") " pod="openshift-network-operator/iptables-alerter-sz2z5"
Jul 08 21:06:19.410888 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.410819    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-cni-binary-copy\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.410888 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.410842    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-run-k8s-cni-cncf-io\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.410888 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.410882    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59f1bd39-6d31-460e-99be-5bb083479ba8-cnibin\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.411122 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.410909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-kubernetes\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.411122 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.410934    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a76885ac-b10f-40cd-aa28-4b274d95c017-kubelet-config\") pod \"global-pull-secret-syncer-58wxg\" (UID: \"a76885ac-b10f-40cd-aa28-4b274d95c017\") " pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:19.411122 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret\") pod \"global-pull-secret-syncer-58wxg\" (UID: \"a76885ac-b10f-40cd-aa28-4b274d95c017\") " pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:19.411259 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411135    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-var-lib-cni-bin\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.411259 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411125    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a76885ac-b10f-40cd-aa28-4b274d95c017-kubelet-config\") pod \"global-pull-secret-syncer-58wxg\" (UID: \"a76885ac-b10f-40cd-aa28-4b274d95c017\") " pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:19.411259 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411160    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-etc-selinux\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.411259 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411186    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d7a538d-6907-487e-b67f-c68e86d0e043-host\") pod \"node-ca-jmxt4\" (UID: \"7d7a538d-6907-487e-b67f-c68e86d0e043\") " pod="openshift-image-registry/node-ca-jmxt4"
Jul 08 21:06:19.411259 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411236    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9bvf\" (UniqueName: \"kubernetes.io/projected/7d7a538d-6907-487e-b67f-c68e86d0e043-kube-api-access-c9bvf\") pod \"node-ca-jmxt4\" (UID: \"7d7a538d-6907-487e-b67f-c68e86d0e043\") " pod="openshift-image-registry/node-ca-jmxt4"
Jul 08 21:06:19.411488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411270    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-modprobe-d\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.411488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411297    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59f1bd39-6d31-460e-99be-5bb083479ba8-system-cni-dir\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.411488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411328    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8ltn\" (UniqueName: \"kubernetes.io/projected/7a084819-c4bf-41ef-ae06-5e982935c4b4-kube-api-access-z8ltn\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.411488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411355    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-run-netns\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.411488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411382    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/35d39013-c4de-41ad-9f73-d009a2207661-hosts-file\") pod \"node-resolver-8fkbn\" (UID: \"35d39013-c4de-41ad-9f73-d009a2207661\") " pod="openshift-dns/node-resolver-8fkbn"
Jul 08 21:06:19.411488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411436    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-multus-daemon-config\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.411488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411460    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59f1bd39-6d31-460e-99be-5bb083479ba8-cni-binary-copy\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.411488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411471    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c500e88-9c68-4236-90da-59716c65e58a-iptables-alerter-script\") pod \"iptables-alerter-sz2z5\" (UID: \"7c500e88-9c68-4236-90da-59716c65e58a\") " pod="openshift-network-operator/iptables-alerter-sz2z5"
Jul 08 21:06:19.411883 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411489    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59f1bd39-6d31-460e-99be-5bb083479ba8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.411883 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411519    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-node-log\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.411883 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411546    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdhxc\" (UniqueName: \"kubernetes.io/projected/59f1bd39-6d31-460e-99be-5bb083479ba8-kube-api-access-bdhxc\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.411883 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411553    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-run-k8s-cni-cncf-io\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.411883 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411570    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-sysctl-conf\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.411883 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411616    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-sys\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.411883 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411622    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-kubernetes\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.411883 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411645    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-tuned\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.411883 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411668    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59f1bd39-6d31-460e-99be-5bb083479ba8-system-cni-dir\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.411883 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411672    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-kubelet\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.411883 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411695    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-os-release\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.412376 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.411709    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/35d39013-c4de-41ad-9f73-d009a2207661-hosts-file\") pod \"node-resolver-8fkbn\" (UID: \"35d39013-c4de-41ad-9f73-d009a2207661\") " pod="openshift-dns/node-resolver-8fkbn"
Jul 08 21:06:19.412696 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.412671    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-cni-binary-copy\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.412910 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.412892    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-os-release\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.415618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.413236    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-sysctl-conf\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.415618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.413299    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-sys\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.415618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.413342    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59f1bd39-6d31-460e-99be-5bb083479ba8-cnibin\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.415618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.413384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-multus-socket-dir-parent\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.415618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.413394    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d7a538d-6907-487e-b67f-c68e86d0e043-host\") pod \"node-ca-jmxt4\" (UID: \"7d7a538d-6907-487e-b67f-c68e86d0e043\") " pod="openshift-image-registry/node-ca-jmxt4"
Jul 08 21:06:19.415618 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.413415    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:19.415618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.413446    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59f1bd39-6d31-460e-99be-5bb083479ba8-os-release\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.415618 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.413657    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret podName:a76885ac-b10f-40cd-aa28-4b274d95c017 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:19.913633498 +0000 UTC m=+3.007437043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret") pod "global-pull-secret-syncer-58wxg" (UID: "a76885ac-b10f-40cd-aa28-4b274d95c017") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:19.415618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.413930    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-multus-daemon-config\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.415618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.414016    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-socket-dir\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.415618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.414054    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-sysctl-d\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.415618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.414131    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59f1bd39-6d31-460e-99be-5bb083479ba8-os-release\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.415618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.414415    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-etc-selinux\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.415618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.414425    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59f1bd39-6d31-460e-99be-5bb083479ba8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.415618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.414663    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-modprobe-d\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.415618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.414710    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-var-lib-cni-bin\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.415618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.414745    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-systemd\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.416476 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.414827    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-sysctl-d\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.416476 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.414883    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-multus-socket-dir-parent\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.416476 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.414986    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-socket-dir\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.416476 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.415392    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59f1bd39-6d31-460e-99be-5bb083479ba8-cni-binary-copy\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.416476 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.415604    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/594ec0f6-ccb6-4125-81f0-4ccf9115682b-agent-certs\") pod \"konnectivity-agent-stmvp\" (UID: \"594ec0f6-ccb6-4125-81f0-4ccf9115682b\") " pod="kube-system/konnectivity-agent-stmvp"
Jul 08 21:06:19.416476 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.415641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-var-lib-openvswitch\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.416476 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.415676    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-var-lib-cni-multus\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.416476 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.415707    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-systemd\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.416476 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.415731    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59f1bd39-6d31-460e-99be-5bb083479ba8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.416476 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.415772    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-var-lib-cni-multus\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.416476 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.415816    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-ovn-node-metrics-cert\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.416476 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.415930    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-ovnkube-script-lib\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.416476 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.415965    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-var-lib-kubelet\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.416476 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416021    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-etc-kubernetes\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.416476 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416055    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs\") pod \"network-metrics-daemon-qjpwc\" (UID: \"b2421404-0026-4094-bf86-2f36fc0b21ea\") " pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:19.416476 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416087    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-sys-fs\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.416476 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416117    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-run-ovn-kubernetes\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416201    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c500e88-9c68-4236-90da-59716c65e58a-host-slash\") pod \"iptables-alerter-sz2z5\" (UID: \"7c500e88-9c68-4236-90da-59716c65e58a\") " pod="openshift-network-operator/iptables-alerter-sz2z5"
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416240    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb5np\" (UniqueName: \"kubernetes.io/projected/7c500e88-9c68-4236-90da-59716c65e58a-kube-api-access-gb5np\") pod \"iptables-alerter-sz2z5\" (UID: \"7c500e88-9c68-4236-90da-59716c65e58a\") " pod="openshift-network-operator/iptables-alerter-sz2z5"
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416274    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a76885ac-b10f-40cd-aa28-4b274d95c017-dbus\") pod \"global-pull-secret-syncer-58wxg\" (UID: \"a76885ac-b10f-40cd-aa28-4b274d95c017\") " pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416305    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59f1bd39-6d31-460e-99be-5bb083479ba8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416302    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-hostroot\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416357    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-hostroot\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416379    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d7a538d-6907-487e-b67f-c68e86d0e043-serviceca\") pod \"node-ca-jmxt4\" (UID: \"7d7a538d-6907-487e-b67f-c68e86d0e043\") " pod="openshift-image-registry/node-ca-jmxt4"
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416414    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-host-var-lib-kubelet\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416473    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-etc-kubernetes\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416611    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a76885ac-b10f-40cd-aa28-4b274d95c017-dbus\") pod \"global-pull-secret-syncer-58wxg\" (UID: \"a76885ac-b10f-40cd-aa28-4b274d95c017\") " pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416834    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-run-ovn\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416873    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c500e88-9c68-4236-90da-59716c65e58a-host-slash\") pod \"iptables-alerter-sz2z5\" (UID: \"7c500e88-9c68-4236-90da-59716c65e58a\") " pod="openshift-network-operator/iptables-alerter-sz2z5"
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416930    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-cni-bin\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416962    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d7a538d-6907-487e-b67f-c68e86d0e043-serviceca\") pod \"node-ca-jmxt4\" (UID: \"7d7a538d-6907-487e-b67f-c68e86d0e043\") " pod="openshift-image-registry/node-ca-jmxt4"
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.416973    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-cni-netd\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.417070    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17adb24a-07f7-4f46-8c15-09eeb45d9b85-sys-fs\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.417086    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:19.417412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.417101    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgqvt\" (UniqueName: \"kubernetes.io/projected/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-kube-api-access-lgqvt\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.418398 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.417192    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-tuned\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.418398 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.417290    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs podName:b2421404-0026-4094-bf86-2f36fc0b21ea nodeName:}" failed. No retries permitted until 2026-07-08 21:06:19.917271034 +0000 UTC m=+3.011074560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs") pod "network-metrics-daemon-qjpwc" (UID: "b2421404-0026-4094-bf86-2f36fc0b21ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:19.418398 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.417325    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-sysconfig\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.418398 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.417360    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a084819-c4bf-41ef-ae06-5e982935c4b4-etc-sysconfig\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.418398 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.417408    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:06:19.418398 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.417436    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:06:19.418398 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.417450    2583 projected.go:196] Error preparing data for projected volume kube-api-access-57nx5 for pod openshift-network-diagnostics/network-check-target-ss6w5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:19.418398 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.417513    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5 podName:7dce3e47-c290-418d-ac0e-d723eaf6d93d nodeName:}" failed. No retries permitted until 2026-07-08 21:06:19.917498193 +0000 UTC m=+3.011301720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-57nx5" (UniqueName: "kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5") pod "network-check-target-ss6w5" (UID: "7dce3e47-c290-418d-ac0e-d723eaf6d93d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:19.418398 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.418084    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a084819-c4bf-41ef-ae06-5e982935c4b4-tmp\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.420408 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.420283    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8crl\" (UniqueName: \"kubernetes.io/projected/35d39013-c4de-41ad-9f73-d009a2207661-kube-api-access-h8crl\") pod \"node-resolver-8fkbn\" (UID: \"35d39013-c4de-41ad-9f73-d009a2207661\") " pod="openshift-dns/node-resolver-8fkbn"
Jul 08 21:06:19.421927 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.421900    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfkzz\" (UniqueName: \"kubernetes.io/projected/b2421404-0026-4094-bf86-2f36fc0b21ea-kube-api-access-gfkzz\") pod \"network-metrics-daemon-qjpwc\" (UID: \"b2421404-0026-4094-bf86-2f36fc0b21ea\") " pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:19.422922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.422895    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh4j2\" (UniqueName: \"kubernetes.io/projected/17adb24a-07f7-4f46-8c15-09eeb45d9b85-kube-api-access-hh4j2\") pod \"aws-ebs-csi-driver-node-ss4ww\" (UID: \"17adb24a-07f7-4f46-8c15-09eeb45d9b85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.423393 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.423290    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8ltn\" (UniqueName: \"kubernetes.io/projected/7a084819-c4bf-41ef-ae06-5e982935c4b4-kube-api-access-z8ltn\") pod \"tuned-p9st5\" (UID: \"7a084819-c4bf-41ef-ae06-5e982935c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.425300 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.423708    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9bvf\" (UniqueName: \"kubernetes.io/projected/7d7a538d-6907-487e-b67f-c68e86d0e043-kube-api-access-c9bvf\") pod \"node-ca-jmxt4\" (UID: \"7d7a538d-6907-487e-b67f-c68e86d0e043\") " pod="openshift-image-registry/node-ca-jmxt4"
Jul 08 21:06:19.425300 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.425136    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb5np\" (UniqueName: \"kubernetes.io/projected/7c500e88-9c68-4236-90da-59716c65e58a-kube-api-access-gb5np\") pod \"iptables-alerter-sz2z5\" (UID: \"7c500e88-9c68-4236-90da-59716c65e58a\") " pod="openshift-network-operator/iptables-alerter-sz2z5"
Jul 08 21:06:19.425629 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.425608    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdhxc\" (UniqueName: \"kubernetes.io/projected/59f1bd39-6d31-460e-99be-5bb083479ba8-kube-api-access-bdhxc\") pod \"multus-additional-cni-plugins-lz4xt\" (UID: \"59f1bd39-6d31-460e-99be-5bb083479ba8\") " pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.425791 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.425721    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgqvt\" (UniqueName: \"kubernetes.io/projected/0c1e243a-fc11-4e01-b2ec-cd50e5f2e610-kube-api-access-lgqvt\") pod \"multus-2bfh8\" (UID: \"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610\") " pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.428451 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.428407    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal" event={"ID":"acd4d634ee249d4b487dddc3a283d199","Type":"ContainerStarted","Data":"a6fed98388765cb43274e2c026df55127749d3eedd713d5b09d66af28518ac81"}
Jul 08 21:06:19.429961 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.429929    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" event={"ID":"fad7ab4e8604dec7835d117ad532794c","Type":"ContainerStarted","Data":"bc9224beb9e68e0318e866cc4fd012f81cec6889b941f679cc8e0a91e2f088d1"}
Jul 08 21:06:19.518636 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.518577    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-run-openvswitch\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.518636 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.518635    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-log-socket\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.518862 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.518661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-systemd-units\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.518862 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.518682    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-ovnkube-config\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.518862 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.518722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-run-netns\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.518862 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.518756    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-node-log\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.518862 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.518780    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-kubelet\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.518862 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.518805    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/594ec0f6-ccb6-4125-81f0-4ccf9115682b-agent-certs\") pod \"konnectivity-agent-stmvp\" (UID: \"594ec0f6-ccb6-4125-81f0-4ccf9115682b\") " pod="kube-system/konnectivity-agent-stmvp"
Jul 08 21:06:19.518862 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.518827    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-var-lib-openvswitch\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.518862 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.518860    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-ovn-node-metrics-cert\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.519229 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.518884    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-ovnkube-script-lib\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.519229 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.518921    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-run-ovn-kubernetes\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.519229 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.518962    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-run-ovn\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.519229 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.518986    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-cni-bin\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.519229 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.519010    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-cni-netd\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.519229 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.519035    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-slash\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.519229 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.519105    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-run-systemd\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.519229 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.519132    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrdpg\" (UniqueName: \"kubernetes.io/projected/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-kube-api-access-qrdpg\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.519229 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.519164    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-etc-openvswitch\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.519229 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.519192    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/594ec0f6-ccb6-4125-81f0-4ccf9115682b-konnectivity-ca\") pod \"konnectivity-agent-stmvp\" (UID: \"594ec0f6-ccb6-4125-81f0-4ccf9115682b\") " pod="kube-system/konnectivity-agent-stmvp"
Jul 08 21:06:19.519229 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.519218    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.519744 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.519243    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-env-overrides\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.519802    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-env-overrides\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.519890    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-run-netns\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.519896    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-etc-openvswitch\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.519908    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-run-ovn-kubernetes\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.519967    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-kubelet\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.519972    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.519985    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-cni-bin\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.519991    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-log-socket\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.520026    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-cni-netd\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.520038    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-run-systemd\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.520074    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-host-slash\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.520105    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-run-ovn\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.520130    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-systemd-units\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.520178    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-run-openvswitch\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.520206    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-node-log\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.520419    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-ovnkube-config\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.520464    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-var-lib-openvswitch\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.520492 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.520493    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/594ec0f6-ccb6-4125-81f0-4ccf9115682b-konnectivity-ca\") pod \"konnectivity-agent-stmvp\" (UID: \"594ec0f6-ccb6-4125-81f0-4ccf9115682b\") " pod="kube-system/konnectivity-agent-stmvp"
Jul 08 21:06:19.521481 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.521108    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-ovnkube-script-lib\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.523097 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.523072    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-ovn-node-metrics-cert\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.523527 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.523503    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/594ec0f6-ccb6-4125-81f0-4ccf9115682b-agent-certs\") pod \"konnectivity-agent-stmvp\" (UID: \"594ec0f6-ccb6-4125-81f0-4ccf9115682b\") " pod="kube-system/konnectivity-agent-stmvp"
Jul 08 21:06:19.528329 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.528274    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrdpg\" (UniqueName: \"kubernetes.io/projected/0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82-kube-api-access-qrdpg\") pod \"ovnkube-node-pwjgn\" (UID: \"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.597446 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.597411    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww"
Jul 08 21:06:19.605545 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.605516    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jmxt4"
Jul 08 21:06:19.607438 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:19.607411    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17adb24a_07f7_4f46_8c15_09eeb45d9b85.slice/crio-16c5cc0b0fa67d908698ce7131dff945f790bf03709490b6c60c7347b46fd000 WatchSource:0}: Error finding container 16c5cc0b0fa67d908698ce7131dff945f790bf03709490b6c60c7347b46fd000: Status 404 returned error can't find the container with id 16c5cc0b0fa67d908698ce7131dff945f790bf03709490b6c60c7347b46fd000
Jul 08 21:06:19.614891 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:19.614867    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d7a538d_6907_487e_b67f_c68e86d0e043.slice/crio-f75180eb07f6db1c021e6e83495e7803405b9734ddb794f1d2d40db3c3bc1d04 WatchSource:0}: Error finding container f75180eb07f6db1c021e6e83495e7803405b9734ddb794f1d2d40db3c3bc1d04: Status 404 returned error can't find the container with id f75180eb07f6db1c021e6e83495e7803405b9734ddb794f1d2d40db3c3bc1d04
Jul 08 21:06:19.617114 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.617091    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sz2z5"
Jul 08 21:06:19.623214 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.623194    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p9st5"
Jul 08 21:06:19.626414 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:19.626389    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c500e88_9c68_4236_90da_59716c65e58a.slice/crio-766c938ecf5041f82dade036d69835079768f8da7cd069e852eef89221c430ec WatchSource:0}: Error finding container 766c938ecf5041f82dade036d69835079768f8da7cd069e852eef89221c430ec: Status 404 returned error can't find the container with id 766c938ecf5041f82dade036d69835079768f8da7cd069e852eef89221c430ec
Jul 08 21:06:19.631829 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.631810    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8fkbn"
Jul 08 21:06:19.632403 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:19.632379    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a084819_c4bf_41ef_ae06_5e982935c4b4.slice/crio-dd3ef923e8609cee0067d4a3ad2ee1dd7624bff233414a2544987e78c1204c33 WatchSource:0}: Error finding container dd3ef923e8609cee0067d4a3ad2ee1dd7624bff233414a2544987e78c1204c33: Status 404 returned error can't find the container with id dd3ef923e8609cee0067d4a3ad2ee1dd7624bff233414a2544987e78c1204c33
Jul 08 21:06:19.639780 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.639744    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2bfh8"
Jul 08 21:06:19.639854 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:19.639792    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d39013_c4de_41ad_9f73_d009a2207661.slice/crio-a7aba09b5e045a1a4dc73b4a48a2b957017e47c5ad07c209d9e7c75f185512e3 WatchSource:0}: Error finding container a7aba09b5e045a1a4dc73b4a48a2b957017e47c5ad07c209d9e7c75f185512e3: Status 404 returned error can't find the container with id a7aba09b5e045a1a4dc73b4a48a2b957017e47c5ad07c209d9e7c75f185512e3
Jul 08 21:06:19.647718 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:19.647693    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c1e243a_fc11_4e01_b2ec_cd50e5f2e610.slice/crio-6c486b11bd0aa334686803ec980a4760bdebc26fc92b64b35f8b9ef9dfdbac87 WatchSource:0}: Error finding container 6c486b11bd0aa334686803ec980a4760bdebc26fc92b64b35f8b9ef9dfdbac87: Status 404 returned error can't find the container with id 6c486b11bd0aa334686803ec980a4760bdebc26fc92b64b35f8b9ef9dfdbac87
Jul 08 21:06:19.652023 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.652006    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lz4xt"
Jul 08 21:06:19.659465 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.659443    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:19.659789 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:19.659765    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f1bd39_6d31_460e_99be_5bb083479ba8.slice/crio-e907c8475c61336647f65aef968f010bf3706c373c35a229cb41bd509229135b WatchSource:0}: Error finding container e907c8475c61336647f65aef968f010bf3706c373c35a229cb41bd509229135b: Status 404 returned error can't find the container with id e907c8475c61336647f65aef968f010bf3706c373c35a229cb41bd509229135b
Jul 08 21:06:19.668580 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.668548    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-stmvp"
Jul 08 21:06:19.668850 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:19.668817    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c5b22c4_aa3d_4cd2_80c2_b8acfcc6da82.slice/crio-328974a3966f235d7a959865f8908006769a54d85e5e66fe42bc683788856d93 WatchSource:0}: Error finding container 328974a3966f235d7a959865f8908006769a54d85e5e66fe42bc683788856d93: Status 404 returned error can't find the container with id 328974a3966f235d7a959865f8908006769a54d85e5e66fe42bc683788856d93
Jul 08 21:06:19.678017 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:19.677995    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod594ec0f6_ccb6_4125_81f0_4ccf9115682b.slice/crio-66378907dc56b7feb482f8242bc05bca272634007c98e3adf5a16e955915f13c WatchSource:0}: Error finding container 66378907dc56b7feb482f8242bc05bca272634007c98e3adf5a16e955915f13c: Status 404 returned error can't find the container with id 66378907dc56b7feb482f8242bc05bca272634007c98e3adf5a16e955915f13c
Jul 08 21:06:19.922723 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.922632    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs\") pod \"network-metrics-daemon-qjpwc\" (UID: \"b2421404-0026-4094-bf86-2f36fc0b21ea\") " pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:19.922723 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.922703    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57nx5\" (UniqueName: \"kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5\") pod \"network-check-target-ss6w5\" (UID: \"7dce3e47-c290-418d-ac0e-d723eaf6d93d\") " pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:19.922933 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:19.922743    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret\") pod \"global-pull-secret-syncer-58wxg\" (UID: \"a76885ac-b10f-40cd-aa28-4b274d95c017\") " pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:19.922933 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.922848    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:19.922933 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.922924    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs podName:b2421404-0026-4094-bf86-2f36fc0b21ea nodeName:}" failed. No retries permitted until 2026-07-08 21:06:20.922905359 +0000 UTC m=+4.016708884 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs") pod "network-metrics-daemon-qjpwc" (UID: "b2421404-0026-4094-bf86-2f36fc0b21ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:19.923064 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.922853    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:19.923064 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.923013    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret podName:a76885ac-b10f-40cd-aa28-4b274d95c017 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:20.922996493 +0000 UTC m=+4.016800029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret") pod "global-pull-secret-syncer-58wxg" (UID: "a76885ac-b10f-40cd-aa28-4b274d95c017") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:19.923064 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.922856    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:06:19.923064 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.923042    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:06:19.923064 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.923055    2583 projected.go:196] Error preparing data for projected volume kube-api-access-57nx5 for pod openshift-network-diagnostics/network-check-target-ss6w5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:19.923269 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:19.923092    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5 podName:7dce3e47-c290-418d-ac0e-d723eaf6d93d nodeName:}" failed. No retries permitted until 2026-07-08 21:06:20.923081163 +0000 UTC m=+4.016884703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-57nx5" (UniqueName: "kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5") pod "network-check-target-ss6w5" (UID: "7dce3e47-c290-418d-ac0e-d723eaf6d93d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:20.352675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:20.352565    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 21:01:19 +0000 UTC" deadline="2028-02-02 14:43:34.166362322 +0000 UTC"
Jul 08 21:06:20.352675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:20.352631    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13769h37m13.813742895s"
Jul 08 21:06:20.433148 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:20.433111    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-stmvp" event={"ID":"594ec0f6-ccb6-4125-81f0-4ccf9115682b","Type":"ContainerStarted","Data":"66378907dc56b7feb482f8242bc05bca272634007c98e3adf5a16e955915f13c"}
Jul 08 21:06:20.434437 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:20.434402    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jmxt4" event={"ID":"7d7a538d-6907-487e-b67f-c68e86d0e043","Type":"ContainerStarted","Data":"f75180eb07f6db1c021e6e83495e7803405b9734ddb794f1d2d40db3c3bc1d04"}
Jul 08 21:06:20.435702 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:20.435672    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww" event={"ID":"17adb24a-07f7-4f46-8c15-09eeb45d9b85","Type":"ContainerStarted","Data":"16c5cc0b0fa67d908698ce7131dff945f790bf03709490b6c60c7347b46fd000"}
Jul 08 21:06:20.436893 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:20.436868    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn" event={"ID":"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82","Type":"ContainerStarted","Data":"328974a3966f235d7a959865f8908006769a54d85e5e66fe42bc683788856d93"}
Jul 08 21:06:20.438619 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:20.438580    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lz4xt" event={"ID":"59f1bd39-6d31-460e-99be-5bb083479ba8","Type":"ContainerStarted","Data":"e907c8475c61336647f65aef968f010bf3706c373c35a229cb41bd509229135b"}
Jul 08 21:06:20.439874 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:20.439840    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2bfh8" event={"ID":"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610","Type":"ContainerStarted","Data":"6c486b11bd0aa334686803ec980a4760bdebc26fc92b64b35f8b9ef9dfdbac87"}
Jul 08 21:06:20.441221 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:20.441176    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8fkbn" event={"ID":"35d39013-c4de-41ad-9f73-d009a2207661","Type":"ContainerStarted","Data":"a7aba09b5e045a1a4dc73b4a48a2b957017e47c5ad07c209d9e7c75f185512e3"}
Jul 08 21:06:20.442560 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:20.442397    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p9st5" event={"ID":"7a084819-c4bf-41ef-ae06-5e982935c4b4","Type":"ContainerStarted","Data":"dd3ef923e8609cee0067d4a3ad2ee1dd7624bff233414a2544987e78c1204c33"}
Jul 08 21:06:20.443660 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:20.443636    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sz2z5" event={"ID":"7c500e88-9c68-4236-90da-59716c65e58a","Type":"ContainerStarted","Data":"766c938ecf5041f82dade036d69835079768f8da7cd069e852eef89221c430ec"}
Jul 08 21:06:20.932158 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:20.931198    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs\") pod \"network-metrics-daemon-qjpwc\" (UID: \"b2421404-0026-4094-bf86-2f36fc0b21ea\") " pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:20.932158 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:20.931265    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57nx5\" (UniqueName: \"kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5\") pod \"network-check-target-ss6w5\" (UID: \"7dce3e47-c290-418d-ac0e-d723eaf6d93d\") " pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:20.932158 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:20.931306    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret\") pod \"global-pull-secret-syncer-58wxg\" (UID: \"a76885ac-b10f-40cd-aa28-4b274d95c017\") " pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:20.932158 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:20.931477    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:20.932158 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:20.931537    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret podName:a76885ac-b10f-40cd-aa28-4b274d95c017 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:22.931520089 +0000 UTC m=+6.025323617 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret") pod "global-pull-secret-syncer-58wxg" (UID: "a76885ac-b10f-40cd-aa28-4b274d95c017") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:20.932158 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:20.931937    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:20.932158 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:20.931985    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs podName:b2421404-0026-4094-bf86-2f36fc0b21ea nodeName:}" failed. No retries permitted until 2026-07-08 21:06:22.931970745 +0000 UTC m=+6.025774274 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs") pod "network-metrics-daemon-qjpwc" (UID: "b2421404-0026-4094-bf86-2f36fc0b21ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:20.932158 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:20.932064    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:06:20.932158 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:20.932078    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:06:20.932158 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:20.932092    2583 projected.go:196] Error preparing data for projected volume kube-api-access-57nx5 for pod openshift-network-diagnostics/network-check-target-ss6w5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:20.932158 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:20.932127    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5 podName:7dce3e47-c290-418d-ac0e-d723eaf6d93d nodeName:}" failed. No retries permitted until 2026-07-08 21:06:22.932115331 +0000 UTC m=+6.025918856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-57nx5" (UniqueName: "kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5") pod "network-check-target-ss6w5" (UID: "7dce3e47-c290-418d-ac0e-d723eaf6d93d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:21.353409 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:21.353337    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 21:01:19 +0000 UTC" deadline="2027-12-18 08:16:11.283151024 +0000 UTC"
Jul 08 21:06:21.353409 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:21.353370    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12659h9m49.929784791s"
Jul 08 21:06:21.431536 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:21.429176    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:21.431536 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:21.429314    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:21.431536 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:21.429849    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:21.431536 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:21.429959    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:21.431536 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:21.430160    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:21.431536 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:21.430240    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:22.458445 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:22.458151    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal" event={"ID":"acd4d634ee249d4b487dddc3a283d199","Type":"ContainerStarted","Data":"35ff106be2473b16c6c4cd0afc079c710a87e4d13c0fc43e470de718659efbfa"}
Jul 08 21:06:22.472715 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:22.472671    2583 generic.go:356] "Generic (PLEG): container finished" podID="fad7ab4e8604dec7835d117ad532794c" containerID="03f079f34a8f8846f22010a49f610447c9f03e652cb15ed5ecf79b977267e083" exitCode=0
Jul 08 21:06:22.472871 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:22.472719    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" event={"ID":"fad7ab4e8604dec7835d117ad532794c","Type":"ContainerDied","Data":"03f079f34a8f8846f22010a49f610447c9f03e652cb15ed5ecf79b977267e083"}
Jul 08 21:06:22.489865 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:22.489375    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal" podStartSLOduration=4.48935461 podStartE2EDuration="4.48935461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:22.471794052 +0000 UTC m=+5.565597600" watchObservedRunningTime="2026-07-08 21:06:22.48935461 +0000 UTC m=+5.583158158"
Jul 08 21:06:22.951773 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:22.951685    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57nx5\" (UniqueName: \"kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5\") pod \"network-check-target-ss6w5\" (UID: \"7dce3e47-c290-418d-ac0e-d723eaf6d93d\") " pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:22.951773 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:22.951753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret\") pod \"global-pull-secret-syncer-58wxg\" (UID: \"a76885ac-b10f-40cd-aa28-4b274d95c017\") " pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:22.951983 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:22.951820    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs\") pod \"network-metrics-daemon-qjpwc\" (UID: \"b2421404-0026-4094-bf86-2f36fc0b21ea\") " pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:22.951983 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:22.951940    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:22.952088 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:22.952003    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs podName:b2421404-0026-4094-bf86-2f36fc0b21ea nodeName:}" failed. No retries permitted until 2026-07-08 21:06:26.951984787 +0000 UTC m=+10.045788315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs") pod "network-metrics-daemon-qjpwc" (UID: "b2421404-0026-4094-bf86-2f36fc0b21ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:22.952488 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:22.952435    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:06:22.952488 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:22.952461    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:06:22.952488 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:22.952473    2583 projected.go:196] Error preparing data for projected volume kube-api-access-57nx5 for pod openshift-network-diagnostics/network-check-target-ss6w5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:22.952699 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:22.952518    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5 podName:7dce3e47-c290-418d-ac0e-d723eaf6d93d nodeName:}" failed. No retries permitted until 2026-07-08 21:06:26.952503193 +0000 UTC m=+10.046306733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-57nx5" (UniqueName: "kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5") pod "network-check-target-ss6w5" (UID: "7dce3e47-c290-418d-ac0e-d723eaf6d93d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:22.952699 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:22.952580    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:22.952699 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:22.952757    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret podName:a76885ac-b10f-40cd-aa28-4b274d95c017 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:26.952742411 +0000 UTC m=+10.046545943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret") pod "global-pull-secret-syncer-58wxg" (UID: "a76885ac-b10f-40cd-aa28-4b274d95c017") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:23.424362 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:23.424288    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:23.424523 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:23.424415    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:23.424735 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:23.424712    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:23.424847 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:23.424827    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:23.424912 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:23.424888    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:23.425014 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:23.424972    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:25.425103 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:25.424968    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:25.425103 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:25.425006    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:25.425103 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:25.425096    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:25.425698 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:25.425142    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:25.425698 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:25.425170    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:25.425698 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:25.425260    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:26.985036 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:26.984154    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs\") pod \"network-metrics-daemon-qjpwc\" (UID: \"b2421404-0026-4094-bf86-2f36fc0b21ea\") " pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:26.985036 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:26.984220    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57nx5\" (UniqueName: \"kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5\") pod \"network-check-target-ss6w5\" (UID: \"7dce3e47-c290-418d-ac0e-d723eaf6d93d\") " pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:26.985036 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:26.984260    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret\") pod \"global-pull-secret-syncer-58wxg\" (UID: \"a76885ac-b10f-40cd-aa28-4b274d95c017\") " pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:26.985036 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:26.984387    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:26.985036 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:26.984444    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret podName:a76885ac-b10f-40cd-aa28-4b274d95c017 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:34.984425803 +0000 UTC m=+18.078229332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret") pod "global-pull-secret-syncer-58wxg" (UID: "a76885ac-b10f-40cd-aa28-4b274d95c017") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:26.985036 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:26.984826    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:26.985036 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:26.984874    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs podName:b2421404-0026-4094-bf86-2f36fc0b21ea nodeName:}" failed. No retries permitted until 2026-07-08 21:06:34.984858646 +0000 UTC m=+18.078662177 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs") pod "network-metrics-daemon-qjpwc" (UID: "b2421404-0026-4094-bf86-2f36fc0b21ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:26.985036 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:26.984944    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:06:26.985036 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:26.984960    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:06:26.985036 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:26.984972    2583 projected.go:196] Error preparing data for projected volume kube-api-access-57nx5 for pod openshift-network-diagnostics/network-check-target-ss6w5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:26.985036 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:26.985003    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5 podName:7dce3e47-c290-418d-ac0e-d723eaf6d93d nodeName:}" failed. No retries permitted until 2026-07-08 21:06:34.98499376 +0000 UTC m=+18.078797286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-57nx5" (UniqueName: "kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5") pod "network-check-target-ss6w5" (UID: "7dce3e47-c290-418d-ac0e-d723eaf6d93d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:27.425466 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:27.425395    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:27.425682 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:27.425483    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:27.425682 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:27.425500    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:27.425682 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:27.425609    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:27.425682 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:27.425672    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:27.425895 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:27.425756    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:29.424674 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:29.424641    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:29.425108 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:29.424803    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:29.425108 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:29.424826    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:29.425108 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:29.424911    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:29.425108 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:29.424960    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:29.425108 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:29.425065    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:31.424255 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:31.424218    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:31.424727 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:31.424219    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:31.424727 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:31.424374    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:31.424727 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:31.424218    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:31.424727 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:31.424450    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:31.424727 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:31.424537    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:33.424255 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:33.424220    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:33.424728 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:33.424220    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:33.424728 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:33.424345    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:33.424728 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:33.424220    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:33.424728 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:33.424449    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:33.424728 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:33.424546    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:35.042376 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:35.042337    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs\") pod \"network-metrics-daemon-qjpwc\" (UID: \"b2421404-0026-4094-bf86-2f36fc0b21ea\") " pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:35.042905 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:35.042388    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57nx5\" (UniqueName: \"kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5\") pod \"network-check-target-ss6w5\" (UID: \"7dce3e47-c290-418d-ac0e-d723eaf6d93d\") " pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:35.042905 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:35.042427    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret\") pod \"global-pull-secret-syncer-58wxg\" (UID: \"a76885ac-b10f-40cd-aa28-4b274d95c017\") " pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:35.042905 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:35.042516    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:35.042905 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:35.042537    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:35.042905 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:35.042598    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:06:35.042905 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:35.042623    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:06:35.042905 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:35.042637    2583 projected.go:196] Error preparing data for projected volume kube-api-access-57nx5 for pod openshift-network-diagnostics/network-check-target-ss6w5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:35.042905 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:35.042602    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs podName:b2421404-0026-4094-bf86-2f36fc0b21ea nodeName:}" failed. No retries permitted until 2026-07-08 21:06:51.042566501 +0000 UTC m=+34.136370043 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs") pod "network-metrics-daemon-qjpwc" (UID: "b2421404-0026-4094-bf86-2f36fc0b21ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:35.042905 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:35.042699    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret podName:a76885ac-b10f-40cd-aa28-4b274d95c017 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:51.042682873 +0000 UTC m=+34.136486404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret") pod "global-pull-secret-syncer-58wxg" (UID: "a76885ac-b10f-40cd-aa28-4b274d95c017") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:35.042905 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:35.042717    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5 podName:7dce3e47-c290-418d-ac0e-d723eaf6d93d nodeName:}" failed. No retries permitted until 2026-07-08 21:06:51.042710174 +0000 UTC m=+34.136513699 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-57nx5" (UniqueName: "kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5") pod "network-check-target-ss6w5" (UID: "7dce3e47-c290-418d-ac0e-d723eaf6d93d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:35.424746 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:35.424656    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:35.424897 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:35.424663    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:35.424897 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:35.424778    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:35.424897 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:35.424663    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:35.424897 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:35.424861    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:35.425105 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:35.424948    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:37.425077 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:37.425044    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:37.425506 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:37.425140    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:37.425506 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:37.425438    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:37.425641 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:37.425608    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:37.425690 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:37.425622    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:37.425783 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:37.425761    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:39.427794 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.427415    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:39.428511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.427450    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:39.428511 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:39.427847    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:39.428511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.427458    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:39.428511 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:39.427885    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:39.428511 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:39.427989    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:39.508931 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.508890    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn" event={"ID":"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82","Type":"ContainerStarted","Data":"16b3d40f4d68ed2827c4b7acf7342098dfebac6f2b3451d648f3d12e7405aa61"}
Jul 08 21:06:39.509131 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.508965    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn" event={"ID":"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82","Type":"ContainerStarted","Data":"6ca74522c9a03274170dc8a492f799610f46da0c26f367927f7a169171feb04d"}
Jul 08 21:06:39.509131 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.509008    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn" event={"ID":"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82","Type":"ContainerStarted","Data":"50d1e45ea386461fa23b5324020c72c39a56a9ef2b39be872d8436d857f769c0"}
Jul 08 21:06:39.509131 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.509053    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn" event={"ID":"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82","Type":"ContainerStarted","Data":"6d118ff3186cfc065d32e6f9a7f9f38cce992b1be5da726797aa95a379cc926e"}
Jul 08 21:06:39.509131 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.509084    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn" event={"ID":"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82","Type":"ContainerStarted","Data":"84f704a5323a94a154ddfb0a2110e2eb18e84c8fec3433feebfc5e041dd8680f"}
Jul 08 21:06:39.509131 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.509110    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn" event={"ID":"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82","Type":"ContainerStarted","Data":"0250f1a7b5f09ef98e9b4d4f96a5318b9ce9abe1aa3c12c9175aacb11bac1b8a"}
Jul 08 21:06:39.510391 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.510359    2583 generic.go:356] "Generic (PLEG): container finished" podID="59f1bd39-6d31-460e-99be-5bb083479ba8" containerID="f1a7773e561b9aaf8a36214aae8e6db19b5dffc94011781c868013d8172aa630" exitCode=0
Jul 08 21:06:39.510497 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.510447    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lz4xt" event={"ID":"59f1bd39-6d31-460e-99be-5bb083479ba8","Type":"ContainerDied","Data":"f1a7773e561b9aaf8a36214aae8e6db19b5dffc94011781c868013d8172aa630"}
Jul 08 21:06:39.512019 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.511996    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2bfh8" event={"ID":"0c1e243a-fc11-4e01-b2ec-cd50e5f2e610","Type":"ContainerStarted","Data":"4e014857543482e4003b209ff2ee3c1039c70f0f9356f6415e11c15a25b32702"}
Jul 08 21:06:39.513477 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.513454    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8fkbn" event={"ID":"35d39013-c4de-41ad-9f73-d009a2207661","Type":"ContainerStarted","Data":"6fef7bc911615d82b53b93457e56b1cd4bdef70bb4bc7703f95c76d83e12fed5"}
Jul 08 21:06:39.514790 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.514766    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p9st5" event={"ID":"7a084819-c4bf-41ef-ae06-5e982935c4b4","Type":"ContainerStarted","Data":"2170f736ddcc77559a56cf7c39195a6affea66108febacd1a88e6136290808c5"}
Jul 08 21:06:39.516556 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.516539    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" event={"ID":"fad7ab4e8604dec7835d117ad532794c","Type":"ContainerStarted","Data":"ec9a5947ba8e79309c5c93606aa1bbfce57a9d172dbde5a6c45756693dadfb20"}
Jul 08 21:06:39.517872 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.517853    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-stmvp" event={"ID":"594ec0f6-ccb6-4125-81f0-4ccf9115682b","Type":"ContainerStarted","Data":"4ecabbfe6e83300b4648045b606be68916bdb61375e62eadaf0a21c97ac998bd"}
Jul 08 21:06:39.519086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.519065    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jmxt4" event={"ID":"7d7a538d-6907-487e-b67f-c68e86d0e043","Type":"ContainerStarted","Data":"6b343819bfbd7ff73fce34d743ced1c54c69c8cb5aa18c418632118cef82e294"}
Jul 08 21:06:39.520287 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.520268    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww" event={"ID":"17adb24a-07f7-4f46-8c15-09eeb45d9b85","Type":"ContainerStarted","Data":"411a8dae68aeb0509773004f47a55081eb8e87881b29fe5fa62ccf9b9d90e26a"}
Jul 08 21:06:39.545344 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.545303    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8fkbn" podStartSLOduration=3.576584372 podStartE2EDuration="22.545289598s" totalImagesPullingTime="18.968705226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:39.545224378 +0000 UTC m=+22.639027936" watchObservedRunningTime="2026-07-08 21:06:39.545289598 +0000 UTC m=+22.639093145"
Jul 08 21:06:39.560333 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.560285    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2bfh8" podStartSLOduration=3.547744451 podStartE2EDuration="22.560270573s" totalImagesPullingTime="19.012526122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:39.559868762 +0000 UTC m=+22.653672308" watchObservedRunningTime="2026-07-08 21:06:39.560270573 +0000 UTC m=+22.654074147"
Jul 08 21:06:39.574169 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.574099    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p9st5" podStartSLOduration=3.5945376749999998 podStartE2EDuration="22.574081429s" totalImagesPullingTime="18.979543754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:39.573900732 +0000 UTC m=+22.667704278" watchObservedRunningTime="2026-07-08 21:06:39.574081429 +0000 UTC m=+22.667884977"
Jul 08 21:06:39.587845 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.587805    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-stmvp" podStartSLOduration=11.888362442 podStartE2EDuration="22.587791775s" totalImagesPullingTime="10.699429333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:39.58727097 +0000 UTC m=+22.681074516" watchObservedRunningTime="2026-07-08 21:06:39.587791775 +0000 UTC m=+22.681595321"
Jul 08 21:06:39.601380 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.601340    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" podStartSLOduration=21.601331035 podStartE2EDuration="21.601331035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:39.601164684 +0000 UTC m=+22.694968230" watchObservedRunningTime="2026-07-08 21:06:39.601331035 +0000 UTC m=+22.695134581"
Jul 08 21:06:39.617363 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.615710    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jmxt4" podStartSLOduration=3.622968118 podStartE2EDuration="22.61569144s" totalImagesPullingTime="18.992723322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:39.614457269 +0000 UTC m=+22.708260828" watchObservedRunningTime="2026-07-08 21:06:39.61569144 +0000 UTC m=+22.709494989"
Jul 08 21:06:39.663801 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.663764    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-stmvp"
Jul 08 21:06:39.664307 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:39.664290    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-stmvp"
Jul 08 21:06:40.523511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:40.523474    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sz2z5" event={"ID":"7c500e88-9c68-4236-90da-59716c65e58a","Type":"ContainerStarted","Data":"29426e55d941c558b9a533641ad1c0f38eb73f5e25a45e4a06c857c40ffb01f0"}
Jul 08 21:06:40.524280 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:40.524263    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-stmvp"
Jul 08 21:06:40.524702 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:40.524684    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-stmvp"
Jul 08 21:06:40.539232 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:40.539194    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sz2z5" podStartSLOduration=4.55659885 podStartE2EDuration="23.539181943s" totalImagesPullingTime="18.982583093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:40.539094746 +0000 UTC m=+23.632898293" watchObservedRunningTime="2026-07-08 21:06:40.539181943 +0000 UTC m=+23.632985490"
Jul 08 21:06:40.679015 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:40.678993    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 21:06:41.366373 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:41.366261    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T21:06:40.679010711Z","UUID":"e172185c-e0fc-4c32-aa63-a026805ce16b","Handler":null,"Name":"","Endpoint":""}
Jul 08 21:06:41.368272 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:41.368251    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 21:06:41.368396 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:41.368293    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 21:06:41.425110 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:41.424916    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:41.425225 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:41.424916    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:41.425225 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:41.425198    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:41.425338 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:41.424916    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:41.425338 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:41.425284    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:41.425440 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:41.425381    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:41.527116 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:41.527080    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww" event={"ID":"17adb24a-07f7-4f46-8c15-09eeb45d9b85","Type":"ContainerStarted","Data":"7c249ee94102903108310c7d7a21575d3a53da4d91d1238437c62eb10d97f93a"}
Jul 08 21:06:41.530147 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:41.530123    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn" event={"ID":"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82","Type":"ContainerStarted","Data":"ab8b1d8e46fab357b95292e79ad95a315ac5c9cc6133ad4b2841ff0735176bfb"}
Jul 08 21:06:42.534356 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:42.534321    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww" event={"ID":"17adb24a-07f7-4f46-8c15-09eeb45d9b85","Type":"ContainerStarted","Data":"e33c93d9b42018e594a1351d81114711c831b11a76100b27cc853150029999f4"}
Jul 08 21:06:42.550905 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:42.550855    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4ww" podStartSLOduration=3.595588764 podStartE2EDuration="25.55084225s" totalImagesPullingTime="21.955253486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:42.549263364 +0000 UTC m=+25.643066922" watchObservedRunningTime="2026-07-08 21:06:42.55084225 +0000 UTC m=+25.644645796"
Jul 08 21:06:43.424447 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:43.424414    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:43.424710 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:43.424415    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:43.424710 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:43.424514    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:43.424710 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:43.424424    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:43.424710 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:43.424629    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:43.424870 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:43.424734    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:44.542797 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:44.542340    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn" event={"ID":"0c5b22c4-aa3d-4cd2-80c2-b8acfcc6da82","Type":"ContainerStarted","Data":"23eb9f7021ad3c9a7f53d4fc38a1c4da504d3f7d3f7932973a6dce00e4cb5239"}
Jul 08 21:06:44.542797 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:44.542672    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:44.542797 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:44.542725    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:44.560884 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:44.560862    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:44.569615 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:44.568810    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn" podStartSLOduration=8.54267444 podStartE2EDuration="27.568793582s" totalImagesPullingTime="19.026119142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:44.567877714 +0000 UTC m=+27.661681261" watchObservedRunningTime="2026-07-08 21:06:44.568793582 +0000 UTC m=+27.662597130"
Jul 08 21:06:45.424300 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:45.424226    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:45.424300 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:45.424268    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:45.424495 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:45.424234    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:45.424495 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:45.424364    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:45.424611 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:45.424486    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:45.424611 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:45.424580    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:45.545075 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:45.545033    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:45.562107 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:45.562076    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:06:45.856295 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:45.856262    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ss6w5"]
Jul 08 21:06:45.856451 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:45.856367    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:45.856532 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:45.856482    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:45.859134 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:45.859103    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-58wxg"]
Jul 08 21:06:45.859702 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:45.859212    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:45.859702 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:45.859306    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:45.859906 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:45.859883    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qjpwc"]
Jul 08 21:06:45.860009 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:45.859980    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:45.860179 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:45.860084    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:47.425334 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:47.425173    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:47.425834 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:47.425380    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:47.425834 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:47.425278    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:47.425834 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:47.425437    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:47.425834 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:47.425252    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:47.425834 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:47.425493    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:47.551668 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:47.551630    2583 generic.go:356] "Generic (PLEG): container finished" podID="59f1bd39-6d31-460e-99be-5bb083479ba8" containerID="c01aad5b052543112a19ea7b5c58b9e462930ed8ec9cf9f4f57cd7e960e82ee7" exitCode=0
Jul 08 21:06:47.551829 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:47.551703    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lz4xt" event={"ID":"59f1bd39-6d31-460e-99be-5bb083479ba8","Type":"ContainerDied","Data":"c01aad5b052543112a19ea7b5c58b9e462930ed8ec9cf9f4f57cd7e960e82ee7"}
Jul 08 21:06:48.555540 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:48.555509    2583 generic.go:356] "Generic (PLEG): container finished" podID="59f1bd39-6d31-460e-99be-5bb083479ba8" containerID="aea741fd8b8bca2c3a1217bebad88018e065fa69d0555ea4a54b500afb2c2052" exitCode=0
Jul 08 21:06:48.556185 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:48.555557    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lz4xt" event={"ID":"59f1bd39-6d31-460e-99be-5bb083479ba8","Type":"ContainerDied","Data":"aea741fd8b8bca2c3a1217bebad88018e065fa69d0555ea4a54b500afb2c2052"}
Jul 08 21:06:49.424703 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:49.424671    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:49.424703 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:49.424704    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:49.424893 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:49.424678    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:49.424893 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:49.424797    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:49.424893 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:49.424856    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:49.424979 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:49.424914    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:50.561519 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:50.561490    2583 generic.go:356] "Generic (PLEG): container finished" podID="59f1bd39-6d31-460e-99be-5bb083479ba8" containerID="033a24a6c999851d4cf6788fe102aade59952c9dcf0683656429c0580508b4fb" exitCode=0
Jul 08 21:06:50.561870 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:50.561539    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lz4xt" event={"ID":"59f1bd39-6d31-460e-99be-5bb083479ba8","Type":"ContainerDied","Data":"033a24a6c999851d4cf6788fe102aade59952c9dcf0683656429c0580508b4fb"}
Jul 08 21:06:51.065619 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:51.065573    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret\") pod \"global-pull-secret-syncer-58wxg\" (UID: \"a76885ac-b10f-40cd-aa28-4b274d95c017\") " pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:51.065762 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:51.065643    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs\") pod \"network-metrics-daemon-qjpwc\" (UID: \"b2421404-0026-4094-bf86-2f36fc0b21ea\") " pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:51.065762 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:51.065684    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57nx5\" (UniqueName: \"kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5\") pod \"network-check-target-ss6w5\" (UID: \"7dce3e47-c290-418d-ac0e-d723eaf6d93d\") " pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:51.065762 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:51.065726    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:51.065888 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:51.065761    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:51.065888 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:51.065787    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret podName:a76885ac-b10f-40cd-aa28-4b274d95c017 nodeName:}" failed. No retries permitted until 2026-07-08 21:07:23.065769508 +0000 UTC m=+66.159573038 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret") pod "global-pull-secret-syncer-58wxg" (UID: "a76885ac-b10f-40cd-aa28-4b274d95c017") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:51.065888 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:51.065787    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:06:51.065888 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:51.065805    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:06:51.065888 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:51.065816    2583 projected.go:196] Error preparing data for projected volume kube-api-access-57nx5 for pod openshift-network-diagnostics/network-check-target-ss6w5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:51.065888 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:51.065815    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs podName:b2421404-0026-4094-bf86-2f36fc0b21ea nodeName:}" failed. No retries permitted until 2026-07-08 21:07:23.065801268 +0000 UTC m=+66.159604793 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs") pod "network-metrics-daemon-qjpwc" (UID: "b2421404-0026-4094-bf86-2f36fc0b21ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:51.065888 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:51.065848    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5 podName:7dce3e47-c290-418d-ac0e-d723eaf6d93d nodeName:}" failed. No retries permitted until 2026-07-08 21:07:23.065837203 +0000 UTC m=+66.159640729 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-57nx5" (UniqueName: "kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5") pod "network-check-target-ss6w5" (UID: "7dce3e47-c290-418d-ac0e-d723eaf6d93d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:51.424226 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:51.424005    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:51.424226 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:51.424009    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:51.424226 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:51.424145    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ss6w5" podUID="7dce3e47-c290-418d-ac0e-d723eaf6d93d"
Jul 08 21:06:51.424226 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:51.424187    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:51.424633 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:51.424322    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58wxg" podUID="a76885ac-b10f-40cd-aa28-4b274d95c017"
Jul 08 21:06:51.424633 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:51.424410    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:06:52.184208 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.184183    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeReady"
Jul 08 21:06:52.184644 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.184298    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 21:06:52.224312 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.224284    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rw49m"]
Jul 08 21:06:52.231171 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.231142    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-b4q7m"]
Jul 08 21:06:52.231312 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.231269    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rw49m"
Jul 08 21:06:52.233797 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.233774    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 21:06:52.233932 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.233832    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 21:06:52.233932 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.233885    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ltsxq\""
Jul 08 21:06:52.234998 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.234861    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b4q7m"
Jul 08 21:06:52.235814 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.235791    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rw49m"]
Jul 08 21:06:52.237071 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.237051    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 21:06:52.237203 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.237183    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vg9kt\""
Jul 08 21:06:52.237683 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.237657    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 21:06:52.238129 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.238102    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 21:06:52.238667 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.238649    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b4q7m"]
Jul 08 21:06:52.376736 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.376703    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbmz2\" (UniqueName: \"kubernetes.io/projected/723ef4ae-7bd1-4f3e-9824-68a3117131cd-kube-api-access-zbmz2\") pod \"ingress-canary-b4q7m\" (UID: \"723ef4ae-7bd1-4f3e-9824-68a3117131cd\") " pod="openshift-ingress-canary/ingress-canary-b4q7m"
Jul 08 21:06:52.376736 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.376740    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/352a5cba-6f07-4f24-bd51-c1f8c52c6848-tmp-dir\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:06:52.377009 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.376779    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:06:52.377009 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.376857    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/723ef4ae-7bd1-4f3e-9824-68a3117131cd-cert\") pod \"ingress-canary-b4q7m\" (UID: \"723ef4ae-7bd1-4f3e-9824-68a3117131cd\") " pod="openshift-ingress-canary/ingress-canary-b4q7m"
Jul 08 21:06:52.377009 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.376895    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/352a5cba-6f07-4f24-bd51-c1f8c52c6848-config-volume\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:06:52.377009 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.376912    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22phl\" (UniqueName: \"kubernetes.io/projected/352a5cba-6f07-4f24-bd51-c1f8c52c6848-kube-api-access-22phl\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:06:52.478306 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.478220    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/723ef4ae-7bd1-4f3e-9824-68a3117131cd-cert\") pod \"ingress-canary-b4q7m\" (UID: \"723ef4ae-7bd1-4f3e-9824-68a3117131cd\") " pod="openshift-ingress-canary/ingress-canary-b4q7m"
Jul 08 21:06:52.478306 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.478292    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/352a5cba-6f07-4f24-bd51-c1f8c52c6848-config-volume\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:06:52.478535 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.478322    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22phl\" (UniqueName: \"kubernetes.io/projected/352a5cba-6f07-4f24-bd51-c1f8c52c6848-kube-api-access-22phl\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:06:52.478535 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.478359    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbmz2\" (UniqueName: \"kubernetes.io/projected/723ef4ae-7bd1-4f3e-9824-68a3117131cd-kube-api-access-zbmz2\") pod \"ingress-canary-b4q7m\" (UID: \"723ef4ae-7bd1-4f3e-9824-68a3117131cd\") " pod="openshift-ingress-canary/ingress-canary-b4q7m"
Jul 08 21:06:52.478667 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.478564    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/352a5cba-6f07-4f24-bd51-c1f8c52c6848-tmp-dir\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:06:52.478667 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.478661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:06:52.478797 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:52.478782    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:06:52.478852 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:52.478835    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls podName:352a5cba-6f07-4f24-bd51-c1f8c52c6848 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:52.978820788 +0000 UTC m=+36.072624314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls") pod "dns-default-rw49m" (UID: "352a5cba-6f07-4f24-bd51-c1f8c52c6848") : secret "dns-default-metrics-tls" not found
Jul 08 21:06:52.478912 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.478855    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/352a5cba-6f07-4f24-bd51-c1f8c52c6848-tmp-dir\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:06:52.478912 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.478891    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/352a5cba-6f07-4f24-bd51-c1f8c52c6848-config-volume\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:06:52.483099 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.483074    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/723ef4ae-7bd1-4f3e-9824-68a3117131cd-cert\") pod \"ingress-canary-b4q7m\" (UID: \"723ef4ae-7bd1-4f3e-9824-68a3117131cd\") " pod="openshift-ingress-canary/ingress-canary-b4q7m"
Jul 08 21:06:52.487841 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.487812    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbmz2\" (UniqueName: \"kubernetes.io/projected/723ef4ae-7bd1-4f3e-9824-68a3117131cd-kube-api-access-zbmz2\") pod \"ingress-canary-b4q7m\" (UID: \"723ef4ae-7bd1-4f3e-9824-68a3117131cd\") " pod="openshift-ingress-canary/ingress-canary-b4q7m"
Jul 08 21:06:52.487931 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.487812    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22phl\" (UniqueName: \"kubernetes.io/projected/352a5cba-6f07-4f24-bd51-c1f8c52c6848-kube-api-access-22phl\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:06:52.548939 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.548908    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b4q7m"
Jul 08 21:06:52.682471 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.682272    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b4q7m"]
Jul 08 21:06:52.685549 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:06:52.685514    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod723ef4ae_7bd1_4f3e_9824_68a3117131cd.slice/crio-af051e75f0fb9428f0d1ec4148dc2d5da196d5d52c61758378000ce8cbf2aed1 WatchSource:0}: Error finding container af051e75f0fb9428f0d1ec4148dc2d5da196d5d52c61758378000ce8cbf2aed1: Status 404 returned error can't find the container with id af051e75f0fb9428f0d1ec4148dc2d5da196d5d52c61758378000ce8cbf2aed1
Jul 08 21:06:52.981604 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:52.981557    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:06:52.981780 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:52.981713    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:06:52.981854 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:52.981790    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls podName:352a5cba-6f07-4f24-bd51-c1f8c52c6848 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:53.981769139 +0000 UTC m=+37.075572665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls") pod "dns-default-rw49m" (UID: "352a5cba-6f07-4f24-bd51-c1f8c52c6848") : secret "dns-default-metrics-tls" not found
Jul 08 21:06:53.424661 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:53.424629    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:06:53.424661 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:53.424658    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:06:53.425197 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:53.424629    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:06:53.427482 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:53.427446    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fk5xk\""
Jul 08 21:06:53.427629 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:53.427504    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 21:06:53.428503 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:53.428457    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 21:06:53.428625 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:53.428515    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 21:06:53.428625 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:53.428527    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 21:06:53.428842 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:53.428814    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nfx9c\""
Jul 08 21:06:53.569174 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:53.569144    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b4q7m" event={"ID":"723ef4ae-7bd1-4f3e-9824-68a3117131cd","Type":"ContainerStarted","Data":"af051e75f0fb9428f0d1ec4148dc2d5da196d5d52c61758378000ce8cbf2aed1"}
Jul 08 21:06:53.990700 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:53.990663    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:06:53.990866 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:53.990812    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:06:53.990908 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:53.990873    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls podName:352a5cba-6f07-4f24-bd51-c1f8c52c6848 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:55.990857967 +0000 UTC m=+39.084661496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls") pod "dns-default-rw49m" (UID: "352a5cba-6f07-4f24-bd51-c1f8c52c6848") : secret "dns-default-metrics-tls" not found
Jul 08 21:06:56.006196 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:56.006152    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:06:56.006646 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:56.006312    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:06:56.006646 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:06:56.006384    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls podName:352a5cba-6f07-4f24-bd51-c1f8c52c6848 nodeName:}" failed. No retries permitted until 2026-07-08 21:07:00.006363058 +0000 UTC m=+43.100166602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls") pod "dns-default-rw49m" (UID: "352a5cba-6f07-4f24-bd51-c1f8c52c6848") : secret "dns-default-metrics-tls" not found
Jul 08 21:06:58.586275 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:58.586232    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b4q7m" event={"ID":"723ef4ae-7bd1-4f3e-9824-68a3117131cd","Type":"ContainerStarted","Data":"f36d3a093f3cf59860cfcdc8eff1468c4150030579bc2aa41021740a4f6d6b1a"}
Jul 08 21:06:58.588902 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:58.588877    2583 generic.go:356] "Generic (PLEG): container finished" podID="59f1bd39-6d31-460e-99be-5bb083479ba8" containerID="ff805fb001b7f0d95ddb126d1f85305566f717008f4a0309da4804d8f7d91ddb" exitCode=0
Jul 08 21:06:58.588999 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:58.588914    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lz4xt" event={"ID":"59f1bd39-6d31-460e-99be-5bb083479ba8","Type":"ContainerDied","Data":"ff805fb001b7f0d95ddb126d1f85305566f717008f4a0309da4804d8f7d91ddb"}
Jul 08 21:06:58.601827 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:58.601787    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-b4q7m" podStartSLOduration=1.029508264 podStartE2EDuration="6.601774554s" totalImagesPullingTime="5.57226629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:58.601278835 +0000 UTC m=+41.695082400" watchObservedRunningTime="2026-07-08 21:06:58.601774554 +0000 UTC m=+41.695578078"
Jul 08 21:06:59.594194 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:59.594152    2583 generic.go:356] "Generic (PLEG): container finished" podID="59f1bd39-6d31-460e-99be-5bb083479ba8" containerID="7df80a91bc7ce33d8244f8c7c7a5ee341985126616e8044d30e043d4beade34b" exitCode=0
Jul 08 21:06:59.594679 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:06:59.594226    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lz4xt" event={"ID":"59f1bd39-6d31-460e-99be-5bb083479ba8","Type":"ContainerDied","Data":"7df80a91bc7ce33d8244f8c7c7a5ee341985126616e8044d30e043d4beade34b"}
Jul 08 21:07:00.036844 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:00.036812    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:07:00.036994 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:07:00.036956    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:07:00.037034 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:07:00.037016    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls podName:352a5cba-6f07-4f24-bd51-c1f8c52c6848 nodeName:}" failed. No retries permitted until 2026-07-08 21:07:08.036997005 +0000 UTC m=+51.130800542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls") pod "dns-default-rw49m" (UID: "352a5cba-6f07-4f24-bd51-c1f8c52c6848") : secret "dns-default-metrics-tls" not found
Jul 08 21:07:00.599997 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:00.599967    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lz4xt" event={"ID":"59f1bd39-6d31-460e-99be-5bb083479ba8","Type":"ContainerStarted","Data":"31fc66c6a53b4fd0d467b5f334d8b525b9415cb4bab3d819c2b699c34deb8ba6"}
Jul 08 21:07:00.621199 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:00.621131    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lz4xt" podStartSLOduration=7.473613273 podStartE2EDuration="43.621111758s" totalImagesPullingTime="36.147498485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:07:00.619688994 +0000 UTC m=+43.713492559" watchObservedRunningTime="2026-07-08 21:07:00.621111758 +0000 UTC m=+43.714915309"
Jul 08 21:07:08.089062 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:08.089025    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:07:08.089443 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:07:08.089194    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:07:08.089443 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:07:08.089279    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls podName:352a5cba-6f07-4f24-bd51-c1f8c52c6848 nodeName:}" failed. No retries permitted until 2026-07-08 21:07:24.089258105 +0000 UTC m=+67.183061645 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls") pod "dns-default-rw49m" (UID: "352a5cba-6f07-4f24-bd51-c1f8c52c6848") : secret "dns-default-metrics-tls" not found
Jul 08 21:07:17.565667 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:17.565638    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwjgn"
Jul 08 21:07:23.090744 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:23.090707    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs\") pod \"network-metrics-daemon-qjpwc\" (UID: \"b2421404-0026-4094-bf86-2f36fc0b21ea\") " pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:07:23.091264 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:23.090756    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57nx5\" (UniqueName: \"kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5\") pod \"network-check-target-ss6w5\" (UID: \"7dce3e47-c290-418d-ac0e-d723eaf6d93d\") " pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:07:23.091264 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:23.090789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret\") pod \"global-pull-secret-syncer-58wxg\" (UID: \"a76885ac-b10f-40cd-aa28-4b274d95c017\") " pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:07:23.093628 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:23.093610    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 21:07:23.093693 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:23.093629    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 21:07:23.093693 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:23.093643    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 21:07:23.101819 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:07:23.101800    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 21:07:23.101915 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:07:23.101883    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs podName:b2421404-0026-4094-bf86-2f36fc0b21ea nodeName:}" failed. No retries permitted until 2026-07-08 21:08:27.101862392 +0000 UTC m=+130.195665919 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs") pod "network-metrics-daemon-qjpwc" (UID: "b2421404-0026-4094-bf86-2f36fc0b21ea") : secret "metrics-daemon-secret" not found
Jul 08 21:07:23.103938 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:23.103925    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 21:07:23.104985 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:23.104967    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a76885ac-b10f-40cd-aa28-4b274d95c017-original-pull-secret\") pod \"global-pull-secret-syncer-58wxg\" (UID: \"a76885ac-b10f-40cd-aa28-4b274d95c017\") " pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:07:23.114849 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:23.114830    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57nx5\" (UniqueName: \"kubernetes.io/projected/7dce3e47-c290-418d-ac0e-d723eaf6d93d-kube-api-access-57nx5\") pod \"network-check-target-ss6w5\" (UID: \"7dce3e47-c290-418d-ac0e-d723eaf6d93d\") " pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:07:23.135790 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:23.135744    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58wxg"
Jul 08 21:07:23.149360 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:23.149337    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fk5xk\""
Jul 08 21:07:23.157342 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:23.157319    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:07:23.257904 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:23.257874    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-58wxg"]
Jul 08 21:07:23.261429 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:07:23.261405    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76885ac_b10f_40cd_aa28_4b274d95c017.slice/crio-f0d1bebc07bf690c161b71a9e9ec79c9fdd838188d966c3db9e5e845d0c6da34 WatchSource:0}: Error finding container f0d1bebc07bf690c161b71a9e9ec79c9fdd838188d966c3db9e5e845d0c6da34: Status 404 returned error can't find the container with id f0d1bebc07bf690c161b71a9e9ec79c9fdd838188d966c3db9e5e845d0c6da34
Jul 08 21:07:23.283292 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:23.283227    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ss6w5"]
Jul 08 21:07:23.286511 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:07:23.286486    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dce3e47_c290_418d_ac0e_d723eaf6d93d.slice/crio-37b51f33ec5b9aff8d5e00232749b29bee49cb63128b5a8465b75fbf7e1e4b02 WatchSource:0}: Error finding container 37b51f33ec5b9aff8d5e00232749b29bee49cb63128b5a8465b75fbf7e1e4b02: Status 404 returned error can't find the container with id 37b51f33ec5b9aff8d5e00232749b29bee49cb63128b5a8465b75fbf7e1e4b02
Jul 08 21:07:23.652545 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:23.652504    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ss6w5" event={"ID":"7dce3e47-c290-418d-ac0e-d723eaf6d93d","Type":"ContainerStarted","Data":"37b51f33ec5b9aff8d5e00232749b29bee49cb63128b5a8465b75fbf7e1e4b02"}
Jul 08 21:07:23.653474 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:23.653450    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-58wxg" event={"ID":"a76885ac-b10f-40cd-aa28-4b274d95c017","Type":"ContainerStarted","Data":"f0d1bebc07bf690c161b71a9e9ec79c9fdd838188d966c3db9e5e845d0c6da34"}
Jul 08 21:07:24.098006 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:24.097966    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:07:24.098472 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:07:24.098160    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:07:24.098472 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:07:24.098237    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls podName:352a5cba-6f07-4f24-bd51-c1f8c52c6848 nodeName:}" failed. No retries permitted until 2026-07-08 21:07:56.098213626 +0000 UTC m=+99.192017163 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls") pod "dns-default-rw49m" (UID: "352a5cba-6f07-4f24-bd51-c1f8c52c6848") : secret "dns-default-metrics-tls" not found
Jul 08 21:07:28.668397 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:28.668354    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ss6w5" event={"ID":"7dce3e47-c290-418d-ac0e-d723eaf6d93d","Type":"ContainerStarted","Data":"44dce7156a9fc3fbda9bba2ea8ae09902ff5131704da25230f19b37b390ff6a8"}
Jul 08 21:07:28.668967 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:28.668420    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:07:28.670058 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:28.670032    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-58wxg" event={"ID":"a76885ac-b10f-40cd-aa28-4b274d95c017","Type":"ContainerStarted","Data":"b628aa5202c7fbbc015b15d7a1c634ab93d0f0ae54599e2a382ac06e95eee675"}
Jul 08 21:07:28.683264 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:28.683218    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ss6w5" podStartSLOduration=67.037158524 podStartE2EDuration="1m11.683203148s" totalImagesPullingTime="4.646044624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:07:28.682312929 +0000 UTC m=+71.776116493" watchObservedRunningTime="2026-07-08 21:07:28.683203148 +0000 UTC m=+71.777006695"
Jul 08 21:07:28.695689 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:28.695650    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-58wxg" podStartSLOduration=67.013530582 podStartE2EDuration="1m11.695638732s" totalImagesPullingTime="4.68210815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:07:28.694842662 +0000 UTC m=+71.788646229" watchObservedRunningTime="2026-07-08 21:07:28.695638732 +0000 UTC m=+71.789442278"
Jul 08 21:07:39.801457 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.801333    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"]
Jul 08 21:07:39.803514 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.803499    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph"]
Jul 08 21:07:39.803934 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.803914    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:39.805091 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.805076    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph"
Jul 08 21:07:39.806554 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.806536    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 08 21:07:39.806680 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.806564    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 21:07:39.806680 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.806536    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 21:07:39.806797 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.806736    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 08 21:07:39.806852 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.806809    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 08 21:07:39.806904 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.806851    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 08 21:07:39.806904 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.806861    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 21:07:39.807883 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.807865    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-x489g\""
Jul 08 21:07:39.807960 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.807871    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 08 21:07:39.813151 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.812954    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph"]
Jul 08 21:07:39.816758 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.816740    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"]
Jul 08 21:07:39.909126 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.909095    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-hub\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:39.909273 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.909133    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:39.909273 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.909155    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4ff43b83-8eb1-404b-ae71-bfceb5350853-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph\" (UID: \"4ff43b83-8eb1-404b-ae71-bfceb5350853\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph"
Jul 08 21:07:39.909273 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.909218    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:39.909273 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.909250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-ca\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:39.909400 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.909273    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6vw4\" (UniqueName: \"kubernetes.io/projected/4ff43b83-8eb1-404b-ae71-bfceb5350853-kube-api-access-t6vw4\") pod \"managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph\" (UID: \"4ff43b83-8eb1-404b-ae71-bfceb5350853\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph"
Jul 08 21:07:39.909400 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.909291    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxs4x\" (UniqueName: \"kubernetes.io/projected/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-kube-api-access-sxs4x\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:39.909400 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:39.909316    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:40.009619 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.009562    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:40.009619 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.009622    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4ff43b83-8eb1-404b-ae71-bfceb5350853-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph\" (UID: \"4ff43b83-8eb1-404b-ae71-bfceb5350853\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph"
Jul 08 21:07:40.009738 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.009652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:40.009738 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.009674    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-ca\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:40.009738 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.009699    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6vw4\" (UniqueName: \"kubernetes.io/projected/4ff43b83-8eb1-404b-ae71-bfceb5350853-kube-api-access-t6vw4\") pod \"managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph\" (UID: \"4ff43b83-8eb1-404b-ae71-bfceb5350853\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph"
Jul 08 21:07:40.009738 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.009718    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxs4x\" (UniqueName: \"kubernetes.io/projected/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-kube-api-access-sxs4x\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:40.009922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.009744    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:40.009922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.009774    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-hub\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:40.010389 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.010358    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:40.012299 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.012273    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-hub\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:40.012395 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.012316    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:40.012395 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.012359    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:40.012468 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.012460    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-ca\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:40.012789 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.012769    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4ff43b83-8eb1-404b-ae71-bfceb5350853-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph\" (UID: \"4ff43b83-8eb1-404b-ae71-bfceb5350853\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph"
Jul 08 21:07:40.016913 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.016892    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6vw4\" (UniqueName: \"kubernetes.io/projected/4ff43b83-8eb1-404b-ae71-bfceb5350853-kube-api-access-t6vw4\") pod \"managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph\" (UID: \"4ff43b83-8eb1-404b-ae71-bfceb5350853\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph"
Jul 08 21:07:40.017001 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.016971    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxs4x\" (UniqueName: \"kubernetes.io/projected/d1d437e6-b5ce-4458-8bdb-8bacb4ad3275-kube-api-access-sxs4x\") pod \"cluster-proxy-proxy-agent-5f79fffbd4-fq8mj\" (UID: \"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:40.125132 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.125036    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:07:40.128994 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.128978    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph"
Jul 08 21:07:40.249902 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.249870    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph"]
Jul 08 21:07:40.255296 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:07:40.253297    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ff43b83_8eb1_404b_ae71_bfceb5350853.slice/crio-20f46908d64d25df4509be4b09759e764cad408c0ed4f3727e3ed1b167dbcc76 WatchSource:0}: Error finding container 20f46908d64d25df4509be4b09759e764cad408c0ed4f3727e3ed1b167dbcc76: Status 404 returned error can't find the container with id 20f46908d64d25df4509be4b09759e764cad408c0ed4f3727e3ed1b167dbcc76
Jul 08 21:07:40.266930 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.266907    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"]
Jul 08 21:07:40.269623 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:07:40.269600    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1d437e6_b5ce_4458_8bdb_8bacb4ad3275.slice/crio-1bf1e8895c8c88d821cf2f4587339e5861e05e1ad80686792bd176d7b5f03ef3 WatchSource:0}: Error finding container 1bf1e8895c8c88d821cf2f4587339e5861e05e1ad80686792bd176d7b5f03ef3: Status 404 returned error can't find the container with id 1bf1e8895c8c88d821cf2f4587339e5861e05e1ad80686792bd176d7b5f03ef3
Jul 08 21:07:40.699149 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.699112    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph" event={"ID":"4ff43b83-8eb1-404b-ae71-bfceb5350853","Type":"ContainerStarted","Data":"20f46908d64d25df4509be4b09759e764cad408c0ed4f3727e3ed1b167dbcc76"}
Jul 08 21:07:40.700134 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:40.700112    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj" event={"ID":"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275","Type":"ContainerStarted","Data":"1bf1e8895c8c88d821cf2f4587339e5861e05e1ad80686792bd176d7b5f03ef3"}
Jul 08 21:07:44.715325 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:44.715230    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph" event={"ID":"4ff43b83-8eb1-404b-ae71-bfceb5350853","Type":"ContainerStarted","Data":"95b842e05514bb35342d3ad8bda6f30cb2b2558c1e2c004ba65cf9aff23f8e0e"}
Jul 08 21:07:44.717280 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:44.717253    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj" event={"ID":"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275","Type":"ContainerStarted","Data":"d45cb8154eb93cd5281dc5b60eaa791b241e4c9340fa889efade73f0a56086c9"}
Jul 08 21:07:44.717406 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:44.717293    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj" event={"ID":"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275","Type":"ContainerStarted","Data":"3a3fcf0abe988ad6b0e9abd3e2cf4583541e688f6b0a2327fc40b54ee9a01f62"}
Jul 08 21:07:44.717406 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:44.717311    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj" event={"ID":"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275","Type":"ContainerStarted","Data":"5eed422ac32b7793297b8c646482e5d210e489b4300cdfa4bc91d1e56f2aee57"}
Jul 08 21:07:44.729338 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:44.729295    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph" podStartSLOduration=1.6554466319999999 podStartE2EDuration="5.729282276s" totalImagesPullingTime="4.073835644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:07:44.728909577 +0000 UTC m=+87.822713125" watchObservedRunningTime="2026-07-08 21:07:44.729282276 +0000 UTC m=+87.823085823"
Jul 08 21:07:44.745346 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:44.745300    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj" podStartSLOduration=1.674969787 podStartE2EDuration="5.745285283s" totalImagesPullingTime="4.070315496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:07:44.744310679 +0000 UTC m=+87.838114225" watchObservedRunningTime="2026-07-08 21:07:44.745285283 +0000 UTC m=+87.839088829"
Jul 08 21:07:56.128789 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:56.128752    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:07:56.129165 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:07:56.128879    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:07:56.129165 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:07:56.128933    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls podName:352a5cba-6f07-4f24-bd51-c1f8c52c6848 nodeName:}" failed. No retries permitted until 2026-07-08 21:09:00.128919436 +0000 UTC m=+163.222722960 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls") pod "dns-default-rw49m" (UID: "352a5cba-6f07-4f24-bd51-c1f8c52c6848") : secret "dns-default-metrics-tls" not found
Jul 08 21:07:59.674270 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:07:59.674244    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ss6w5"
Jul 08 21:08:27.148763 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:08:27.148707    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs\") pod \"network-metrics-daemon-qjpwc\" (UID: \"b2421404-0026-4094-bf86-2f36fc0b21ea\") " pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:08:27.149256 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:08:27.148869    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 21:08:27.149256 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:08:27.148940    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs podName:b2421404-0026-4094-bf86-2f36fc0b21ea nodeName:}" failed. No retries permitted until 2026-07-08 21:10:29.148922505 +0000 UTC m=+252.242726030 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs") pod "network-metrics-daemon-qjpwc" (UID: "b2421404-0026-4094-bf86-2f36fc0b21ea") : secret "metrics-daemon-secret" not found
Jul 08 21:08:55.244064 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:08:55.244020    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rw49m" podUID="352a5cba-6f07-4f24-bd51-c1f8c52c6848"
Jul 08 21:08:55.911828 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:08:55.911805    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rw49m"
Jul 08 21:08:56.442193 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:08:56.442156    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qjpwc" podUID="b2421404-0026-4094-bf86-2f36fc0b21ea"
Jul 08 21:09:00.171536 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:09:00.171490    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:09:00.171969 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:09:00.171624    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:09:00.171969 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:09:00.171683    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls podName:352a5cba-6f07-4f24-bd51-c1f8c52c6848 nodeName:}" failed. No retries permitted until 2026-07-08 21:11:02.171670478 +0000 UTC m=+285.265474003 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls") pod "dns-default-rw49m" (UID: "352a5cba-6f07-4f24-bd51-c1f8c52c6848") : secret "dns-default-metrics-tls" not found
Jul 08 21:09:11.424472 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:09:11.424379    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:09:45.047943 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:09:45.047908    2583 generic.go:356] "Generic (PLEG): container finished" podID="4ff43b83-8eb1-404b-ae71-bfceb5350853" containerID="95b842e05514bb35342d3ad8bda6f30cb2b2558c1e2c004ba65cf9aff23f8e0e" exitCode=255
Jul 08 21:09:45.047943 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:09:45.047944    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph" event={"ID":"4ff43b83-8eb1-404b-ae71-bfceb5350853","Type":"ContainerDied","Data":"95b842e05514bb35342d3ad8bda6f30cb2b2558c1e2c004ba65cf9aff23f8e0e"}
Jul 08 21:09:45.048469 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:09:45.048184    2583 scope.go:117] "RemoveContainer" containerID="95b842e05514bb35342d3ad8bda6f30cb2b2558c1e2c004ba65cf9aff23f8e0e"
Jul 08 21:09:46.052322 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:09:46.052285    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cd76b4fc8-k7hph" event={"ID":"4ff43b83-8eb1-404b-ae71-bfceb5350853","Type":"ContainerStarted","Data":"8201330c539d929b9d08e0d8f46b4294ba66038331910292844fd6c00e61a563"}
Jul 08 21:10:04.067883 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.067848    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hk2ln"]
Jul 08 21:10:04.070014 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.069995    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:04.072675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.072570    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 21:10:04.072675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.072609    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 21:10:04.072675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.072646    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zz8jg\""
Jul 08 21:10:04.072921 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.072647    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 21:10:04.073546 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.073532    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 21:10:04.118945 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.118916    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98bl8\" (UniqueName: \"kubernetes.io/projected/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-api-access-98bl8\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:04.119077 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.118966    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4084193-ce3e-4a6a-bb51-682b92e66523-data-volume\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:04.119077 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.119055    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c4084193-ce3e-4a6a-bb51-682b92e66523-crio-socket\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:04.119150 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.119110    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:04.119150 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.119133    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:04.168423 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.168341    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hk2ln"]
Jul 08 21:10:04.220302 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.220266    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:04.220445 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.220308    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98bl8\" (UniqueName: \"kubernetes.io/projected/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-api-access-98bl8\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:04.220445 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.220356    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4084193-ce3e-4a6a-bb51-682b92e66523-data-volume\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:04.220445 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:04.220382    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:10:04.220445 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.220400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c4084193-ce3e-4a6a-bb51-682b92e66523-crio-socket\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:04.220691 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.220447    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:04.220691 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:04.220508    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm podName:c4084193-ce3e-4a6a-bb51-682b92e66523 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:04.720488108 +0000 UTC m=+227.814291652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hk2ln" (UID: "c4084193-ce3e-4a6a-bb51-682b92e66523") : configmap "kube-rbac-proxy" not found
Jul 08 21:10:04.220691 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.220543    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c4084193-ce3e-4a6a-bb51-682b92e66523-crio-socket\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:04.220691 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:04.220556    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:04.220691 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:04.220623    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls podName:c4084193-ce3e-4a6a-bb51-682b92e66523 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:04.720607252 +0000 UTC m=+227.814410778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hk2ln" (UID: "c4084193-ce3e-4a6a-bb51-682b92e66523") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:04.220691 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.220689    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4084193-ce3e-4a6a-bb51-682b92e66523-data-volume\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:04.231127 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.231105    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98bl8\" (UniqueName: \"kubernetes.io/projected/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-api-access-98bl8\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:04.723045 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.723004    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:04.723045 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:04.723046    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:04.723304 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:04.723140    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:10:04.723304 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:04.723168    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:04.723304 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:04.723200    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm podName:c4084193-ce3e-4a6a-bb51-682b92e66523 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:05.723186125 +0000 UTC m=+228.816989650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hk2ln" (UID: "c4084193-ce3e-4a6a-bb51-682b92e66523") : configmap "kube-rbac-proxy" not found
Jul 08 21:10:04.723304 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:04.723235    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls podName:c4084193-ce3e-4a6a-bb51-682b92e66523 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:05.723217842 +0000 UTC m=+228.817021367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hk2ln" (UID: "c4084193-ce3e-4a6a-bb51-682b92e66523") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:05.730261 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:05.730220    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:05.730261 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:05.730258    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:05.730768 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:05.730352    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:10:05.730768 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:05.730395    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:05.730768 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:05.730402    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm podName:c4084193-ce3e-4a6a-bb51-682b92e66523 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:07.730389408 +0000 UTC m=+230.824192933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hk2ln" (UID: "c4084193-ce3e-4a6a-bb51-682b92e66523") : configmap "kube-rbac-proxy" not found
Jul 08 21:10:05.730768 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:05.730470    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls podName:c4084193-ce3e-4a6a-bb51-682b92e66523 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:07.730451992 +0000 UTC m=+230.824255516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hk2ln" (UID: "c4084193-ce3e-4a6a-bb51-682b92e66523") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:06.868455 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:06.868427    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8fkbn_35d39013-c4de-41ad-9f73-d009a2207661/dns-node-resolver/0.log"
Jul 08 21:10:07.668273 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:07.668247    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jmxt4_7d7a538d-6907-487e-b67f-c68e86d0e043/node-ca/0.log"
Jul 08 21:10:07.746062 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:07.746028    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:07.746213 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:07.746119    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:07.746213 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:07.746143    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:10:07.746213 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:07.746203    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm podName:c4084193-ce3e-4a6a-bb51-682b92e66523 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:11.746188079 +0000 UTC m=+234.839991607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hk2ln" (UID: "c4084193-ce3e-4a6a-bb51-682b92e66523") : configmap "kube-rbac-proxy" not found
Jul 08 21:10:07.746213 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:07.746206    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:07.746450 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:07.746251    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls podName:c4084193-ce3e-4a6a-bb51-682b92e66523 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:11.746238817 +0000 UTC m=+234.840042341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hk2ln" (UID: "c4084193-ce3e-4a6a-bb51-682b92e66523") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:08.468987 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:08.468961    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b4q7m_723ef4ae-7bd1-4f3e-9824-68a3117131cd/serve-healthcheck-canary/0.log"
Jul 08 21:10:11.777014 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:11.776981    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:11.777014 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:11.777018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:11.777534 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:11.777131    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:11.777534 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:11.777192    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls podName:c4084193-ce3e-4a6a-bb51-682b92e66523 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:19.777178185 +0000 UTC m=+242.870981715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hk2ln" (UID: "c4084193-ce3e-4a6a-bb51-682b92e66523") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:11.777534 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:11.777131    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:10:11.777534 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:11.777257    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm podName:c4084193-ce3e-4a6a-bb51-682b92e66523 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:19.777245502 +0000 UTC m=+242.871049027 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hk2ln" (UID: "c4084193-ce3e-4a6a-bb51-682b92e66523") : configmap "kube-rbac-proxy" not found
Jul 08 21:10:19.835681 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:19.835631    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:19.835681 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:19.835682    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:19.836191 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:19.836150    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4084193-ce3e-4a6a-bb51-682b92e66523-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:19.837846 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:19.837814    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4084193-ce3e-4a6a-bb51-682b92e66523-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk2ln\" (UID: \"c4084193-ce3e-4a6a-bb51-682b92e66523\") " pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:19.980436 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:19.980406    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zz8jg\""
Jul 08 21:10:19.989219 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:19.989200    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hk2ln"
Jul 08 21:10:20.109548 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:20.109478    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hk2ln"]
Jul 08 21:10:20.112898 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:10:20.112871    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4084193_ce3e_4a6a_bb51_682b92e66523.slice/crio-b62e1e70fb02068a07f9dd6756154d2430e2cd6daf949ef0e1479b74099fe366 WatchSource:0}: Error finding container b62e1e70fb02068a07f9dd6756154d2430e2cd6daf949ef0e1479b74099fe366: Status 404 returned error can't find the container with id b62e1e70fb02068a07f9dd6756154d2430e2cd6daf949ef0e1479b74099fe366
Jul 08 21:10:20.147356 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:20.147323    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hk2ln" event={"ID":"c4084193-ce3e-4a6a-bb51-682b92e66523","Type":"ContainerStarted","Data":"b62e1e70fb02068a07f9dd6756154d2430e2cd6daf949ef0e1479b74099fe366"}
Jul 08 21:10:24.161406 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:24.161313    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hk2ln" event={"ID":"c4084193-ce3e-4a6a-bb51-682b92e66523","Type":"ContainerStarted","Data":"950e7581f2a14494079e5452d4df8683b2f331fde44eaecc48787538807c2950"}
Jul 08 21:10:25.166202 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:25.166160    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hk2ln" event={"ID":"c4084193-ce3e-4a6a-bb51-682b92e66523","Type":"ContainerStarted","Data":"fda412857a4b41cc4a09bf97cff3af38a81839033e72cbfe421fdb7b152b5ce0"}
Jul 08 21:10:28.177217 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:28.177179    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hk2ln" event={"ID":"c4084193-ce3e-4a6a-bb51-682b92e66523","Type":"ContainerStarted","Data":"86f231fe52e2f825ca930908505a639dc8db0e7e80f00d2ce0de7ea11808d247"}
Jul 08 21:10:28.194152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:28.194109    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hk2ln" podStartSLOduration=17.240858571 podStartE2EDuration="24.194092434s" totalImagesPullingTime="6.953233863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:10:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:28.192380396 +0000 UTC m=+251.286183943" watchObservedRunningTime="2026-07-08 21:10:28.194092434 +0000 UTC m=+251.287895982"
Jul 08 21:10:29.206234 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:29.206195    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs\") pod \"network-metrics-daemon-qjpwc\" (UID: \"b2421404-0026-4094-bf86-2f36fc0b21ea\") " pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:10:29.208397 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:29.208376    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2421404-0026-4094-bf86-2f36fc0b21ea-metrics-certs\") pod \"network-metrics-daemon-qjpwc\" (UID: \"b2421404-0026-4094-bf86-2f36fc0b21ea\") " pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:10:29.427364 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:29.427341    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nfx9c\""
Jul 08 21:10:29.436193 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:29.436173    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qjpwc"
Jul 08 21:10:29.551249 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:29.551220    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qjpwc"]
Jul 08 21:10:29.553800 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:10:29.553774    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2421404_0026_4094_bf86_2f36fc0b21ea.slice/crio-b85c8f7c0a81698d6a819c378174f352fd97743bc1cd0d7d5b47b7adce60b14b WatchSource:0}: Error finding container b85c8f7c0a81698d6a819c378174f352fd97743bc1cd0d7d5b47b7adce60b14b: Status 404 returned error can't find the container with id b85c8f7c0a81698d6a819c378174f352fd97743bc1cd0d7d5b47b7adce60b14b
Jul 08 21:10:30.183551 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:30.183519    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qjpwc" event={"ID":"b2421404-0026-4094-bf86-2f36fc0b21ea","Type":"ContainerStarted","Data":"b85c8f7c0a81698d6a819c378174f352fd97743bc1cd0d7d5b47b7adce60b14b"}
Jul 08 21:10:31.188521 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:31.188480    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qjpwc" event={"ID":"b2421404-0026-4094-bf86-2f36fc0b21ea","Type":"ContainerStarted","Data":"549f2ec2a0b48e13b1a72f68fda855eb4899c7321d2c4f926925db3a304f88d0"}
Jul 08 21:10:31.188942 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:31.188581    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qjpwc" event={"ID":"b2421404-0026-4094-bf86-2f36fc0b21ea","Type":"ContainerStarted","Data":"1dc7fa919daa34475cecc79021815b80443966606706d7eb03c5fb52dc94410e"}
Jul 08 21:10:31.202397 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:31.202343    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qjpwc" podStartSLOduration=253.19651027 podStartE2EDuration="4m14.20232532s" totalImagesPullingTime="1.00581505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:31.201965439 +0000 UTC m=+254.295768996" watchObservedRunningTime="2026-07-08 21:10:31.20232532 +0000 UTC m=+254.296128867"
Jul 08 21:10:37.289046 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.289010    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-659fb9dd64-kx6ln"]
Jul 08 21:10:37.291138 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.291122    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.294390 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.293367    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 21:10:37.294390 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.294226    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 21:10:37.294744 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.294720    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 21:10:37.295706 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.294790    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 21:10:37.295808 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.295318    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 21:10:37.295869 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.295443    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 21:10:37.295922 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.295500    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 21:10:37.295977 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.295510    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r54dz\""
Jul 08 21:10:37.302063 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.302041    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659fb9dd64-kx6ln"]
Jul 08 21:10:37.359562 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.359528    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-oauth-config\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.359562 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.359565    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-service-ca\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.359823 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.359594    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-serving-cert\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.359823 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.359608    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-oauth-serving-cert\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.359823 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.359628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrjrv\" (UniqueName: \"kubernetes.io/projected/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-kube-api-access-zrjrv\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.359823 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.359691    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-config\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.460543 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.460513    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-service-ca\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.460543 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.460547    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-serving-cert\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.460737 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.460565    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-oauth-serving-cert\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.460737 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.460605    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrjrv\" (UniqueName: \"kubernetes.io/projected/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-kube-api-access-zrjrv\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.460737 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.460688    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-config\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.460888 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.460871    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-oauth-config\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.461341 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.461318    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-oauth-serving-cert\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.461488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.461470    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-config\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.461558 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.461470    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-service-ca\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.463080 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.463061    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-oauth-config\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.463080 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.463071    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-serving-cert\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.467314 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.467288    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrjrv\" (UniqueName: \"kubernetes.io/projected/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-kube-api-access-zrjrv\") pod \"console-659fb9dd64-kx6ln\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") " pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.603793 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.603714    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:37.727878 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:37.727802    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659fb9dd64-kx6ln"]
Jul 08 21:10:37.731345 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:10:37.731317    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b2d91d_6e44_4160_b2a0_6b3d16c22d38.slice/crio-c4aba3dd145c4a40151d27089db1fb873f5d29aabf690cef87e6f93b7fe0b7bb WatchSource:0}: Error finding container c4aba3dd145c4a40151d27089db1fb873f5d29aabf690cef87e6f93b7fe0b7bb: Status 404 returned error can't find the container with id c4aba3dd145c4a40151d27089db1fb873f5d29aabf690cef87e6f93b7fe0b7bb
Jul 08 21:10:38.210373 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:38.210341    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659fb9dd64-kx6ln" event={"ID":"15b2d91d-6e44-4160-b2a0-6b3d16c22d38","Type":"ContainerStarted","Data":"c4aba3dd145c4a40151d27089db1fb873f5d29aabf690cef87e6f93b7fe0b7bb"}
Jul 08 21:10:40.127174 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.127070    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj" podUID="d1d437e6-b5ce-4458-8bdb-8bacb4ad3275" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 21:10:40.882415 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.882382    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"]
Jul 08 21:10:40.888339 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.888314    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:40.891343 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.891287    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 21:10:40.891494 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.891438    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 21:10:40.892309 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.892289    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 08 21:10:40.892412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.892364    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 21:10:40.892519 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.892482    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 08 21:10:40.892726 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.892706    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jhggk\""
Jul 08 21:10:40.892831 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.892817    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 08 21:10:40.895218 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.895196    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9tk9w"]
Jul 08 21:10:40.899623 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.898844    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"]
Jul 08 21:10:40.899623 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.898958    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:40.902252 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.902036    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 21:10:40.902252 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.902048    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 21:10:40.902252 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.902056    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 21:10:40.902469 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.902387    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vmxqb\""
Jul 08 21:10:40.985774 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.985735    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a0b7429-9fe3-42a7-b117-f846e7bab721-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:40.985971 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.985783    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f46bbf75-cd00-458f-be76-068012063e62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:40.985971 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.985813    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nrbg\" (UniqueName: \"kubernetes.io/projected/f46bbf75-cd00-458f-be76-068012063e62-kube-api-access-9nrbg\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:40.985971 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.985850    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f46bbf75-cd00-458f-be76-068012063e62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:40.985971 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.985896    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a0b7429-9fe3-42a7-b117-f846e7bab721-root\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:40.986178 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.985972    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a0b7429-9fe3-42a7-b117-f846e7bab721-node-exporter-textfile\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:40.986178 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.986010    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a0b7429-9fe3-42a7-b117-f846e7bab721-node-exporter-wtmp\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:40.986178 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.986064    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a0b7429-9fe3-42a7-b117-f846e7bab721-node-exporter-tls\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:40.986178 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.986088    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f46bbf75-cd00-458f-be76-068012063e62-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:40.986178 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.986110    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a0b7429-9fe3-42a7-b117-f846e7bab721-sys\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:40.986178 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.986127    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f46bbf75-cd00-458f-be76-068012063e62-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:40.986178 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.986146    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spwcz\" (UniqueName: \"kubernetes.io/projected/8a0b7429-9fe3-42a7-b117-f846e7bab721-kube-api-access-spwcz\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:40.986459 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.986241    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a0b7429-9fe3-42a7-b117-f846e7bab721-metrics-client-ca\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:40.986459 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.986281    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a0b7429-9fe3-42a7-b117-f846e7bab721-node-exporter-accelerators-collector-config\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:40.986459 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:40.986313    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f46bbf75-cd00-458f-be76-068012063e62-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:41.087339 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.087307    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a0b7429-9fe3-42a7-b117-f846e7bab721-node-exporter-accelerators-collector-config\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.087339 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.087346    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f46bbf75-cd00-458f-be76-068012063e62-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:41.087615 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.087373    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a0b7429-9fe3-42a7-b117-f846e7bab721-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.087615 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.087401    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f46bbf75-cd00-458f-be76-068012063e62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:41.087615 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.087423    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nrbg\" (UniqueName: \"kubernetes.io/projected/f46bbf75-cd00-458f-be76-068012063e62-kube-api-access-9nrbg\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:41.087615 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.087452    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f46bbf75-cd00-458f-be76-068012063e62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:41.087615 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.087478    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a0b7429-9fe3-42a7-b117-f846e7bab721-root\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.087615 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.087540    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a0b7429-9fe3-42a7-b117-f846e7bab721-root\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.087908 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.087641    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a0b7429-9fe3-42a7-b117-f846e7bab721-node-exporter-textfile\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.087908 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.087684    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a0b7429-9fe3-42a7-b117-f846e7bab721-node-exporter-wtmp\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.087908 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.087732    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a0b7429-9fe3-42a7-b117-f846e7bab721-node-exporter-tls\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.087908 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.087761    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f46bbf75-cd00-458f-be76-068012063e62-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:41.087908 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.087787    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a0b7429-9fe3-42a7-b117-f846e7bab721-sys\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.087908 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.087797    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f46bbf75-cd00-458f-be76-068012063e62-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:41.087908 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.087816    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f46bbf75-cd00-458f-be76-068012063e62-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:41.087908 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.087863    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spwcz\" (UniqueName: \"kubernetes.io/projected/8a0b7429-9fe3-42a7-b117-f846e7bab721-kube-api-access-spwcz\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.088273 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.087928    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a0b7429-9fe3-42a7-b117-f846e7bab721-metrics-client-ca\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.088273 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.088134    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a0b7429-9fe3-42a7-b117-f846e7bab721-node-exporter-textfile\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.088273 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.088179    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a0b7429-9fe3-42a7-b117-f846e7bab721-node-exporter-wtmp\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.088273 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:41.088239    2583 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 08 21:10:41.088533 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:41.088303    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f46bbf75-cd00-458f-be76-068012063e62-kube-state-metrics-tls podName:f46bbf75-cd00-458f-be76-068012063e62 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:41.58828244 +0000 UTC m=+264.682085979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f46bbf75-cd00-458f-be76-068012063e62-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-2qjqc" (UID: "f46bbf75-cd00-458f-be76-068012063e62") : secret "kube-state-metrics-tls" not found
Jul 08 21:10:41.088533 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.088241    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a0b7429-9fe3-42a7-b117-f846e7bab721-sys\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.088533 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.088239    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f46bbf75-cd00-458f-be76-068012063e62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:41.088533 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.088425    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f46bbf75-cd00-458f-be76-068012063e62-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:41.088533 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.088429    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a0b7429-9fe3-42a7-b117-f846e7bab721-metrics-client-ca\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.088863 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.088841    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a0b7429-9fe3-42a7-b117-f846e7bab721-node-exporter-accelerators-collector-config\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.090243 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.090196    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a0b7429-9fe3-42a7-b117-f846e7bab721-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.090640 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.090619    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a0b7429-9fe3-42a7-b117-f846e7bab721-node-exporter-tls\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.090777 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.090756    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f46bbf75-cd00-458f-be76-068012063e62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:41.095285 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.095016    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nrbg\" (UniqueName: \"kubernetes.io/projected/f46bbf75-cd00-458f-be76-068012063e62-kube-api-access-9nrbg\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:41.100387 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.100361    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spwcz\" (UniqueName: \"kubernetes.io/projected/8a0b7429-9fe3-42a7-b117-f846e7bab721-kube-api-access-spwcz\") pod \"node-exporter-9tk9w\" (UID: \"8a0b7429-9fe3-42a7-b117-f846e7bab721\") " pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.209777 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.209696    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9tk9w"
Jul 08 21:10:41.220517 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:10:41.220491    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a0b7429_9fe3_42a7_b117_f846e7bab721.slice/crio-7425988c00f7ca457d4658c7337a986eb7eb9bf0c98cc86cf11521c5c62000c2 WatchSource:0}: Error finding container 7425988c00f7ca457d4658c7337a986eb7eb9bf0c98cc86cf11521c5c62000c2: Status 404 returned error can't find the container with id 7425988c00f7ca457d4658c7337a986eb7eb9bf0c98cc86cf11521c5c62000c2
Jul 08 21:10:41.593223 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.593182    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f46bbf75-cd00-458f-be76-068012063e62-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:41.595482 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.595462    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f46bbf75-cd00-458f-be76-068012063e62-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-2qjqc\" (UID: \"f46bbf75-cd00-458f-be76-068012063e62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:41.800374 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.800333    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"
Jul 08 21:10:41.937287 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:41.937251    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc"]
Jul 08 21:10:41.940290 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:10:41.940268    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46bbf75_cd00_458f_be76_068012063e62.slice/crio-eebf796e6226f9fa82074d2d206a3079d185040c9b56b8f608e8ca07737ee96c WatchSource:0}: Error finding container eebf796e6226f9fa82074d2d206a3079d185040c9b56b8f608e8ca07737ee96c: Status 404 returned error can't find the container with id eebf796e6226f9fa82074d2d206a3079d185040c9b56b8f608e8ca07737ee96c
Jul 08 21:10:42.226974 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:42.226945    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc" event={"ID":"f46bbf75-cd00-458f-be76-068012063e62","Type":"ContainerStarted","Data":"eebf796e6226f9fa82074d2d206a3079d185040c9b56b8f608e8ca07737ee96c"}
Jul 08 21:10:42.228249 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:42.228220    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9tk9w" event={"ID":"8a0b7429-9fe3-42a7-b117-f846e7bab721","Type":"ContainerStarted","Data":"7425988c00f7ca457d4658c7337a986eb7eb9bf0c98cc86cf11521c5c62000c2"}
Jul 08 21:10:42.229929 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:42.229904    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659fb9dd64-kx6ln" event={"ID":"15b2d91d-6e44-4160-b2a0-6b3d16c22d38","Type":"ContainerStarted","Data":"5b686da907357bf5047c331d925aeb75cfc9aa2bc492967f7ce3006c8dd890f8"}
Jul 08 21:10:42.248876 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:42.248836    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-659fb9dd64-kx6ln" podStartSLOduration=1.7584944930000002 podStartE2EDuration="5.248821969s" totalImagesPullingTime="3.490327476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:10:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:42.248429643 +0000 UTC m=+265.342233203" watchObservedRunningTime="2026-07-08 21:10:42.248821969 +0000 UTC m=+265.342625516"
Jul 08 21:10:43.235254 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:43.235213    2583 generic.go:356] "Generic (PLEG): container finished" podID="8a0b7429-9fe3-42a7-b117-f846e7bab721" containerID="e8ad08d8cacded1c19dd63e148763b09321a506fc5b7e1af21a371930a851442" exitCode=0
Jul 08 21:10:43.235691 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:43.235369    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9tk9w" event={"ID":"8a0b7429-9fe3-42a7-b117-f846e7bab721","Type":"ContainerDied","Data":"e8ad08d8cacded1c19dd63e148763b09321a506fc5b7e1af21a371930a851442"}
Jul 08 21:10:44.244861 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.244826    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc" event={"ID":"f46bbf75-cd00-458f-be76-068012063e62","Type":"ContainerStarted","Data":"cfe5d67df66e833f67289cb40989c904cb60f0bcb541bad49c72aab8d3847506"}
Jul 08 21:10:44.245287 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.244912    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc" event={"ID":"f46bbf75-cd00-458f-be76-068012063e62","Type":"ContainerStarted","Data":"076639e2f14c94a76446eb24f0d4034ac16f969f8c19c356d8d7c375879f0548"}
Jul 08 21:10:44.245287 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.244964    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc" event={"ID":"f46bbf75-cd00-458f-be76-068012063e62","Type":"ContainerStarted","Data":"20e74fe4416e623d569ff0966a8056c6c6c0bce32ca02609fdfc41fe9c3827b1"}
Jul 08 21:10:44.246895 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.246872    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9tk9w" event={"ID":"8a0b7429-9fe3-42a7-b117-f846e7bab721","Type":"ContainerStarted","Data":"d4ea4c92f98d2b1a839a9b87f2275d11b26c03c69ed3af46b52c910b5be64cff"}
Jul 08 21:10:44.247000 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.246911    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9tk9w" event={"ID":"8a0b7429-9fe3-42a7-b117-f846e7bab721","Type":"ContainerStarted","Data":"72998b273d12b4f47cbb61effd44fbc77101797263d18886449309861bb14b91"}
Jul 08 21:10:44.262327 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.262279    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2qjqc" podStartSLOduration=2.661412537 podStartE2EDuration="4.262266358s" totalImagesPullingTime="1.600853821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:44.260966604 +0000 UTC m=+267.354770176" watchObservedRunningTime="2026-07-08 21:10:44.262266358 +0000 UTC m=+267.356069906"
Jul 08 21:10:44.276530 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.276474    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9tk9w" podStartSLOduration=3.224585539 podStartE2EDuration="4.276456107s" totalImagesPullingTime="989.077435ms" totalInitContainerRuntime="62.793133ms" isStatefulPod=true podCreationTimestamp="2026-07-08 21:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:44.275879186 +0000 UTC m=+267.369682733" watchObservedRunningTime="2026-07-08 21:10:44.276456107 +0000 UTC m=+267.370259654"
Jul 08 21:10:44.852518 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.852477    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"]
Jul 08 21:10:44.855241 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.855225    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:44.857444 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.857419    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 08 21:10:44.857720 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.857476    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 08 21:10:44.857720 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.857492    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 08 21:10:44.857845 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.857784    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-80g5rp00f03g\""
Jul 08 21:10:44.857912 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.857837    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-v9wkw\""
Jul 08 21:10:44.857912 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.857850    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 08 21:10:44.857912 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.857871    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 08 21:10:44.866801 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.866783    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"]
Jul 08 21:10:44.922203 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.922176    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:44.922364 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.922210    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:44.922364 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.922250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9dq5\" (UniqueName: \"kubernetes.io/projected/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-kube-api-access-t9dq5\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:44.922364 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.922320    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:44.922461 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.922367    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-thanos-querier-tls\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:44.922461 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.922388    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-metrics-client-ca\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:44.922461 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.922414    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:44.922461 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:44.922431    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-grpc-tls\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.023777 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.023744    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-thanos-querier-tls\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.023777 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.023776    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-metrics-client-ca\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.024072 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.023800    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.024072 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.023818    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-grpc-tls\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.024072 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.023838    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.024072 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.023863    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.024072 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.023905    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9dq5\" (UniqueName: \"kubernetes.io/projected/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-kube-api-access-t9dq5\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.024072 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.023931    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.024606 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.024559    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-metrics-client-ca\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.026502 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.026464    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.026622 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.026605    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-grpc-tls\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.026826 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.026805    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-thanos-querier-tls\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.026884 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.026815    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.026884 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.026862    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.027125 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.027106    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.031109 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.031087    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9dq5\" (UniqueName: \"kubernetes.io/projected/518c8a24-ba1d-4f24-ac17-ffeedbd7b729-kube-api-access-t9dq5\") pod \"thanos-querier-6fbbdf85c5-6bhht\" (UID: \"518c8a24-ba1d-4f24-ac17-ffeedbd7b729\") " pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.163783 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.163691    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:45.296356 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.296323    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"]
Jul 08 21:10:45.299256 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:10:45.299226    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod518c8a24_ba1d_4f24_ac17_ffeedbd7b729.slice/crio-6323b78e437fdd7c0c0c5c726db5f545442890897f2369481b00bb43f39440a7 WatchSource:0}: Error finding container 6323b78e437fdd7c0c0c5c726db5f545442890897f2369481b00bb43f39440a7: Status 404 returned error can't find the container with id 6323b78e437fdd7c0c0c5c726db5f545442890897f2369481b00bb43f39440a7
Jul 08 21:10:45.689030 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.688997    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-6p98z"]
Jul 08 21:10:45.692475 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.692457    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6p98z"
Jul 08 21:10:45.694786 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.694762    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-cdnfb\""
Jul 08 21:10:45.694861 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.694790    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 08 21:10:45.698035 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.698015    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-659fb9dd64-kx6ln"]
Jul 08 21:10:45.701287 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.701267    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-6p98z"]
Jul 08 21:10:45.830572 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.830528    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/952fa495-b638-402f-bf66-183252d18ed1-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-6p98z\" (UID: \"952fa495-b638-402f-bf66-183252d18ed1\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6p98z"
Jul 08 21:10:45.830572 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.830578    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bshgz\" (UniqueName: \"kubernetes.io/projected/952fa495-b638-402f-bf66-183252d18ed1-kube-api-access-bshgz\") pod \"monitoring-plugin-d5dcff7cf-6p98z\" (UID: \"952fa495-b638-402f-bf66-183252d18ed1\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6p98z"
Jul 08 21:10:45.931751 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.931706    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/952fa495-b638-402f-bf66-183252d18ed1-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-6p98z\" (UID: \"952fa495-b638-402f-bf66-183252d18ed1\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6p98z"
Jul 08 21:10:45.931751 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.931761    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bshgz\" (UniqueName: \"kubernetes.io/projected/952fa495-b638-402f-bf66-183252d18ed1-kube-api-access-bshgz\") pod \"monitoring-plugin-d5dcff7cf-6p98z\" (UID: \"952fa495-b638-402f-bf66-183252d18ed1\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6p98z"
Jul 08 21:10:45.934148 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.934122    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/952fa495-b638-402f-bf66-183252d18ed1-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-6p98z\" (UID: \"952fa495-b638-402f-bf66-183252d18ed1\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6p98z"
Jul 08 21:10:45.938915 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:45.938895    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bshgz\" (UniqueName: \"kubernetes.io/projected/952fa495-b638-402f-bf66-183252d18ed1-kube-api-access-bshgz\") pod \"monitoring-plugin-d5dcff7cf-6p98z\" (UID: \"952fa495-b638-402f-bf66-183252d18ed1\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6p98z"
Jul 08 21:10:46.002959 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:46.002929    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6p98z"
Jul 08 21:10:46.152436 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:46.152397    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-6p98z"]
Jul 08 21:10:46.155967 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:10:46.155941    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod952fa495_b638_402f_bf66_183252d18ed1.slice/crio-d050de6bd2433cbe2e157b780095b23313b4b5b5f8c2c2cd17c439e0105cbccc WatchSource:0}: Error finding container d050de6bd2433cbe2e157b780095b23313b4b5b5f8c2c2cd17c439e0105cbccc: Status 404 returned error can't find the container with id d050de6bd2433cbe2e157b780095b23313b4b5b5f8c2c2cd17c439e0105cbccc
Jul 08 21:10:46.260392 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:46.260299    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6p98z" event={"ID":"952fa495-b638-402f-bf66-183252d18ed1","Type":"ContainerStarted","Data":"d050de6bd2433cbe2e157b780095b23313b4b5b5f8c2c2cd17c439e0105cbccc"}
Jul 08 21:10:46.261562 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:46.261536    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht" event={"ID":"518c8a24-ba1d-4f24-ac17-ffeedbd7b729","Type":"ContainerStarted","Data":"6323b78e437fdd7c0c0c5c726db5f545442890897f2369481b00bb43f39440a7"}
Jul 08 21:10:47.603884 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:47.603848    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:10:48.270514 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:48.270479    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6p98z" event={"ID":"952fa495-b638-402f-bf66-183252d18ed1","Type":"ContainerStarted","Data":"4a269a3d4bb59dee2cf3619508f647f4381d02cb4988225be9b4e1cafd32e369"}
Jul 08 21:10:48.270713 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:48.270679    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6p98z"
Jul 08 21:10:48.272734 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:48.272710    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht" event={"ID":"518c8a24-ba1d-4f24-ac17-ffeedbd7b729","Type":"ContainerStarted","Data":"f7cd5f6e7109f28ab25857f52897a5a5f6e49b7325a122d3c867b6e1acf6f1a9"}
Jul 08 21:10:48.272857 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:48.272767    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht" event={"ID":"518c8a24-ba1d-4f24-ac17-ffeedbd7b729","Type":"ContainerStarted","Data":"dadca7677c4152ee6e498f2d77589493d2a8542fd6f066f97443c97f0b88ffad"}
Jul 08 21:10:48.272857 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:48.272796    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht" event={"ID":"518c8a24-ba1d-4f24-ac17-ffeedbd7b729","Type":"ContainerStarted","Data":"b083636d936e50e46462c5888e38dd1e4ae59a4008ac334cc4b94f7ece01c992"}
Jul 08 21:10:48.275616 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:48.275579    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6p98z"
Jul 08 21:10:48.286225 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:48.286173    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6p98z" podStartSLOduration=1.562858751 podStartE2EDuration="3.286160819s" totalImagesPullingTime="1.723302068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:48.284885036 +0000 UTC m=+271.378688585" watchObservedRunningTime="2026-07-08 21:10:48.286160819 +0000 UTC m=+271.379964344"
Jul 08 21:10:49.279743 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:49.279710    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht" event={"ID":"518c8a24-ba1d-4f24-ac17-ffeedbd7b729","Type":"ContainerStarted","Data":"c5dc15b84892cd57b72eaa1fb2637bc1b5131cad9c580e06086387bdd4479797"}
Jul 08 21:10:49.280106 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:49.279775    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht" event={"ID":"518c8a24-ba1d-4f24-ac17-ffeedbd7b729","Type":"ContainerStarted","Data":"6160bfcb395834c225aa31d10179799049760af6b5316528ed57af3aa2dcd361"}
Jul 08 21:10:49.280106 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:49.279802    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht" event={"ID":"518c8a24-ba1d-4f24-ac17-ffeedbd7b729","Type":"ContainerStarted","Data":"4a2a236223dc04c13d2cd709526b22b6a4a61dc14e6a3d7881c386fc331472cf"}
Jul 08 21:10:49.305416 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:49.303529    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht" podStartSLOduration=1.8493178430000001 podStartE2EDuration="5.303509301s" totalImagesPullingTime="3.454191458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:10:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:49.30202894 +0000 UTC m=+272.395832511" watchObservedRunningTime="2026-07-08 21:10:49.303509301 +0000 UTC m=+272.397312848"
Jul 08 21:10:50.126244 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:50.126203    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj" podUID="d1d437e6-b5ce-4458-8bdb-8bacb4ad3275" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 21:10:50.283563 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:50.283527    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:56.109994 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.109959    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f99446f65-h7gms"]
Jul 08 21:10:56.118865 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.118833    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.121751 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.121724    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f99446f65-h7gms"]
Jul 08 21:10:56.126917 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.126891    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 21:10:56.215704 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.215667    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31f0cc68-575d-4987-a837-c9e0ef019b16-console-serving-cert\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.215704 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.215710    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31f0cc68-575d-4987-a837-c9e0ef019b16-console-oauth-config\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.215980 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.215731    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-trusted-ca-bundle\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.215980 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.215808    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-service-ca\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.215980 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.215863    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-console-config\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.215980 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.215880    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvdqm\" (UniqueName: \"kubernetes.io/projected/31f0cc68-575d-4987-a837-c9e0ef019b16-kube-api-access-lvdqm\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.215980 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.215929    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-oauth-serving-cert\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.292467 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.292438    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6fbbdf85c5-6bhht"
Jul 08 21:10:56.316706 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.316669    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31f0cc68-575d-4987-a837-c9e0ef019b16-console-serving-cert\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.316706 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.316709    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31f0cc68-575d-4987-a837-c9e0ef019b16-console-oauth-config\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.316949 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.316826    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-trusted-ca-bundle\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.316949 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.316873    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-service-ca\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.316949 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.316919    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-console-config\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.317105 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.316949    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvdqm\" (UniqueName: \"kubernetes.io/projected/31f0cc68-575d-4987-a837-c9e0ef019b16-kube-api-access-lvdqm\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.317105 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.317021    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-oauth-serving-cert\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.317775 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.317720    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-console-config\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.317925 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.317824    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-oauth-serving-cert\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.317925 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.317879    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-trusted-ca-bundle\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.317925 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.317892    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-service-ca\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.319240 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.319217    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31f0cc68-575d-4987-a837-c9e0ef019b16-console-oauth-config\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.319346 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.319311    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31f0cc68-575d-4987-a837-c9e0ef019b16-console-serving-cert\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.329175 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.329149    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvdqm\" (UniqueName: \"kubernetes.io/projected/31f0cc68-575d-4987-a837-c9e0ef019b16-kube-api-access-lvdqm\") pod \"console-5f99446f65-h7gms\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") " pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.429471 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.429404    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:10:56.596225 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:56.596192    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f99446f65-h7gms"]
Jul 08 21:10:56.599165 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:10:56.599139    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f0cc68_575d_4987_a837_c9e0ef019b16.slice/crio-7f9182f73c472aa0e62dfde95f8f96dea42b42a14f799ae89ec4a0599326f9e6 WatchSource:0}: Error finding container 7f9182f73c472aa0e62dfde95f8f96dea42b42a14f799ae89ec4a0599326f9e6: Status 404 returned error can't find the container with id 7f9182f73c472aa0e62dfde95f8f96dea42b42a14f799ae89ec4a0599326f9e6
Jul 08 21:10:57.308957 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:57.308929    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f99446f65-h7gms" event={"ID":"31f0cc68-575d-4987-a837-c9e0ef019b16","Type":"ContainerStarted","Data":"c320949b30bcc297838e25a81035dd936e0504c1c8756f553cfbfdb2754770da"}
Jul 08 21:10:57.309343 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:57.308975    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f99446f65-h7gms" event={"ID":"31f0cc68-575d-4987-a837-c9e0ef019b16","Type":"ContainerStarted","Data":"7f9182f73c472aa0e62dfde95f8f96dea42b42a14f799ae89ec4a0599326f9e6"}
Jul 08 21:10:57.325669 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:57.325619    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f99446f65-h7gms" podStartSLOduration=1.325604832 podStartE2EDuration="1.325604832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:57.32412105 +0000 UTC m=+280.417924598" watchObservedRunningTime="2026-07-08 21:10:57.325604832 +0000 UTC m=+280.419408373"
Jul 08 21:10:58.912627 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:10:58.912569    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rw49m" podUID="352a5cba-6f07-4f24-bd51-c1f8c52c6848"
Jul 08 21:10:59.315356 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:10:59.315324    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rw49m"
Jul 08 21:11:00.126310 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:00.126271    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj" podUID="d1d437e6-b5ce-4458-8bdb-8bacb4ad3275" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 21:11:00.126758 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:00.126362    2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj"
Jul 08 21:11:00.127059 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:00.127020    2583 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"d45cb8154eb93cd5281dc5b60eaa791b241e4c9340fa889efade73f0a56086c9"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 08 21:11:00.127142 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:00.127085    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj" podUID="d1d437e6-b5ce-4458-8bdb-8bacb4ad3275" containerName="service-proxy" containerID="cri-o://d45cb8154eb93cd5281dc5b60eaa791b241e4c9340fa889efade73f0a56086c9" gracePeriod=30
Jul 08 21:11:00.321549 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:00.321516    2583 generic.go:356] "Generic (PLEG): container finished" podID="d1d437e6-b5ce-4458-8bdb-8bacb4ad3275" containerID="d45cb8154eb93cd5281dc5b60eaa791b241e4c9340fa889efade73f0a56086c9" exitCode=2
Jul 08 21:11:00.321702 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:00.321598    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj" event={"ID":"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275","Type":"ContainerDied","Data":"d45cb8154eb93cd5281dc5b60eaa791b241e4c9340fa889efade73f0a56086c9"}
Jul 08 21:11:00.321702 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:00.321646    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f79fffbd4-fq8mj" event={"ID":"d1d437e6-b5ce-4458-8bdb-8bacb4ad3275","Type":"ContainerStarted","Data":"adca0dd4b28bd387da49848b712b1a9f187698b5bb3da0a975ef54d52a0d854e"}
Jul 08 21:11:02.266641 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:02.266567    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:11:02.268799 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:02.268778    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/352a5cba-6f07-4f24-bd51-c1f8c52c6848-metrics-tls\") pod \"dns-default-rw49m\" (UID: \"352a5cba-6f07-4f24-bd51-c1f8c52c6848\") " pod="openshift-dns/dns-default-rw49m"
Jul 08 21:11:02.318527 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:02.318498    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ltsxq\""
Jul 08 21:11:02.326079 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:02.326060    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rw49m"
Jul 08 21:11:02.451330 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:02.451295    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rw49m"]
Jul 08 21:11:02.455214 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:11:02.455187    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod352a5cba_6f07_4f24_bd51_c1f8c52c6848.slice/crio-eaebd125d933c84a880bc88e24b856d63b724ad1ebdb180b8b3c93bba8a0a8be WatchSource:0}: Error finding container eaebd125d933c84a880bc88e24b856d63b724ad1ebdb180b8b3c93bba8a0a8be: Status 404 returned error can't find the container with id eaebd125d933c84a880bc88e24b856d63b724ad1ebdb180b8b3c93bba8a0a8be
Jul 08 21:11:03.337067 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:03.337029    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rw49m" event={"ID":"352a5cba-6f07-4f24-bd51-c1f8c52c6848","Type":"ContainerStarted","Data":"eaebd125d933c84a880bc88e24b856d63b724ad1ebdb180b8b3c93bba8a0a8be"}
Jul 08 21:11:04.342178 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:04.342152    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rw49m" event={"ID":"352a5cba-6f07-4f24-bd51-c1f8c52c6848","Type":"ContainerStarted","Data":"1e4715b538ce782606c8dda80ad119d21437d911f3ebfdadf60372217ce456fa"}
Jul 08 21:11:05.347526 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:05.347493    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rw49m" event={"ID":"352a5cba-6f07-4f24-bd51-c1f8c52c6848","Type":"ContainerStarted","Data":"6953f20dd809ecb0cf6da9688a7a43991d0c1360229ff2f12a67a496af03776d"}
Jul 08 21:11:05.348004 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:05.347605    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rw49m"
Jul 08 21:11:05.363536 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:05.363495    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rw49m" podStartSLOduration=251.638779641 podStartE2EDuration="4m13.363480591s" totalImagesPullingTime="1.72470095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:11:05.362185295 +0000 UTC m=+288.455988860" watchObservedRunningTime="2026-07-08 21:11:05.363480591 +0000 UTC m=+288.457284138"
Jul 08 21:11:06.429878 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:06.429845    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:11:06.430255 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:06.429898    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:11:06.434481 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:06.434461    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:11:07.358672 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:07.358646    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:11:10.719782 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:10.719712    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-659fb9dd64-kx6ln" podUID="15b2d91d-6e44-4160-b2a0-6b3d16c22d38" containerName="console" containerID="cri-o://5b686da907357bf5047c331d925aeb75cfc9aa2bc492967f7ce3006c8dd890f8" gracePeriod=15
Jul 08 21:11:10.955782 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:10.955756    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:11:11.031803 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.031771    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-oauth-config\") pod \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") "
Jul 08 21:11:11.031976 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.031819    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-config\") pod \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") "
Jul 08 21:11:11.031976 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.031842    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrjrv\" (UniqueName: \"kubernetes.io/projected/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-kube-api-access-zrjrv\") pod \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") "
Jul 08 21:11:11.031976 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.031872    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-service-ca\") pod \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") "
Jul 08 21:11:11.031976 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.031893    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-serving-cert\") pod \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") "
Jul 08 21:11:11.031976 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.031920    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-oauth-serving-cert\") pod \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\" (UID: \"15b2d91d-6e44-4160-b2a0-6b3d16c22d38\") "
Jul 08 21:11:11.032357 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.032322    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-config" (OuterVolumeSpecName: "console-config") pod "15b2d91d-6e44-4160-b2a0-6b3d16c22d38" (UID: "15b2d91d-6e44-4160-b2a0-6b3d16c22d38"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:11:11.032357 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.032343    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-service-ca" (OuterVolumeSpecName: "service-ca") pod "15b2d91d-6e44-4160-b2a0-6b3d16c22d38" (UID: "15b2d91d-6e44-4160-b2a0-6b3d16c22d38"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:11:11.032357 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.032349    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "15b2d91d-6e44-4160-b2a0-6b3d16c22d38" (UID: "15b2d91d-6e44-4160-b2a0-6b3d16c22d38"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:11:11.034111 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.034089    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "15b2d91d-6e44-4160-b2a0-6b3d16c22d38" (UID: "15b2d91d-6e44-4160-b2a0-6b3d16c22d38"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:11:11.034218 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.034122    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-kube-api-access-zrjrv" (OuterVolumeSpecName: "kube-api-access-zrjrv") pod "15b2d91d-6e44-4160-b2a0-6b3d16c22d38" (UID: "15b2d91d-6e44-4160-b2a0-6b3d16c22d38"). InnerVolumeSpecName "kube-api-access-zrjrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:11:11.034218 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.034158    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "15b2d91d-6e44-4160-b2a0-6b3d16c22d38" (UID: "15b2d91d-6e44-4160-b2a0-6b3d16c22d38"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:11:11.133248 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.133215    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-config\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:11:11.133248 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.133246    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrjrv\" (UniqueName: \"kubernetes.io/projected/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-kube-api-access-zrjrv\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:11:11.133248 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.133255    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-service-ca\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:11:11.133469 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.133263    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-serving-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:11:11.133469 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.133272    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-oauth-serving-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:11:11.133469 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.133280    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15b2d91d-6e44-4160-b2a0-6b3d16c22d38-console-oauth-config\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:11:11.370777 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.370686    2583 generic.go:356] "Generic (PLEG): container finished" podID="15b2d91d-6e44-4160-b2a0-6b3d16c22d38" containerID="5b686da907357bf5047c331d925aeb75cfc9aa2bc492967f7ce3006c8dd890f8" exitCode=0
Jul 08 21:11:11.370777 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.370721    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659fb9dd64-kx6ln" event={"ID":"15b2d91d-6e44-4160-b2a0-6b3d16c22d38","Type":"ContainerDied","Data":"5b686da907357bf5047c331d925aeb75cfc9aa2bc492967f7ce3006c8dd890f8"}
Jul 08 21:11:11.370777 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.370773    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659fb9dd64-kx6ln" event={"ID":"15b2d91d-6e44-4160-b2a0-6b3d16c22d38","Type":"ContainerDied","Data":"c4aba3dd145c4a40151d27089db1fb873f5d29aabf690cef87e6f93b7fe0b7bb"}
Jul 08 21:11:11.371024 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.370793    2583 scope.go:117] "RemoveContainer" containerID="5b686da907357bf5047c331d925aeb75cfc9aa2bc492967f7ce3006c8dd890f8"
Jul 08 21:11:11.371024 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.370732    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659fb9dd64-kx6ln"
Jul 08 21:11:11.382423 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.382403    2583 scope.go:117] "RemoveContainer" containerID="5b686da907357bf5047c331d925aeb75cfc9aa2bc492967f7ce3006c8dd890f8"
Jul 08 21:11:11.382722 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:11:11.382700    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b686da907357bf5047c331d925aeb75cfc9aa2bc492967f7ce3006c8dd890f8\": container with ID starting with 5b686da907357bf5047c331d925aeb75cfc9aa2bc492967f7ce3006c8dd890f8 not found: ID does not exist" containerID="5b686da907357bf5047c331d925aeb75cfc9aa2bc492967f7ce3006c8dd890f8"
Jul 08 21:11:11.382781 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.382730    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b686da907357bf5047c331d925aeb75cfc9aa2bc492967f7ce3006c8dd890f8"} err="failed to get container status \"5b686da907357bf5047c331d925aeb75cfc9aa2bc492967f7ce3006c8dd890f8\": rpc error: code = NotFound desc = could not find container \"5b686da907357bf5047c331d925aeb75cfc9aa2bc492967f7ce3006c8dd890f8\": container with ID starting with 5b686da907357bf5047c331d925aeb75cfc9aa2bc492967f7ce3006c8dd890f8 not found: ID does not exist"
Jul 08 21:11:11.392458 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.392432    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-659fb9dd64-kx6ln"]
Jul 08 21:11:11.395934 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.395910    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-659fb9dd64-kx6ln"]
Jul 08 21:11:11.429449 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:11.429417    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15b2d91d-6e44-4160-b2a0-6b3d16c22d38" path="/var/lib/kubelet/pods/15b2d91d-6e44-4160-b2a0-6b3d16c22d38/volumes"
Jul 08 21:11:15.353220 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:15.353192    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rw49m"
Jul 08 21:11:17.324774 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:17.324750    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 21:11:19.631037 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:11:19.631005    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b4q7m_723ef4ae-7bd1-4f3e-9824-68a3117131cd/serve-healthcheck-canary/0.log"
Jul 08 21:12:16.451142 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:16.451109    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f99446f65-h7gms"]
Jul 08 21:12:41.470410 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.470339    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f99446f65-h7gms" podUID="31f0cc68-575d-4987-a837-c9e0ef019b16" containerName="console" containerID="cri-o://c320949b30bcc297838e25a81035dd936e0504c1c8756f553cfbfdb2754770da" gracePeriod=15
Jul 08 21:12:41.681509 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.681470    2583 generic.go:356] "Generic (PLEG): container finished" podID="31f0cc68-575d-4987-a837-c9e0ef019b16" containerID="c320949b30bcc297838e25a81035dd936e0504c1c8756f553cfbfdb2754770da" exitCode=0
Jul 08 21:12:41.681684 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.681518    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f99446f65-h7gms" event={"ID":"31f0cc68-575d-4987-a837-c9e0ef019b16","Type":"ContainerDied","Data":"c320949b30bcc297838e25a81035dd936e0504c1c8756f553cfbfdb2754770da"}
Jul 08 21:12:41.713827 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.713803    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:12:41.791537 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.791503    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-trusted-ca-bundle\") pod \"31f0cc68-575d-4987-a837-c9e0ef019b16\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") "
Jul 08 21:12:41.791735 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.791547    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-service-ca\") pod \"31f0cc68-575d-4987-a837-c9e0ef019b16\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") "
Jul 08 21:12:41.791735 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.791576    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31f0cc68-575d-4987-a837-c9e0ef019b16-console-oauth-config\") pod \"31f0cc68-575d-4987-a837-c9e0ef019b16\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") "
Jul 08 21:12:41.791735 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.791612    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-console-config\") pod \"31f0cc68-575d-4987-a837-c9e0ef019b16\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") "
Jul 08 21:12:41.791735 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.791636    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-oauth-serving-cert\") pod \"31f0cc68-575d-4987-a837-c9e0ef019b16\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") "
Jul 08 21:12:41.791735 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.791679    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvdqm\" (UniqueName: \"kubernetes.io/projected/31f0cc68-575d-4987-a837-c9e0ef019b16-kube-api-access-lvdqm\") pod \"31f0cc68-575d-4987-a837-c9e0ef019b16\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") "
Jul 08 21:12:41.791735 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.791697    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31f0cc68-575d-4987-a837-c9e0ef019b16-console-serving-cert\") pod \"31f0cc68-575d-4987-a837-c9e0ef019b16\" (UID: \"31f0cc68-575d-4987-a837-c9e0ef019b16\") "
Jul 08 21:12:41.792130 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.792080    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "31f0cc68-575d-4987-a837-c9e0ef019b16" (UID: "31f0cc68-575d-4987-a837-c9e0ef019b16"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:12:41.792130 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.792102    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-console-config" (OuterVolumeSpecName: "console-config") pod "31f0cc68-575d-4987-a837-c9e0ef019b16" (UID: "31f0cc68-575d-4987-a837-c9e0ef019b16"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:12:41.792130 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.792108    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-service-ca" (OuterVolumeSpecName: "service-ca") pod "31f0cc68-575d-4987-a837-c9e0ef019b16" (UID: "31f0cc68-575d-4987-a837-c9e0ef019b16"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:12:41.792130 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.792087    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "31f0cc68-575d-4987-a837-c9e0ef019b16" (UID: "31f0cc68-575d-4987-a837-c9e0ef019b16"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:12:41.793806 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.793776    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31f0cc68-575d-4987-a837-c9e0ef019b16-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "31f0cc68-575d-4987-a837-c9e0ef019b16" (UID: "31f0cc68-575d-4987-a837-c9e0ef019b16"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:12:41.793912 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.793857    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31f0cc68-575d-4987-a837-c9e0ef019b16-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "31f0cc68-575d-4987-a837-c9e0ef019b16" (UID: "31f0cc68-575d-4987-a837-c9e0ef019b16"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:12:41.793912 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.793855    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31f0cc68-575d-4987-a837-c9e0ef019b16-kube-api-access-lvdqm" (OuterVolumeSpecName: "kube-api-access-lvdqm") pod "31f0cc68-575d-4987-a837-c9e0ef019b16" (UID: "31f0cc68-575d-4987-a837-c9e0ef019b16"). InnerVolumeSpecName "kube-api-access-lvdqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:12:41.892903 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.892869    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvdqm\" (UniqueName: \"kubernetes.io/projected/31f0cc68-575d-4987-a837-c9e0ef019b16-kube-api-access-lvdqm\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:12:41.892903 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.892897    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31f0cc68-575d-4987-a837-c9e0ef019b16-console-serving-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:12:41.892903 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.892907    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-trusted-ca-bundle\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:12:41.893147 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.892915    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-service-ca\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:12:41.893147 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.892924    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31f0cc68-575d-4987-a837-c9e0ef019b16-console-oauth-config\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:12:41.893147 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.892931    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-console-config\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:12:41.893147 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:41.892940    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31f0cc68-575d-4987-a837-c9e0ef019b16-oauth-serving-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:12:42.686365 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:42.686335    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f99446f65-h7gms"
Jul 08 21:12:42.686365 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:42.686349    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f99446f65-h7gms" event={"ID":"31f0cc68-575d-4987-a837-c9e0ef019b16","Type":"ContainerDied","Data":"7f9182f73c472aa0e62dfde95f8f96dea42b42a14f799ae89ec4a0599326f9e6"}
Jul 08 21:12:42.686901 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:42.686400    2583 scope.go:117] "RemoveContainer" containerID="c320949b30bcc297838e25a81035dd936e0504c1c8756f553cfbfdb2754770da"
Jul 08 21:12:42.707172 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:42.707139    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f99446f65-h7gms"]
Jul 08 21:12:42.712208 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:42.712182    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f99446f65-h7gms"]
Jul 08 21:12:43.429098 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:12:43.429063    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31f0cc68-575d-4987-a837-c9e0ef019b16" path="/var/lib/kubelet/pods/31f0cc68-575d-4987-a837-c9e0ef019b16/volumes"
Jul 08 21:13:37.298383 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.298356    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q"]
Jul 08 21:13:37.298806 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.298620    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31f0cc68-575d-4987-a837-c9e0ef019b16" containerName="console"
Jul 08 21:13:37.298806 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.298631    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="31f0cc68-575d-4987-a837-c9e0ef019b16" containerName="console"
Jul 08 21:13:37.298806 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.298650    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b2d91d-6e44-4160-b2a0-6b3d16c22d38" containerName="console"
Jul 08 21:13:37.298806 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.298656    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b2d91d-6e44-4160-b2a0-6b3d16c22d38" containerName="console"
Jul 08 21:13:37.298806 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.298696    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="31f0cc68-575d-4987-a837-c9e0ef019b16" containerName="console"
Jul 08 21:13:37.298806 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.298703    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b2d91d-6e44-4160-b2a0-6b3d16c22d38" containerName="console"
Jul 08 21:13:37.302752 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.302732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q"
Jul 08 21:13:37.305244 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.305225    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 21:13:37.306135 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.306114    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 21:13:37.306240 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.306116    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x8fg9\""
Jul 08 21:13:37.308071 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.308050    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdr74\" (UniqueName: \"kubernetes.io/projected/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-kube-api-access-sdr74\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q\" (UID: \"d6c9a6b6-95c3-431e-b69c-b0287381ea8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q"
Jul 08 21:13:37.308163 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.308081    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q\" (UID: \"d6c9a6b6-95c3-431e-b69c-b0287381ea8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q"
Jul 08 21:13:37.308163 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.308131    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q\" (UID: \"d6c9a6b6-95c3-431e-b69c-b0287381ea8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q"
Jul 08 21:13:37.310333 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.310312    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q"]
Jul 08 21:13:37.408979 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.408939    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdr74\" (UniqueName: \"kubernetes.io/projected/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-kube-api-access-sdr74\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q\" (UID: \"d6c9a6b6-95c3-431e-b69c-b0287381ea8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q"
Jul 08 21:13:37.408979 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.408982    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q\" (UID: \"d6c9a6b6-95c3-431e-b69c-b0287381ea8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q"
Jul 08 21:13:37.409219 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.409044    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q\" (UID: \"d6c9a6b6-95c3-431e-b69c-b0287381ea8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q"
Jul 08 21:13:37.409380 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.409359    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q\" (UID: \"d6c9a6b6-95c3-431e-b69c-b0287381ea8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q"
Jul 08 21:13:37.409443 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.409394    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q\" (UID: \"d6c9a6b6-95c3-431e-b69c-b0287381ea8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q"
Jul 08 21:13:37.417197 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.417173    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdr74\" (UniqueName: \"kubernetes.io/projected/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-kube-api-access-sdr74\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q\" (UID: \"d6c9a6b6-95c3-431e-b69c-b0287381ea8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q"
Jul 08 21:13:37.612436 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.612358    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q"
Jul 08 21:13:37.723319 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.723289    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-k5lbt"]
Jul 08 21:13:37.726407 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.726385    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-k5lbt"
Jul 08 21:13:37.728895 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.728876    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 08 21:13:37.729022 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.728894    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 08 21:13:37.729022 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.728960    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-bqlr2\""
Jul 08 21:13:37.734268 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.734243    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-k5lbt"]
Jul 08 21:13:37.738145 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.738110    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q"]
Jul 08 21:13:37.740797 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:13:37.740775    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6c9a6b6_95c3_431e_b69c_b0287381ea8e.slice/crio-cf2a94c89b4a2c612fe480b9a2d40a0e53f50ba7027ec0459dd23da55d86ace4 WatchSource:0}: Error finding container cf2a94c89b4a2c612fe480b9a2d40a0e53f50ba7027ec0459dd23da55d86ace4: Status 404 returned error can't find the container with id cf2a94c89b4a2c612fe480b9a2d40a0e53f50ba7027ec0459dd23da55d86ace4
Jul 08 21:13:37.742990 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.742974    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:13:37.812138 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.812109    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/707ac7e3-5cb0-43f9-ad92-038bcce52fa9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-k5lbt\" (UID: \"707ac7e3-5cb0-43f9-ad92-038bcce52fa9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k5lbt"
Jul 08 21:13:37.812281 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.812162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qw7x\" (UniqueName: \"kubernetes.io/projected/707ac7e3-5cb0-43f9-ad92-038bcce52fa9-kube-api-access-6qw7x\") pod \"cert-manager-cainjector-559cdd8c87-k5lbt\" (UID: \"707ac7e3-5cb0-43f9-ad92-038bcce52fa9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k5lbt"
Jul 08 21:13:37.879460 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.879393    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q" event={"ID":"d6c9a6b6-95c3-431e-b69c-b0287381ea8e","Type":"ContainerStarted","Data":"cf2a94c89b4a2c612fe480b9a2d40a0e53f50ba7027ec0459dd23da55d86ace4"}
Jul 08 21:13:37.912767 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.912740    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qw7x\" (UniqueName: \"kubernetes.io/projected/707ac7e3-5cb0-43f9-ad92-038bcce52fa9-kube-api-access-6qw7x\") pod \"cert-manager-cainjector-559cdd8c87-k5lbt\" (UID: \"707ac7e3-5cb0-43f9-ad92-038bcce52fa9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k5lbt"
Jul 08 21:13:37.912873 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.912786    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/707ac7e3-5cb0-43f9-ad92-038bcce52fa9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-k5lbt\" (UID: \"707ac7e3-5cb0-43f9-ad92-038bcce52fa9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k5lbt"
Jul 08 21:13:37.920744 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.920717    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/707ac7e3-5cb0-43f9-ad92-038bcce52fa9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-k5lbt\" (UID: \"707ac7e3-5cb0-43f9-ad92-038bcce52fa9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k5lbt"
Jul 08 21:13:37.920899 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:37.920881    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qw7x\" (UniqueName: \"kubernetes.io/projected/707ac7e3-5cb0-43f9-ad92-038bcce52fa9-kube-api-access-6qw7x\") pod \"cert-manager-cainjector-559cdd8c87-k5lbt\" (UID: \"707ac7e3-5cb0-43f9-ad92-038bcce52fa9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k5lbt"
Jul 08 21:13:38.035567 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:38.035536    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-k5lbt"
Jul 08 21:13:38.152862 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:38.152837    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-k5lbt"]
Jul 08 21:13:38.155204 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:13:38.155178    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod707ac7e3_5cb0_43f9_ad92_038bcce52fa9.slice/crio-13f72b0c123c992b5c200d9c2a6ef6a3970e031c2fb59ac6d6119aa3d37ff6bf WatchSource:0}: Error finding container 13f72b0c123c992b5c200d9c2a6ef6a3970e031c2fb59ac6d6119aa3d37ff6bf: Status 404 returned error can't find the container with id 13f72b0c123c992b5c200d9c2a6ef6a3970e031c2fb59ac6d6119aa3d37ff6bf
Jul 08 21:13:38.884838 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:38.884747    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-k5lbt" event={"ID":"707ac7e3-5cb0-43f9-ad92-038bcce52fa9","Type":"ContainerStarted","Data":"13f72b0c123c992b5c200d9c2a6ef6a3970e031c2fb59ac6d6119aa3d37ff6bf"}
Jul 08 21:13:41.901163 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:41.901125    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-k5lbt" event={"ID":"707ac7e3-5cb0-43f9-ad92-038bcce52fa9","Type":"ContainerStarted","Data":"6d480491aae030f2348d15a4f6c26579bd6912792fe81c2fafee7b1446ba1be9"}
Jul 08 21:13:41.919865 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:41.919806    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-k5lbt" podStartSLOduration=1.277704872 podStartE2EDuration="4.919783823s" totalImagesPullingTime="3.642078951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:13:41.91884208 +0000 UTC m=+445.012645628" watchObservedRunningTime="2026-07-08 21:13:41.919783823 +0000 UTC m=+445.013587352"
Jul 08 21:13:45.917049 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:45.917015    2583 generic.go:356] "Generic (PLEG): container finished" podID="d6c9a6b6-95c3-431e-b69c-b0287381ea8e" containerID="d12a736707bee6b7f9b8e1afadc79c8058087d9da505ded45ce28be1bca0401b" exitCode=0
Jul 08 21:13:45.917471 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:45.917106    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q" event={"ID":"d6c9a6b6-95c3-431e-b69c-b0287381ea8e","Type":"ContainerDied","Data":"d12a736707bee6b7f9b8e1afadc79c8058087d9da505ded45ce28be1bca0401b"}
Jul 08 21:13:47.927151 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:47.927116    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q" event={"ID":"d6c9a6b6-95c3-431e-b69c-b0287381ea8e","Type":"ContainerStarted","Data":"1a40221807c649bc4f9424f292c2749fa7d702d45fc1b65b26610a37a6ef25b9"}
Jul 08 21:13:48.932639 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:48.932580    2583 generic.go:356] "Generic (PLEG): container finished" podID="d6c9a6b6-95c3-431e-b69c-b0287381ea8e" containerID="1a40221807c649bc4f9424f292c2749fa7d702d45fc1b65b26610a37a6ef25b9" exitCode=0
Jul 08 21:13:48.933061 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:48.932660    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q" event={"ID":"d6c9a6b6-95c3-431e-b69c-b0287381ea8e","Type":"ContainerDied","Data":"1a40221807c649bc4f9424f292c2749fa7d702d45fc1b65b26610a37a6ef25b9"}
Jul 08 21:13:57.971247 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:57.971213    2583 generic.go:356] "Generic (PLEG): container finished" podID="d6c9a6b6-95c3-431e-b69c-b0287381ea8e" containerID="b4fa1e36d21f66d0317e4ab31a9a51691ecc1c73b0d774b99e1fe3508e1134b1" exitCode=0
Jul 08 21:13:57.971641 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:57.971300    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q" event={"ID":"d6c9a6b6-95c3-431e-b69c-b0287381ea8e","Type":"ContainerDied","Data":"b4fa1e36d21f66d0317e4ab31a9a51691ecc1c73b0d774b99e1fe3508e1134b1"}
Jul 08 21:13:59.107343 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:59.107319    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q"
Jul 08 21:13:59.181251 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:59.181224    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-bundle\") pod \"d6c9a6b6-95c3-431e-b69c-b0287381ea8e\" (UID: \"d6c9a6b6-95c3-431e-b69c-b0287381ea8e\") "
Jul 08 21:13:59.181411 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:59.181287    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-util\") pod \"d6c9a6b6-95c3-431e-b69c-b0287381ea8e\" (UID: \"d6c9a6b6-95c3-431e-b69c-b0287381ea8e\") "
Jul 08 21:13:59.181411 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:59.181308    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdr74\" (UniqueName: \"kubernetes.io/projected/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-kube-api-access-sdr74\") pod \"d6c9a6b6-95c3-431e-b69c-b0287381ea8e\" (UID: \"d6c9a6b6-95c3-431e-b69c-b0287381ea8e\") "
Jul 08 21:13:59.181631 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:59.181610    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-bundle" (OuterVolumeSpecName: "bundle") pod "d6c9a6b6-95c3-431e-b69c-b0287381ea8e" (UID: "d6c9a6b6-95c3-431e-b69c-b0287381ea8e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:13:59.183684 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:59.183660    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-kube-api-access-sdr74" (OuterVolumeSpecName: "kube-api-access-sdr74") pod "d6c9a6b6-95c3-431e-b69c-b0287381ea8e" (UID: "d6c9a6b6-95c3-431e-b69c-b0287381ea8e"). InnerVolumeSpecName "kube-api-access-sdr74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:13:59.185738 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:59.185713    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-util" (OuterVolumeSpecName: "util") pod "d6c9a6b6-95c3-431e-b69c-b0287381ea8e" (UID: "d6c9a6b6-95c3-431e-b69c-b0287381ea8e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:13:59.281825 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:59.281801    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-bundle\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:13:59.281825 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:59.281823    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-util\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:13:59.281976 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:59.281832    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdr74\" (UniqueName: \"kubernetes.io/projected/d6c9a6b6-95c3-431e-b69c-b0287381ea8e-kube-api-access-sdr74\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:13:59.980510 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:59.980482    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q"
Jul 08 21:13:59.980685 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:59.980481    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn4f9q" event={"ID":"d6c9a6b6-95c3-431e-b69c-b0287381ea8e","Type":"ContainerDied","Data":"cf2a94c89b4a2c612fe480b9a2d40a0e53f50ba7027ec0459dd23da55d86ace4"}
Jul 08 21:13:59.980685 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:13:59.980613    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf2a94c89b4a2c612fe480b9a2d40a0e53f50ba7027ec0459dd23da55d86ace4"
Jul 08 21:14:23.843730 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.843696    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"]
Jul 08 21:14:23.844273 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.844090    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6c9a6b6-95c3-431e-b69c-b0287381ea8e" containerName="pull"
Jul 08 21:14:23.844273 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.844105    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6c9a6b6-95c3-431e-b69c-b0287381ea8e" containerName="pull"
Jul 08 21:14:23.844273 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.844126    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6c9a6b6-95c3-431e-b69c-b0287381ea8e" containerName="util"
Jul 08 21:14:23.844273 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.844134    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6c9a6b6-95c3-431e-b69c-b0287381ea8e" containerName="util"
Jul 08 21:14:23.844273 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.844156    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6c9a6b6-95c3-431e-b69c-b0287381ea8e" containerName="extract"
Jul 08 21:14:23.844273 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.844215    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6c9a6b6-95c3-431e-b69c-b0287381ea8e" containerName="extract"
Jul 08 21:14:23.844572 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.844287    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6c9a6b6-95c3-431e-b69c-b0287381ea8e" containerName="extract"
Jul 08 21:14:23.846440 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.846422    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"
Jul 08 21:14:23.849096 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.849080    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 08 21:14:23.850478 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.850458    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 08 21:14:23.850600 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.850491    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:14:23.850600 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.850493    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 21:14:23.850600 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.850462    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 08 21:14:23.850791 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.850778    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mbpgv\""
Jul 08 21:14:23.856749 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.856733    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"]
Jul 08 21:14:23.951396 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.951357    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/82c1ee56-9cfc-485a-b1bc-01a1104ae3f7-manager-config\") pod \"lws-controller-manager-66869b5f86-kz8ll\" (UID: \"82c1ee56-9cfc-485a-b1bc-01a1104ae3f7\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"
Jul 08 21:14:23.951605 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.951413    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlwpn\" (UniqueName: \"kubernetes.io/projected/82c1ee56-9cfc-485a-b1bc-01a1104ae3f7-kube-api-access-dlwpn\") pod \"lws-controller-manager-66869b5f86-kz8ll\" (UID: \"82c1ee56-9cfc-485a-b1bc-01a1104ae3f7\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"
Jul 08 21:14:23.951605 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.951493    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/82c1ee56-9cfc-485a-b1bc-01a1104ae3f7-metrics-cert\") pod \"lws-controller-manager-66869b5f86-kz8ll\" (UID: \"82c1ee56-9cfc-485a-b1bc-01a1104ae3f7\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"
Jul 08 21:14:23.951605 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:23.951511    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82c1ee56-9cfc-485a-b1bc-01a1104ae3f7-cert\") pod \"lws-controller-manager-66869b5f86-kz8ll\" (UID: \"82c1ee56-9cfc-485a-b1bc-01a1104ae3f7\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"
Jul 08 21:14:24.052719 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:24.052689    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/82c1ee56-9cfc-485a-b1bc-01a1104ae3f7-metrics-cert\") pod \"lws-controller-manager-66869b5f86-kz8ll\" (UID: \"82c1ee56-9cfc-485a-b1bc-01a1104ae3f7\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"
Jul 08 21:14:24.052719 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:24.052723    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82c1ee56-9cfc-485a-b1bc-01a1104ae3f7-cert\") pod \"lws-controller-manager-66869b5f86-kz8ll\" (UID: \"82c1ee56-9cfc-485a-b1bc-01a1104ae3f7\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"
Jul 08 21:14:24.052924 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:24.052747    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/82c1ee56-9cfc-485a-b1bc-01a1104ae3f7-manager-config\") pod \"lws-controller-manager-66869b5f86-kz8ll\" (UID: \"82c1ee56-9cfc-485a-b1bc-01a1104ae3f7\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"
Jul 08 21:14:24.052966 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:24.052950    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlwpn\" (UniqueName: \"kubernetes.io/projected/82c1ee56-9cfc-485a-b1bc-01a1104ae3f7-kube-api-access-dlwpn\") pod \"lws-controller-manager-66869b5f86-kz8ll\" (UID: \"82c1ee56-9cfc-485a-b1bc-01a1104ae3f7\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"
Jul 08 21:14:24.053354 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:24.053330    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/82c1ee56-9cfc-485a-b1bc-01a1104ae3f7-manager-config\") pod \"lws-controller-manager-66869b5f86-kz8ll\" (UID: \"82c1ee56-9cfc-485a-b1bc-01a1104ae3f7\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"
Jul 08 21:14:24.055208 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:24.055187    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/82c1ee56-9cfc-485a-b1bc-01a1104ae3f7-metrics-cert\") pod \"lws-controller-manager-66869b5f86-kz8ll\" (UID: \"82c1ee56-9cfc-485a-b1bc-01a1104ae3f7\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"
Jul 08 21:14:24.055308 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:24.055276    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82c1ee56-9cfc-485a-b1bc-01a1104ae3f7-cert\") pod \"lws-controller-manager-66869b5f86-kz8ll\" (UID: \"82c1ee56-9cfc-485a-b1bc-01a1104ae3f7\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"
Jul 08 21:14:24.067789 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:24.067768    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlwpn\" (UniqueName: \"kubernetes.io/projected/82c1ee56-9cfc-485a-b1bc-01a1104ae3f7-kube-api-access-dlwpn\") pod \"lws-controller-manager-66869b5f86-kz8ll\" (UID: \"82c1ee56-9cfc-485a-b1bc-01a1104ae3f7\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"
Jul 08 21:14:24.155290 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:24.155210    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"
Jul 08 21:14:24.286782 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:24.286653    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"]
Jul 08 21:14:24.289260 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:14:24.289239    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c1ee56_9cfc_485a_b1bc_01a1104ae3f7.slice/crio-b84bf59ca0eed2a6d6928f6958b68026b41887804f22f5047255e118fb429aad WatchSource:0}: Error finding container b84bf59ca0eed2a6d6928f6958b68026b41887804f22f5047255e118fb429aad: Status 404 returned error can't find the container with id b84bf59ca0eed2a6d6928f6958b68026b41887804f22f5047255e118fb429aad
Jul 08 21:14:25.003047 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.003018    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"]
Jul 08 21:14:25.006739 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.006721    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:25.009184 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.009163    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 21:14:25.009184 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.009177    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 21:14:25.009366 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.009194    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 21:14:25.009621 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.009580    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w5666\""
Jul 08 21:14:25.009721 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.009706    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 21:14:25.021379 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.021358    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"]
Jul 08 21:14:25.060386 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.060357    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c606878-9b04-425e-abc5-af3bb55a7ee3-tmp\") pod \"opendatahub-operator-controller-manager-94bc986b9-kxj8s\" (UID: \"8c606878-9b04-425e-abc5-af3bb55a7ee3\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:25.060526 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.060401    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcjxs\" (UniqueName: \"kubernetes.io/projected/8c606878-9b04-425e-abc5-af3bb55a7ee3-kube-api-access-dcjxs\") pod \"opendatahub-operator-controller-manager-94bc986b9-kxj8s\" (UID: \"8c606878-9b04-425e-abc5-af3bb55a7ee3\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:25.060526 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.060449    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c606878-9b04-425e-abc5-af3bb55a7ee3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94bc986b9-kxj8s\" (UID: \"8c606878-9b04-425e-abc5-af3bb55a7ee3\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:25.060682 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.060525    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c606878-9b04-425e-abc5-af3bb55a7ee3-webhook-cert\") pod \"opendatahub-operator-controller-manager-94bc986b9-kxj8s\" (UID: \"8c606878-9b04-425e-abc5-af3bb55a7ee3\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:25.060682 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.060575    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c606878-9b04-425e-abc5-af3bb55a7ee3-manifests\") pod \"opendatahub-operator-controller-manager-94bc986b9-kxj8s\" (UID: \"8c606878-9b04-425e-abc5-af3bb55a7ee3\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:25.070293 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.070267    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll" event={"ID":"82c1ee56-9cfc-485a-b1bc-01a1104ae3f7","Type":"ContainerStarted","Data":"b84bf59ca0eed2a6d6928f6958b68026b41887804f22f5047255e118fb429aad"}
Jul 08 21:14:25.161842 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.161810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c606878-9b04-425e-abc5-af3bb55a7ee3-webhook-cert\") pod \"opendatahub-operator-controller-manager-94bc986b9-kxj8s\" (UID: \"8c606878-9b04-425e-abc5-af3bb55a7ee3\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:25.161842 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.161856    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c606878-9b04-425e-abc5-af3bb55a7ee3-manifests\") pod \"opendatahub-operator-controller-manager-94bc986b9-kxj8s\" (UID: \"8c606878-9b04-425e-abc5-af3bb55a7ee3\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:25.162156 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.161886    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c606878-9b04-425e-abc5-af3bb55a7ee3-tmp\") pod \"opendatahub-operator-controller-manager-94bc986b9-kxj8s\" (UID: \"8c606878-9b04-425e-abc5-af3bb55a7ee3\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:25.162156 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.161902    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcjxs\" (UniqueName: \"kubernetes.io/projected/8c606878-9b04-425e-abc5-af3bb55a7ee3-kube-api-access-dcjxs\") pod \"opendatahub-operator-controller-manager-94bc986b9-kxj8s\" (UID: \"8c606878-9b04-425e-abc5-af3bb55a7ee3\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:25.162156 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.161920    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c606878-9b04-425e-abc5-af3bb55a7ee3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94bc986b9-kxj8s\" (UID: \"8c606878-9b04-425e-abc5-af3bb55a7ee3\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:25.162425 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.162390    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c606878-9b04-425e-abc5-af3bb55a7ee3-manifests\") pod \"opendatahub-operator-controller-manager-94bc986b9-kxj8s\" (UID: \"8c606878-9b04-425e-abc5-af3bb55a7ee3\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:25.164389 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.164358    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c606878-9b04-425e-abc5-af3bb55a7ee3-tmp\") pod \"opendatahub-operator-controller-manager-94bc986b9-kxj8s\" (UID: \"8c606878-9b04-425e-abc5-af3bb55a7ee3\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:25.164551 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.164535    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c606878-9b04-425e-abc5-af3bb55a7ee3-webhook-cert\") pod \"opendatahub-operator-controller-manager-94bc986b9-kxj8s\" (UID: \"8c606878-9b04-425e-abc5-af3bb55a7ee3\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:25.164715 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.164697    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c606878-9b04-425e-abc5-af3bb55a7ee3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94bc986b9-kxj8s\" (UID: \"8c606878-9b04-425e-abc5-af3bb55a7ee3\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:25.174069 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.174043    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcjxs\" (UniqueName: \"kubernetes.io/projected/8c606878-9b04-425e-abc5-af3bb55a7ee3-kube-api-access-dcjxs\") pod \"opendatahub-operator-controller-manager-94bc986b9-kxj8s\" (UID: \"8c606878-9b04-425e-abc5-af3bb55a7ee3\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:25.317218 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.317129    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:25.472930 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:25.472899    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"]
Jul 08 21:14:25.478374 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:14:25.478348    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c606878_9b04_425e_abc5_af3bb55a7ee3.slice/crio-635fd1ad56c6b05dfeeb615569b523e91948fdca4dd56ed8a2794b578552cd92 WatchSource:0}: Error finding container 635fd1ad56c6b05dfeeb615569b523e91948fdca4dd56ed8a2794b578552cd92: Status 404 returned error can't find the container with id 635fd1ad56c6b05dfeeb615569b523e91948fdca4dd56ed8a2794b578552cd92
Jul 08 21:14:26.075385 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:26.075355    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s" event={"ID":"8c606878-9b04-425e-abc5-af3bb55a7ee3","Type":"ContainerStarted","Data":"635fd1ad56c6b05dfeeb615569b523e91948fdca4dd56ed8a2794b578552cd92"}
Jul 08 21:14:27.081782 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:27.081740    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll" event={"ID":"82c1ee56-9cfc-485a-b1bc-01a1104ae3f7","Type":"ContainerStarted","Data":"bed24fe7073c6e572529c1569c325fc34be5abf1a03dbfe77f32d245aae89903"}
Jul 08 21:14:27.082288 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:27.081941    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"
Jul 08 21:14:27.100000 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:27.099946    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll" podStartSLOduration=1.853684314 podStartE2EDuration="4.099928583s" totalImagesPullingTime="2.246244269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:14:27.097541909 +0000 UTC m=+490.191345456" watchObservedRunningTime="2026-07-08 21:14:27.099928583 +0000 UTC m=+490.193732135"
Jul 08 21:14:30.096363 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:30.096329    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s" event={"ID":"8c606878-9b04-425e-abc5-af3bb55a7ee3","Type":"ContainerStarted","Data":"8f3c35732570a026801b38e6b222f3f6b2c08c6ccc343aab2baecba7cdb541c0"}
Jul 08 21:14:31.101102 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:31.101064    2583 generic.go:356] "Generic (PLEG): container finished" podID="8c606878-9b04-425e-abc5-af3bb55a7ee3" containerID="8f3c35732570a026801b38e6b222f3f6b2c08c6ccc343aab2baecba7cdb541c0" exitCode=0
Jul 08 21:14:31.101634 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:31.101112    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s" event={"ID":"8c606878-9b04-425e-abc5-af3bb55a7ee3","Type":"ContainerDied","Data":"8f3c35732570a026801b38e6b222f3f6b2c08c6ccc343aab2baecba7cdb541c0"}
Jul 08 21:14:32.106721 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:32.106684    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s" event={"ID":"8c606878-9b04-425e-abc5-af3bb55a7ee3","Type":"ContainerStarted","Data":"244d138c1d6ec25b7325be4005cd035f159d9c740042ec1270a6568d60405f00"}
Jul 08 21:14:32.107088 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:32.106807    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:32.128891 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:32.128841    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s" podStartSLOduration=3.141924856 podStartE2EDuration="8.12882512s" totalImagesPullingTime="3.939168867s" totalInitContainerRuntime="1.047731397s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:14:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:14:32.126340151 +0000 UTC m=+495.220143715" watchObservedRunningTime="2026-07-08 21:14:32.12882512 +0000 UTC m=+495.222628661"
Jul 08 21:14:38.088107 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:38.088077    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66869b5f86-kz8ll"
Jul 08 21:14:43.111810 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:43.111783    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-kxj8s"
Jul 08 21:14:54.913446 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:54.913412    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"]
Jul 08 21:14:54.915706 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:54.915692    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:54.918060 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:54.918037    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 21:14:54.918203 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:54.918188    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 21:14:54.918433 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:54.918279    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wvfxn\""
Jul 08 21:14:54.918433 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:54.918315    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 21:14:54.918433 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:54.918322    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 21:14:54.918433 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:54.918336    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 21:14:54.918433 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:54.918339    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 21:14:54.929177 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:54.929157    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"]
Jul 08 21:14:55.096911 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.096880    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a12d5fd4-cb82-4be5-86af-20799b3b17ed-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.096911 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.096916    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a12d5fd4-cb82-4be5-86af-20799b3b17ed-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.097130 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.096934    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a12d5fd4-cb82-4be5-86af-20799b3b17ed-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.097130 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.097030    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r7ns\" (UniqueName: \"kubernetes.io/projected/a12d5fd4-cb82-4be5-86af-20799b3b17ed-kube-api-access-4r7ns\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.097130 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.097080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a12d5fd4-cb82-4be5-86af-20799b3b17ed-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.097283 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.097153    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a12d5fd4-cb82-4be5-86af-20799b3b17ed-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.097283 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.097201    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a12d5fd4-cb82-4be5-86af-20799b3b17ed-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.198675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.198571    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a12d5fd4-cb82-4be5-86af-20799b3b17ed-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.198675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.198627    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a12d5fd4-cb82-4be5-86af-20799b3b17ed-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.198675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.198644    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a12d5fd4-cb82-4be5-86af-20799b3b17ed-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.198945 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.198683    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r7ns\" (UniqueName: \"kubernetes.io/projected/a12d5fd4-cb82-4be5-86af-20799b3b17ed-kube-api-access-4r7ns\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.198945 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.198701    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a12d5fd4-cb82-4be5-86af-20799b3b17ed-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.198945 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.198723    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a12d5fd4-cb82-4be5-86af-20799b3b17ed-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.198945 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.198752    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a12d5fd4-cb82-4be5-86af-20799b3b17ed-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.199406 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.199386    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a12d5fd4-cb82-4be5-86af-20799b3b17ed-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.201427 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.201405    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a12d5fd4-cb82-4be5-86af-20799b3b17ed-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.201427 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.201419    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a12d5fd4-cb82-4be5-86af-20799b3b17ed-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.201548 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.201445    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a12d5fd4-cb82-4be5-86af-20799b3b17ed-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.201614 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.201571    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a12d5fd4-cb82-4be5-86af-20799b3b17ed-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.207417 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.207389    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r7ns\" (UniqueName: \"kubernetes.io/projected/a12d5fd4-cb82-4be5-86af-20799b3b17ed-kube-api-access-4r7ns\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.207639 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.207620    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a12d5fd4-cb82-4be5-86af-20799b3b17ed-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7l7ck\" (UID: \"a12d5fd4-cb82-4be5-86af-20799b3b17ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.225089 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.225061    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:55.381488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:55.381464    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"]
Jul 08 21:14:55.383966 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:14:55.383941    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda12d5fd4_cb82_4be5_86af_20799b3b17ed.slice/crio-9e70b11b1d854ed9d615eb09ad1ef409a7c80e61f9d44b6e4361dbfc2949d495 WatchSource:0}: Error finding container 9e70b11b1d854ed9d615eb09ad1ef409a7c80e61f9d44b6e4361dbfc2949d495: Status 404 returned error can't find the container with id 9e70b11b1d854ed9d615eb09ad1ef409a7c80e61f9d44b6e4361dbfc2949d495
Jul 08 21:14:56.200477 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:56.200430    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck" event={"ID":"a12d5fd4-cb82-4be5-86af-20799b3b17ed","Type":"ContainerStarted","Data":"9e70b11b1d854ed9d615eb09ad1ef409a7c80e61f9d44b6e4361dbfc2949d495"}
Jul 08 21:14:57.788886 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:57.788840    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:14:57.789137 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:57.788929    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:14:58.217546 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:58.217456    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck" event={"ID":"a12d5fd4-cb82-4be5-86af-20799b3b17ed","Type":"ContainerStarted","Data":"aa30fabb3400f9b6059828a7e137a1ff33253bcc93f976639afcfd16e2eb3661"}
Jul 08 21:14:58.217730 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:58.217634    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:14:58.219422 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:58.219397    2583 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-7l7ck container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 21:14:58.219533 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:58.219447    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck" podUID="a12d5fd4-cb82-4be5-86af-20799b3b17ed" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:14:58.244368 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:58.244315    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck" podStartSLOduration=1.8416417680000001 podStartE2EDuration="4.244298059s" totalImagesPullingTime="2.402656291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:14:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:14:58.242685216 +0000 UTC m=+521.336488791" watchObservedRunningTime="2026-07-08 21:14:58.244298059 +0000 UTC m=+521.338101605"
Jul 08 21:14:59.222410 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:14:59.222383    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7l7ck"
Jul 08 21:16:02.328488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.328456    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl"]
Jul 08 21:16:02.331680 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.331659    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl"
Jul 08 21:16:02.334165 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.334126    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dfkr2\""
Jul 08 21:16:02.334279 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.334171    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 21:16:02.335092 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.335077    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 21:16:02.338228 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.338204    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl"]
Jul 08 21:16:02.511612 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.511551    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl\" (UID: \"decff8aa-a1f8-4bb6-b55c-c3abfe413e95\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl"
Jul 08 21:16:02.511612 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.511621    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl\" (UID: \"decff8aa-a1f8-4bb6-b55c-c3abfe413e95\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl"
Jul 08 21:16:02.511872 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.511699    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rshgd\" (UniqueName: \"kubernetes.io/projected/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-kube-api-access-rshgd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl\" (UID: \"decff8aa-a1f8-4bb6-b55c-c3abfe413e95\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl"
Jul 08 21:16:02.613012 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.612921    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl\" (UID: \"decff8aa-a1f8-4bb6-b55c-c3abfe413e95\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl"
Jul 08 21:16:02.613012 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.612988    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rshgd\" (UniqueName: \"kubernetes.io/projected/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-kube-api-access-rshgd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl\" (UID: \"decff8aa-a1f8-4bb6-b55c-c3abfe413e95\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl"
Jul 08 21:16:02.613012 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.613012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl\" (UID: \"decff8aa-a1f8-4bb6-b55c-c3abfe413e95\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl"
Jul 08 21:16:02.613303 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.613285    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl\" (UID: \"decff8aa-a1f8-4bb6-b55c-c3abfe413e95\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl"
Jul 08 21:16:02.613339 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.613296    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl\" (UID: \"decff8aa-a1f8-4bb6-b55c-c3abfe413e95\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl"
Jul 08 21:16:02.621202 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.621170    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rshgd\" (UniqueName: \"kubernetes.io/projected/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-kube-api-access-rshgd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl\" (UID: \"decff8aa-a1f8-4bb6-b55c-c3abfe413e95\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl"
Jul 08 21:16:02.642188 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.642141    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl"
Jul 08 21:16:02.765144 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.765119    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl"]
Jul 08 21:16:02.767519 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:16:02.767494    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddecff8aa_a1f8_4bb6_b55c_c3abfe413e95.slice/crio-23c61aaa1d549eff69820eb15cb66a35031b4ff86c2af025c741b36b4d32c84b WatchSource:0}: Error finding container 23c61aaa1d549eff69820eb15cb66a35031b4ff86c2af025c741b36b4d32c84b: Status 404 returned error can't find the container with id 23c61aaa1d549eff69820eb15cb66a35031b4ff86c2af025c741b36b4d32c84b
Jul 08 21:16:02.927837 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.927809    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l"]
Jul 08 21:16:02.930936 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.930922    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l"
Jul 08 21:16:02.939109 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:02.939090    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l"]
Jul 08 21:16:03.117564 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.117486    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l\" (UID: \"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l"
Jul 08 21:16:03.117564 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.117528    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l\" (UID: \"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l"
Jul 08 21:16:03.117564 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.117561    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trbwv\" (UniqueName: \"kubernetes.io/projected/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-kube-api-access-trbwv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l\" (UID: \"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l"
Jul 08 21:16:03.218420 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.218383    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l\" (UID: \"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l"
Jul 08 21:16:03.218612 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.218431    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l\" (UID: \"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l"
Jul 08 21:16:03.218612 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.218469    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trbwv\" (UniqueName: \"kubernetes.io/projected/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-kube-api-access-trbwv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l\" (UID: \"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l"
Jul 08 21:16:03.218937 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.218919    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l\" (UID: \"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l"
Jul 08 21:16:03.218979 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.218922    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l\" (UID: \"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l"
Jul 08 21:16:03.225994 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.225970    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trbwv\" (UniqueName: \"kubernetes.io/projected/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-kube-api-access-trbwv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l\" (UID: \"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l"
Jul 08 21:16:03.239954 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.239924    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l"
Jul 08 21:16:03.363159 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.363131    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l"]
Jul 08 21:16:03.365599 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:16:03.365565    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b2d52ed_83f5_4e1f_89c1_5067036f0d5c.slice/crio-f41f7dd4f7996c5883cc42609e98b2e48356ef658e44d32aaaed9077a0b20c59 WatchSource:0}: Error finding container f41f7dd4f7996c5883cc42609e98b2e48356ef658e44d32aaaed9077a0b20c59: Status 404 returned error can't find the container with id f41f7dd4f7996c5883cc42609e98b2e48356ef658e44d32aaaed9077a0b20c59
Jul 08 21:16:03.459833 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.459793    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l" event={"ID":"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c","Type":"ContainerStarted","Data":"a693a8998ca941deafa4fb830e1d39246c62a5c264718956030020c676eb4bb3"}
Jul 08 21:16:03.460022 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.459854    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l" event={"ID":"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c","Type":"ContainerStarted","Data":"f41f7dd4f7996c5883cc42609e98b2e48356ef658e44d32aaaed9077a0b20c59"}
Jul 08 21:16:03.461428 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.461397    2583 generic.go:356] "Generic (PLEG): container finished" podID="decff8aa-a1f8-4bb6-b55c-c3abfe413e95" containerID="2c302e100fcf4771e1f8e00c49308bb1e9cf0fdea3427c20fe2b1b97cc982b4a" exitCode=0
Jul 08 21:16:03.461525 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.461482    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl" event={"ID":"decff8aa-a1f8-4bb6-b55c-c3abfe413e95","Type":"ContainerDied","Data":"2c302e100fcf4771e1f8e00c49308bb1e9cf0fdea3427c20fe2b1b97cc982b4a"}
Jul 08 21:16:03.461599 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.461526    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl" event={"ID":"decff8aa-a1f8-4bb6-b55c-c3abfe413e95","Type":"ContainerStarted","Data":"23c61aaa1d549eff69820eb15cb66a35031b4ff86c2af025c741b36b4d32c84b"}
Jul 08 21:16:03.729067 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.729036    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz"]
Jul 08 21:16:03.732314 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.732299    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz"
Jul 08 21:16:03.739798 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.739773    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz"]
Jul 08 21:16:03.823727 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.823691    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdef781e-23eb-43ca-80eb-71b93e23ea31-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz\" (UID: \"cdef781e-23eb-43ca-80eb-71b93e23ea31\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz"
Jul 08 21:16:03.823727 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.823727    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdef781e-23eb-43ca-80eb-71b93e23ea31-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz\" (UID: \"cdef781e-23eb-43ca-80eb-71b93e23ea31\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz"
Jul 08 21:16:03.823917 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.823838    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79cb5\" (UniqueName: \"kubernetes.io/projected/cdef781e-23eb-43ca-80eb-71b93e23ea31-kube-api-access-79cb5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz\" (UID: \"cdef781e-23eb-43ca-80eb-71b93e23ea31\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz"
Jul 08 21:16:03.925115 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.925040    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79cb5\" (UniqueName: \"kubernetes.io/projected/cdef781e-23eb-43ca-80eb-71b93e23ea31-kube-api-access-79cb5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz\" (UID: \"cdef781e-23eb-43ca-80eb-71b93e23ea31\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz"
Jul 08 21:16:03.925115 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.925091    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdef781e-23eb-43ca-80eb-71b93e23ea31-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz\" (UID: \"cdef781e-23eb-43ca-80eb-71b93e23ea31\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz"
Jul 08 21:16:03.925292 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.925206    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdef781e-23eb-43ca-80eb-71b93e23ea31-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz\" (UID: \"cdef781e-23eb-43ca-80eb-71b93e23ea31\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz"
Jul 08 21:16:03.925394 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.925380    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdef781e-23eb-43ca-80eb-71b93e23ea31-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz\" (UID: \"cdef781e-23eb-43ca-80eb-71b93e23ea31\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz"
Jul 08 21:16:03.925485 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.925471    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdef781e-23eb-43ca-80eb-71b93e23ea31-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz\" (UID: \"cdef781e-23eb-43ca-80eb-71b93e23ea31\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz"
Jul 08 21:16:03.932769 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:03.932744    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79cb5\" (UniqueName: \"kubernetes.io/projected/cdef781e-23eb-43ca-80eb-71b93e23ea31-kube-api-access-79cb5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz\" (UID: \"cdef781e-23eb-43ca-80eb-71b93e23ea31\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz"
Jul 08 21:16:04.041914 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:04.041885    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz"
Jul 08 21:16:04.166352 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:04.166191    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz"]
Jul 08 21:16:04.169005 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:16:04.168978    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdef781e_23eb_43ca_80eb_71b93e23ea31.slice/crio-57bcb9508be393dc1249dffbd9bd8695b06fc07b850d4fc948df60be7ba77dcf WatchSource:0}: Error finding container 57bcb9508be393dc1249dffbd9bd8695b06fc07b850d4fc948df60be7ba77dcf: Status 404 returned error can't find the container with id 57bcb9508be393dc1249dffbd9bd8695b06fc07b850d4fc948df60be7ba77dcf
Jul 08 21:16:04.467422 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:04.467396    2583 generic.go:356] "Generic (PLEG): container finished" podID="9b2d52ed-83f5-4e1f-89c1-5067036f0d5c" containerID="a693a8998ca941deafa4fb830e1d39246c62a5c264718956030020c676eb4bb3" exitCode=0
Jul 08 21:16:04.467745 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:04.467478    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l" event={"ID":"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c","Type":"ContainerDied","Data":"a693a8998ca941deafa4fb830e1d39246c62a5c264718956030020c676eb4bb3"}
Jul 08 21:16:04.469037 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:04.469020    2583 generic.go:356] "Generic (PLEG): container finished" podID="cdef781e-23eb-43ca-80eb-71b93e23ea31" containerID="38b600cc1a86ca42dfbec3dc2fbf26fadba147a3963c4095ac764cc398889e84" exitCode=0
Jul 08 21:16:04.469091 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:04.469060    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz" event={"ID":"cdef781e-23eb-43ca-80eb-71b93e23ea31","Type":"ContainerDied","Data":"38b600cc1a86ca42dfbec3dc2fbf26fadba147a3963c4095ac764cc398889e84"}
Jul 08 21:16:04.469124 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:04.469091    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz" event={"ID":"cdef781e-23eb-43ca-80eb-71b93e23ea31","Type":"ContainerStarted","Data":"57bcb9508be393dc1249dffbd9bd8695b06fc07b850d4fc948df60be7ba77dcf"}
Jul 08 21:16:05.475369 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:05.475322    2583 generic.go:356] "Generic (PLEG): container finished" podID="decff8aa-a1f8-4bb6-b55c-c3abfe413e95" containerID="fd66bba70390e352c21cd5756b1070228524acc424c33642cbca5582864141cf" exitCode=0
Jul 08 21:16:05.476055 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:05.475398    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl" event={"ID":"decff8aa-a1f8-4bb6-b55c-c3abfe413e95","Type":"ContainerDied","Data":"fd66bba70390e352c21cd5756b1070228524acc424c33642cbca5582864141cf"}
Jul 08 21:16:06.481708 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:06.481678    2583 generic.go:356] "Generic (PLEG): container finished" podID="decff8aa-a1f8-4bb6-b55c-c3abfe413e95" containerID="2f3a4e627d0987c64dea1751c9dcb7c77a7c6ca4a9b5fc9129783193f9759935" exitCode=0
Jul 08 21:16:06.482116 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:06.481751    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl" event={"ID":"decff8aa-a1f8-4bb6-b55c-c3abfe413e95","Type":"ContainerDied","Data":"2f3a4e627d0987c64dea1751c9dcb7c77a7c6ca4a9b5fc9129783193f9759935"}
Jul 08 21:16:06.483798 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:06.483774    2583 generic.go:356] "Generic (PLEG): container finished" podID="cdef781e-23eb-43ca-80eb-71b93e23ea31" containerID="33bc10822b4c04411cf86852bdb5a7c870cf5456d1a69c59620297891c43e411" exitCode=0
Jul 08 21:16:06.483911 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:06.483862    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz" event={"ID":"cdef781e-23eb-43ca-80eb-71b93e23ea31","Type":"ContainerDied","Data":"33bc10822b4c04411cf86852bdb5a7c870cf5456d1a69c59620297891c43e411"}
Jul 08 21:16:06.485692 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:06.485670    2583 generic.go:356] "Generic (PLEG): container finished" podID="9b2d52ed-83f5-4e1f-89c1-5067036f0d5c" containerID="4b82e473b6d391ac9f8da5c4c6ef4e15a672f3c25748c98b549f4eb0c15594c0" exitCode=0
Jul 08 21:16:06.485778 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:06.485706    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l" event={"ID":"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c","Type":"ContainerDied","Data":"4b82e473b6d391ac9f8da5c4c6ef4e15a672f3c25748c98b549f4eb0c15594c0"}
Jul 08 21:16:07.491071 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:07.490995    2583 generic.go:356] "Generic (PLEG): container finished" podID="cdef781e-23eb-43ca-80eb-71b93e23ea31" containerID="fc803eb37313607cf659975567c9985b9f08a91c275190744557ad5b4ae15b1f" exitCode=0
Jul 08 21:16:07.491462 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:07.491077    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz" event={"ID":"cdef781e-23eb-43ca-80eb-71b93e23ea31","Type":"ContainerDied","Data":"fc803eb37313607cf659975567c9985b9f08a91c275190744557ad5b4ae15b1f"}
Jul 08 21:16:07.492947 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:07.492921    2583 generic.go:356] "Generic (PLEG): container finished" podID="9b2d52ed-83f5-4e1f-89c1-5067036f0d5c" containerID="f64d94f40ddea7b2637a305a49ec37530d0fa0f1f6aa8dcdd0c0ac4cf5a9dbb4" exitCode=0
Jul 08 21:16:07.493046 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:07.493003    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l" event={"ID":"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c","Type":"ContainerDied","Data":"f64d94f40ddea7b2637a305a49ec37530d0fa0f1f6aa8dcdd0c0ac4cf5a9dbb4"}
Jul 08 21:16:07.615384 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:07.615360    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl"
Jul 08 21:16:07.757900 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:07.757876    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rshgd\" (UniqueName: \"kubernetes.io/projected/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-kube-api-access-rshgd\") pod \"decff8aa-a1f8-4bb6-b55c-c3abfe413e95\" (UID: \"decff8aa-a1f8-4bb6-b55c-c3abfe413e95\") "
Jul 08 21:16:07.758112 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:07.757912    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-bundle\") pod \"decff8aa-a1f8-4bb6-b55c-c3abfe413e95\" (UID: \"decff8aa-a1f8-4bb6-b55c-c3abfe413e95\") "
Jul 08 21:16:07.758112 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:07.757969    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-util\") pod \"decff8aa-a1f8-4bb6-b55c-c3abfe413e95\" (UID: \"decff8aa-a1f8-4bb6-b55c-c3abfe413e95\") "
Jul 08 21:16:07.758396 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:07.758361    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-bundle" (OuterVolumeSpecName: "bundle") pod "decff8aa-a1f8-4bb6-b55c-c3abfe413e95" (UID: "decff8aa-a1f8-4bb6-b55c-c3abfe413e95"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:16:07.760046 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:07.760024    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-kube-api-access-rshgd" (OuterVolumeSpecName: "kube-api-access-rshgd") pod "decff8aa-a1f8-4bb6-b55c-c3abfe413e95" (UID: "decff8aa-a1f8-4bb6-b55c-c3abfe413e95"). InnerVolumeSpecName "kube-api-access-rshgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:16:07.763538 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:07.763515    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-util" (OuterVolumeSpecName: "util") pod "decff8aa-a1f8-4bb6-b55c-c3abfe413e95" (UID: "decff8aa-a1f8-4bb6-b55c-c3abfe413e95"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:16:07.858727 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:07.858696    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-util\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:16:07.858727 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:07.858720    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rshgd\" (UniqueName: \"kubernetes.io/projected/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-kube-api-access-rshgd\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:16:07.858727 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:07.858732    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/decff8aa-a1f8-4bb6-b55c-c3abfe413e95-bundle\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:16:08.500876 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.500843    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl"
Jul 08 21:16:08.500876 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.500876    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl" event={"ID":"decff8aa-a1f8-4bb6-b55c-c3abfe413e95","Type":"ContainerDied","Data":"23c61aaa1d549eff69820eb15cb66a35031b4ff86c2af025c741b36b4d32c84b"}
Jul 08 21:16:08.501348 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.500909    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23c61aaa1d549eff69820eb15cb66a35031b4ff86c2af025c741b36b4d32c84b"
Jul 08 21:16:08.651682 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.651661    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l"
Jul 08 21:16:08.660282 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.660264    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz"
Jul 08 21:16:08.664547 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.664529    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdef781e-23eb-43ca-80eb-71b93e23ea31-bundle\") pod \"cdef781e-23eb-43ca-80eb-71b93e23ea31\" (UID: \"cdef781e-23eb-43ca-80eb-71b93e23ea31\") "
Jul 08 21:16:08.664637 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.664556    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-bundle\") pod \"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c\" (UID: \"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c\") "
Jul 08 21:16:08.664637 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.664582    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-util\") pod \"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c\" (UID: \"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c\") "
Jul 08 21:16:08.664637 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.664631    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trbwv\" (UniqueName: \"kubernetes.io/projected/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-kube-api-access-trbwv\") pod \"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c\" (UID: \"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c\") "
Jul 08 21:16:08.665066 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.665043    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-bundle" (OuterVolumeSpecName: "bundle") pod "9b2d52ed-83f5-4e1f-89c1-5067036f0d5c" (UID: "9b2d52ed-83f5-4e1f-89c1-5067036f0d5c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:16:08.665234 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.665211    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdef781e-23eb-43ca-80eb-71b93e23ea31-bundle" (OuterVolumeSpecName: "bundle") pod "cdef781e-23eb-43ca-80eb-71b93e23ea31" (UID: "cdef781e-23eb-43ca-80eb-71b93e23ea31"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:16:08.666950 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.666879    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-kube-api-access-trbwv" (OuterVolumeSpecName: "kube-api-access-trbwv") pod "9b2d52ed-83f5-4e1f-89c1-5067036f0d5c" (UID: "9b2d52ed-83f5-4e1f-89c1-5067036f0d5c"). InnerVolumeSpecName "kube-api-access-trbwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:16:08.672221 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.672198    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-util" (OuterVolumeSpecName: "util") pod "9b2d52ed-83f5-4e1f-89c1-5067036f0d5c" (UID: "9b2d52ed-83f5-4e1f-89c1-5067036f0d5c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:16:08.765297 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.765275    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdef781e-23eb-43ca-80eb-71b93e23ea31-util\") pod \"cdef781e-23eb-43ca-80eb-71b93e23ea31\" (UID: \"cdef781e-23eb-43ca-80eb-71b93e23ea31\") "
Jul 08 21:16:08.765430 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.765311    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79cb5\" (UniqueName: \"kubernetes.io/projected/cdef781e-23eb-43ca-80eb-71b93e23ea31-kube-api-access-79cb5\") pod \"cdef781e-23eb-43ca-80eb-71b93e23ea31\" (UID: \"cdef781e-23eb-43ca-80eb-71b93e23ea31\") "
Jul 08 21:16:08.765469 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.765456    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdef781e-23eb-43ca-80eb-71b93e23ea31-bundle\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:16:08.765501 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.765470    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-bundle\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:16:08.765501 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.765483    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-util\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:16:08.765501 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.765497    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trbwv\" (UniqueName: \"kubernetes.io/projected/9b2d52ed-83f5-4e1f-89c1-5067036f0d5c-kube-api-access-trbwv\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:16:08.767300 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.767269    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdef781e-23eb-43ca-80eb-71b93e23ea31-kube-api-access-79cb5" (OuterVolumeSpecName: "kube-api-access-79cb5") pod "cdef781e-23eb-43ca-80eb-71b93e23ea31" (UID: "cdef781e-23eb-43ca-80eb-71b93e23ea31"). InnerVolumeSpecName "kube-api-access-79cb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:16:08.770347 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.770322    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdef781e-23eb-43ca-80eb-71b93e23ea31-util" (OuterVolumeSpecName: "util") pod "cdef781e-23eb-43ca-80eb-71b93e23ea31" (UID: "cdef781e-23eb-43ca-80eb-71b93e23ea31"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:16:08.865841 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.865802    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdef781e-23eb-43ca-80eb-71b93e23ea31-util\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:16:08.865841 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:08.865838    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79cb5\" (UniqueName: \"kubernetes.io/projected/cdef781e-23eb-43ca-80eb-71b93e23ea31-kube-api-access-79cb5\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:16:09.506928 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:09.506903    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l"
Jul 08 21:16:09.507366 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:09.506930    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l" event={"ID":"9b2d52ed-83f5-4e1f-89c1-5067036f0d5c","Type":"ContainerDied","Data":"f41f7dd4f7996c5883cc42609e98b2e48356ef658e44d32aaaed9077a0b20c59"}
Jul 08 21:16:09.507366 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:09.506985    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f41f7dd4f7996c5883cc42609e98b2e48356ef658e44d32aaaed9077a0b20c59"
Jul 08 21:16:09.508743 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:09.508710    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz" event={"ID":"cdef781e-23eb-43ca-80eb-71b93e23ea31","Type":"ContainerDied","Data":"57bcb9508be393dc1249dffbd9bd8695b06fc07b850d4fc948df60be7ba77dcf"}
Jul 08 21:16:09.508868 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:09.508743    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz"
Jul 08 21:16:09.508868 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:16:09.508755    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57bcb9508be393dc1249dffbd9bd8695b06fc07b850d4fc948df60be7ba77dcf"
Jul 08 21:17:52.543055 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543018    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7svmm"]
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543307    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdef781e-23eb-43ca-80eb-71b93e23ea31" containerName="extract"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543321    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdef781e-23eb-43ca-80eb-71b93e23ea31" containerName="extract"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543332    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="decff8aa-a1f8-4bb6-b55c-c3abfe413e95" containerName="pull"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543338    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="decff8aa-a1f8-4bb6-b55c-c3abfe413e95" containerName="pull"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543345    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b2d52ed-83f5-4e1f-89c1-5067036f0d5c" containerName="pull"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543350    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b2d52ed-83f5-4e1f-89c1-5067036f0d5c" containerName="pull"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543358    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b2d52ed-83f5-4e1f-89c1-5067036f0d5c" containerName="util"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543364    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b2d52ed-83f5-4e1f-89c1-5067036f0d5c" containerName="util"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543370    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b2d52ed-83f5-4e1f-89c1-5067036f0d5c" containerName="extract"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543375    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b2d52ed-83f5-4e1f-89c1-5067036f0d5c" containerName="extract"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543381    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="decff8aa-a1f8-4bb6-b55c-c3abfe413e95" containerName="util"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543386    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="decff8aa-a1f8-4bb6-b55c-c3abfe413e95" containerName="util"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543394    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdef781e-23eb-43ca-80eb-71b93e23ea31" containerName="pull"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543399    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdef781e-23eb-43ca-80eb-71b93e23ea31" containerName="pull"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543406    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="decff8aa-a1f8-4bb6-b55c-c3abfe413e95" containerName="extract"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543410    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="decff8aa-a1f8-4bb6-b55c-c3abfe413e95" containerName="extract"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543419    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdef781e-23eb-43ca-80eb-71b93e23ea31" containerName="util"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543425    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdef781e-23eb-43ca-80eb-71b93e23ea31" containerName="util"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543466    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="decff8aa-a1f8-4bb6-b55c-c3abfe413e95" containerName="extract"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543476    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdef781e-23eb-43ca-80eb-71b93e23ea31" containerName="extract"
Jul 08 21:17:52.543523 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.543482    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b2d52ed-83f5-4e1f-89c1-5067036f0d5c" containerName="extract"
Jul 08 21:17:52.546283 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.546268    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7svmm"
Jul 08 21:17:52.548836 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.548810    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lqktf\""
Jul 08 21:17:52.548969 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.548838    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 21:17:52.549786 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.549773    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 21:17:52.555568 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.555546    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7svmm"]
Jul 08 21:17:52.635568 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.635530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7n7t\" (UniqueName: \"kubernetes.io/projected/952d9b04-52f8-4154-8eb2-28724ec55d4c-kube-api-access-p7n7t\") pod \"authorino-75d556bd77-7svmm\" (UID: \"952d9b04-52f8-4154-8eb2-28724ec55d4c\") " pod="kuadrant-system/authorino-75d556bd77-7svmm"
Jul 08 21:17:52.736427 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.736393    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7n7t\" (UniqueName: \"kubernetes.io/projected/952d9b04-52f8-4154-8eb2-28724ec55d4c-kube-api-access-p7n7t\") pod \"authorino-75d556bd77-7svmm\" (UID: \"952d9b04-52f8-4154-8eb2-28724ec55d4c\") " pod="kuadrant-system/authorino-75d556bd77-7svmm"
Jul 08 21:17:52.743758 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.743737    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7n7t\" (UniqueName: \"kubernetes.io/projected/952d9b04-52f8-4154-8eb2-28724ec55d4c-kube-api-access-p7n7t\") pod \"authorino-75d556bd77-7svmm\" (UID: \"952d9b04-52f8-4154-8eb2-28724ec55d4c\") " pod="kuadrant-system/authorino-75d556bd77-7svmm"
Jul 08 21:17:52.855791 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.855695    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7svmm"
Jul 08 21:17:52.977976 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:52.977945    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7svmm"]
Jul 08 21:17:52.981495 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:17:52.981469    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod952d9b04_52f8_4154_8eb2_28724ec55d4c.slice/crio-82b4ee26fc99f451dc584f9bf51d7784511be559d75dda6089b0836b694c2173 WatchSource:0}: Error finding container 82b4ee26fc99f451dc584f9bf51d7784511be559d75dda6089b0836b694c2173: Status 404 returned error can't find the container with id 82b4ee26fc99f451dc584f9bf51d7784511be559d75dda6089b0836b694c2173
Jul 08 21:17:53.948696 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:53.948654    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7svmm" event={"ID":"952d9b04-52f8-4154-8eb2-28724ec55d4c","Type":"ContainerStarted","Data":"82b4ee26fc99f451dc584f9bf51d7784511be559d75dda6089b0836b694c2173"}
Jul 08 21:17:56.965071 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:56.964980    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7svmm" event={"ID":"952d9b04-52f8-4154-8eb2-28724ec55d4c","Type":"ContainerStarted","Data":"374b56d73b3949fb8ffc97cf7941e99f4fe7be4d9fc1c5e2edbb2cad7f1f48f9"}
Jul 08 21:17:56.978887 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:17:56.978835    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7svmm" podStartSLOduration=1.4172661469999999 podStartE2EDuration="4.978819328s" totalImagesPullingTime="3.561553181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:17:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:17:56.977404833 +0000 UTC m=+700.071208408" watchObservedRunningTime="2026-07-08 21:17:56.978819328 +0000 UTC m=+700.072622930"
Jul 08 21:18:25.909297 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:25.909259    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5l7fp"]
Jul 08 21:18:25.912749 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:25.912730    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5l7fp"
Jul 08 21:18:25.915856 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:25.915828    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5l7fp"]
Jul 08 21:18:26.010420 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.010385    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65xwq\" (UniqueName: \"kubernetes.io/projected/99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a-kube-api-access-65xwq\") pod \"authorino-5d4b67c446-5l7fp\" (UID: \"99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a\") " pod="kuadrant-system/authorino-5d4b67c446-5l7fp"
Jul 08 21:18:26.111904 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.111869    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65xwq\" (UniqueName: \"kubernetes.io/projected/99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a-kube-api-access-65xwq\") pod \"authorino-5d4b67c446-5l7fp\" (UID: \"99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a\") " pod="kuadrant-system/authorino-5d4b67c446-5l7fp"
Jul 08 21:18:26.119471 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.119439    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65xwq\" (UniqueName: \"kubernetes.io/projected/99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a-kube-api-access-65xwq\") pod \"authorino-5d4b67c446-5l7fp\" (UID: \"99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a\") " pod="kuadrant-system/authorino-5d4b67c446-5l7fp"
Jul 08 21:18:26.147219 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.147185    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5l7fp"]
Jul 08 21:18:26.147415 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.147403    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5l7fp"
Jul 08 21:18:26.170677 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.170614    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c7c657f66-wzq7x"]
Jul 08 21:18:26.173978 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.173956    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c7c657f66-wzq7x"
Jul 08 21:18:26.176215 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.176193    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 08 21:18:26.180738 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.180708    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c7c657f66-wzq7x"]
Jul 08 21:18:26.279114 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.279092    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5l7fp"]
Jul 08 21:18:26.281463 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:18:26.281436    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99ca0aa0_05fa_4c80_b58b_286dbc2d0f9a.slice/crio-d358ff6d6cefd00d217acfef0ff03461b0a1893b32068d81726bda68b5ce34d4 WatchSource:0}: Error finding container d358ff6d6cefd00d217acfef0ff03461b0a1893b32068d81726bda68b5ce34d4: Status 404 returned error can't find the container with id d358ff6d6cefd00d217acfef0ff03461b0a1893b32068d81726bda68b5ce34d4
Jul 08 21:18:26.313426 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.313395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6ed3fec2-088a-44ef-bd86-6b991f66d2d9-tls-cert\") pod \"authorino-5c7c657f66-wzq7x\" (UID: \"6ed3fec2-088a-44ef-bd86-6b991f66d2d9\") " pod="kuadrant-system/authorino-5c7c657f66-wzq7x"
Jul 08 21:18:26.313573 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.313439    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp5d4\" (UniqueName: \"kubernetes.io/projected/6ed3fec2-088a-44ef-bd86-6b991f66d2d9-kube-api-access-fp5d4\") pod \"authorino-5c7c657f66-wzq7x\" (UID: \"6ed3fec2-088a-44ef-bd86-6b991f66d2d9\") " pod="kuadrant-system/authorino-5c7c657f66-wzq7x"
Jul 08 21:18:26.414408 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.414377    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp5d4\" (UniqueName: \"kubernetes.io/projected/6ed3fec2-088a-44ef-bd86-6b991f66d2d9-kube-api-access-fp5d4\") pod \"authorino-5c7c657f66-wzq7x\" (UID: \"6ed3fec2-088a-44ef-bd86-6b991f66d2d9\") " pod="kuadrant-system/authorino-5c7c657f66-wzq7x"
Jul 08 21:18:26.414633 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.414443    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6ed3fec2-088a-44ef-bd86-6b991f66d2d9-tls-cert\") pod \"authorino-5c7c657f66-wzq7x\" (UID: \"6ed3fec2-088a-44ef-bd86-6b991f66d2d9\") " pod="kuadrant-system/authorino-5c7c657f66-wzq7x"
Jul 08 21:18:26.416760 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.416742    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6ed3fec2-088a-44ef-bd86-6b991f66d2d9-tls-cert\") pod \"authorino-5c7c657f66-wzq7x\" (UID: \"6ed3fec2-088a-44ef-bd86-6b991f66d2d9\") " pod="kuadrant-system/authorino-5c7c657f66-wzq7x"
Jul 08 21:18:26.421140 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.421086    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp5d4\" (UniqueName: \"kubernetes.io/projected/6ed3fec2-088a-44ef-bd86-6b991f66d2d9-kube-api-access-fp5d4\") pod \"authorino-5c7c657f66-wzq7x\" (UID: \"6ed3fec2-088a-44ef-bd86-6b991f66d2d9\") " pod="kuadrant-system/authorino-5c7c657f66-wzq7x"
Jul 08 21:18:26.484759 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.484736    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c7c657f66-wzq7x"
Jul 08 21:18:26.607946 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:26.607922    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c7c657f66-wzq7x"]
Jul 08 21:18:26.610153 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:18:26.610135    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ed3fec2_088a_44ef_bd86_6b991f66d2d9.slice/crio-ac321b4bc49ad9c27a8910f950ff8b7a018fb744ef9771e240f301361b32fe14 WatchSource:0}: Error finding container ac321b4bc49ad9c27a8910f950ff8b7a018fb744ef9771e240f301361b32fe14: Status 404 returned error can't find the container with id ac321b4bc49ad9c27a8910f950ff8b7a018fb744ef9771e240f301361b32fe14
Jul 08 21:18:27.092952 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:27.092924    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c7c657f66-wzq7x" event={"ID":"6ed3fec2-088a-44ef-bd86-6b991f66d2d9","Type":"ContainerStarted","Data":"ac321b4bc49ad9c27a8910f950ff8b7a018fb744ef9771e240f301361b32fe14"}
Jul 08 21:18:27.094500 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:27.094469    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5l7fp" event={"ID":"99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a","Type":"ContainerStarted","Data":"69d607061bedd6c42e0624d4fbc7a681fefdff5bccc82c68e764364b69b78ac4"}
Jul 08 21:18:27.094624 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:27.094514    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5l7fp" event={"ID":"99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a","Type":"ContainerStarted","Data":"d358ff6d6cefd00d217acfef0ff03461b0a1893b32068d81726bda68b5ce34d4"}
Jul 08 21:18:27.094624 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:27.094510    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-5l7fp" podUID="99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a" containerName="authorino" containerID="cri-o://69d607061bedd6c42e0624d4fbc7a681fefdff5bccc82c68e764364b69b78ac4" gracePeriod=30
Jul 08 21:18:27.109027 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:27.108985    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-5l7fp" podStartSLOduration=1.449231211 podStartE2EDuration="2.108971108s" totalImagesPullingTime="659.739897ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:18:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:18:27.108051598 +0000 UTC m=+730.201855146" watchObservedRunningTime="2026-07-08 21:18:27.108971108 +0000 UTC m=+730.202774655"
Jul 08 21:18:27.343507 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:27.343484    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5l7fp"
Jul 08 21:18:27.422673 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:27.422639    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65xwq\" (UniqueName: \"kubernetes.io/projected/99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a-kube-api-access-65xwq\") pod \"99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a\" (UID: \"99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a\") "
Jul 08 21:18:27.424760 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:27.424723    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a-kube-api-access-65xwq" (OuterVolumeSpecName: "kube-api-access-65xwq") pod "99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a" (UID: "99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a"). InnerVolumeSpecName "kube-api-access-65xwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:18:27.523323 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:27.523284    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65xwq\" (UniqueName: \"kubernetes.io/projected/99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a-kube-api-access-65xwq\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:18:28.102616 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:28.102563    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c7c657f66-wzq7x" event={"ID":"6ed3fec2-088a-44ef-bd86-6b991f66d2d9","Type":"ContainerStarted","Data":"fa6cef6a8a5a57decb4f325d3fde159ee61b4d91f81005496444a35b4b1815e6"}
Jul 08 21:18:28.104047 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:28.104018    2583 generic.go:356] "Generic (PLEG): container finished" podID="99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a" containerID="69d607061bedd6c42e0624d4fbc7a681fefdff5bccc82c68e764364b69b78ac4" exitCode=0
Jul 08 21:18:28.104186 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:28.104100    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5l7fp"
Jul 08 21:18:28.104186 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:28.104102    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5l7fp" event={"ID":"99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a","Type":"ContainerDied","Data":"69d607061bedd6c42e0624d4fbc7a681fefdff5bccc82c68e764364b69b78ac4"}
Jul 08 21:18:28.104186 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:28.104140    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5l7fp" event={"ID":"99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a","Type":"ContainerDied","Data":"d358ff6d6cefd00d217acfef0ff03461b0a1893b32068d81726bda68b5ce34d4"}
Jul 08 21:18:28.104186 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:28.104157    2583 scope.go:117] "RemoveContainer" containerID="69d607061bedd6c42e0624d4fbc7a681fefdff5bccc82c68e764364b69b78ac4"
Jul 08 21:18:28.112176 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:28.112156    2583 scope.go:117] "RemoveContainer" containerID="69d607061bedd6c42e0624d4fbc7a681fefdff5bccc82c68e764364b69b78ac4"
Jul 08 21:18:28.112423 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:18:28.112402    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69d607061bedd6c42e0624d4fbc7a681fefdff5bccc82c68e764364b69b78ac4\": container with ID starting with 69d607061bedd6c42e0624d4fbc7a681fefdff5bccc82c68e764364b69b78ac4 not found: ID does not exist" containerID="69d607061bedd6c42e0624d4fbc7a681fefdff5bccc82c68e764364b69b78ac4"
Jul 08 21:18:28.112478 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:28.112430    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d607061bedd6c42e0624d4fbc7a681fefdff5bccc82c68e764364b69b78ac4"} err="failed to get container status \"69d607061bedd6c42e0624d4fbc7a681fefdff5bccc82c68e764364b69b78ac4\": rpc error: code = NotFound desc = could not find container \"69d607061bedd6c42e0624d4fbc7a681fefdff5bccc82c68e764364b69b78ac4\": container with ID starting with 69d607061bedd6c42e0624d4fbc7a681fefdff5bccc82c68e764364b69b78ac4 not found: ID does not exist"
Jul 08 21:18:28.117846 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:28.117805    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c7c657f66-wzq7x" podStartSLOduration=1.6465361029999999 podStartE2EDuration="2.1177927s" totalImagesPullingTime="471.256597ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:18:28.115674094 +0000 UTC m=+731.209477645" watchObservedRunningTime="2026-07-08 21:18:28.1177927 +0000 UTC m=+731.211596247"
Jul 08 21:18:28.129778 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:28.129752    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5l7fp"]
Jul 08 21:18:28.136931 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:28.136910    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5l7fp"]
Jul 08 21:18:28.143478 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:28.143456    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7svmm"]
Jul 08 21:18:28.143819 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:28.143768    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7svmm" podUID="952d9b04-52f8-4154-8eb2-28724ec55d4c" containerName="authorino" containerID="cri-o://374b56d73b3949fb8ffc97cf7941e99f4fe7be4d9fc1c5e2edbb2cad7f1f48f9" gracePeriod=30
Jul 08 21:18:28.401949 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:28.401925    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7svmm"
Jul 08 21:18:28.532916 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:28.532888    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7n7t\" (UniqueName: \"kubernetes.io/projected/952d9b04-52f8-4154-8eb2-28724ec55d4c-kube-api-access-p7n7t\") pod \"952d9b04-52f8-4154-8eb2-28724ec55d4c\" (UID: \"952d9b04-52f8-4154-8eb2-28724ec55d4c\") "
Jul 08 21:18:28.534930 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:28.534900    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/952d9b04-52f8-4154-8eb2-28724ec55d4c-kube-api-access-p7n7t" (OuterVolumeSpecName: "kube-api-access-p7n7t") pod "952d9b04-52f8-4154-8eb2-28724ec55d4c" (UID: "952d9b04-52f8-4154-8eb2-28724ec55d4c"). InnerVolumeSpecName "kube-api-access-p7n7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:18:28.633467 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:28.633381    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7n7t\" (UniqueName: \"kubernetes.io/projected/952d9b04-52f8-4154-8eb2-28724ec55d4c-kube-api-access-p7n7t\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:18:29.109991 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:29.109956    2583 generic.go:356] "Generic (PLEG): container finished" podID="952d9b04-52f8-4154-8eb2-28724ec55d4c" containerID="374b56d73b3949fb8ffc97cf7941e99f4fe7be4d9fc1c5e2edbb2cad7f1f48f9" exitCode=0
Jul 08 21:18:29.110403 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:29.110011    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7svmm"
Jul 08 21:18:29.110403 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:29.110048    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7svmm" event={"ID":"952d9b04-52f8-4154-8eb2-28724ec55d4c","Type":"ContainerDied","Data":"374b56d73b3949fb8ffc97cf7941e99f4fe7be4d9fc1c5e2edbb2cad7f1f48f9"}
Jul 08 21:18:29.110403 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:29.110098    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7svmm" event={"ID":"952d9b04-52f8-4154-8eb2-28724ec55d4c","Type":"ContainerDied","Data":"82b4ee26fc99f451dc584f9bf51d7784511be559d75dda6089b0836b694c2173"}
Jul 08 21:18:29.110403 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:29.110120    2583 scope.go:117] "RemoveContainer" containerID="374b56d73b3949fb8ffc97cf7941e99f4fe7be4d9fc1c5e2edbb2cad7f1f48f9"
Jul 08 21:18:29.119094 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:29.119080    2583 scope.go:117] "RemoveContainer" containerID="374b56d73b3949fb8ffc97cf7941e99f4fe7be4d9fc1c5e2edbb2cad7f1f48f9"
Jul 08 21:18:29.119347 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:18:29.119329    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"374b56d73b3949fb8ffc97cf7941e99f4fe7be4d9fc1c5e2edbb2cad7f1f48f9\": container with ID starting with 374b56d73b3949fb8ffc97cf7941e99f4fe7be4d9fc1c5e2edbb2cad7f1f48f9 not found: ID does not exist" containerID="374b56d73b3949fb8ffc97cf7941e99f4fe7be4d9fc1c5e2edbb2cad7f1f48f9"
Jul 08 21:18:29.119391 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:29.119355    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"374b56d73b3949fb8ffc97cf7941e99f4fe7be4d9fc1c5e2edbb2cad7f1f48f9"} err="failed to get container status \"374b56d73b3949fb8ffc97cf7941e99f4fe7be4d9fc1c5e2edbb2cad7f1f48f9\": rpc error: code = NotFound desc = could not find container \"374b56d73b3949fb8ffc97cf7941e99f4fe7be4d9fc1c5e2edbb2cad7f1f48f9\": container with ID starting with 374b56d73b3949fb8ffc97cf7941e99f4fe7be4d9fc1c5e2edbb2cad7f1f48f9 not found: ID does not exist"
Jul 08 21:18:29.130421 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:29.130399    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7svmm"]
Jul 08 21:18:29.131934 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:29.131912    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7svmm"]
Jul 08 21:18:29.429377 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:29.429300    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="952d9b04-52f8-4154-8eb2-28724ec55d4c" path="/var/lib/kubelet/pods/952d9b04-52f8-4154-8eb2-28724ec55d4c/volumes"
Jul 08 21:18:29.429661 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:29.429649    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a" path="/var/lib/kubelet/pods/99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a/volumes"
Jul 08 21:18:32.613333 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.613298    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76bc7f8bb7-pppf8"]
Jul 08 21:18:32.613824 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.613596    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a" containerName="authorino"
Jul 08 21:18:32.613824 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.613607    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a" containerName="authorino"
Jul 08 21:18:32.613824 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.613623    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="952d9b04-52f8-4154-8eb2-28724ec55d4c" containerName="authorino"
Jul 08 21:18:32.613824 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.613628    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="952d9b04-52f8-4154-8eb2-28724ec55d4c" containerName="authorino"
Jul 08 21:18:32.613824 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.613682    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="99ca0aa0-05fa-4c80-b58b-286dbc2d0f9a" containerName="authorino"
Jul 08 21:18:32.613824 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.613690    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="952d9b04-52f8-4154-8eb2-28724ec55d4c" containerName="authorino"
Jul 08 21:18:32.618391 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.618371    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76bc7f8bb7-pppf8"
Jul 08 21:18:32.620907 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.620886    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 21:18:32.621031 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.620917    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 21:18:32.621031 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.620973    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6tkmp\""
Jul 08 21:18:32.624672 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.624650    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76bc7f8bb7-pppf8"]
Jul 08 21:18:32.773712 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.773679    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxgd2\" (UniqueName: \"kubernetes.io/projected/6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f-kube-api-access-qxgd2\") pod \"maas-controller-76bc7f8bb7-pppf8\" (UID: \"6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f\") " pod="opendatahub/maas-controller-76bc7f8bb7-pppf8"
Jul 08 21:18:32.773712 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.773714    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f-webhook-cert\") pod \"maas-controller-76bc7f8bb7-pppf8\" (UID: \"6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f\") " pod="opendatahub/maas-controller-76bc7f8bb7-pppf8"
Jul 08 21:18:32.787955 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.787925    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8f47cbb78-f8dgz"]
Jul 08 21:18:32.793688 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.793664    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f47cbb78-f8dgz"
Jul 08 21:18:32.800669 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.800645    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f47cbb78-f8dgz"]
Jul 08 21:18:32.874623 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.874531    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxgd2\" (UniqueName: \"kubernetes.io/projected/6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f-kube-api-access-qxgd2\") pod \"maas-controller-76bc7f8bb7-pppf8\" (UID: \"6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f\") " pod="opendatahub/maas-controller-76bc7f8bb7-pppf8"
Jul 08 21:18:32.874623 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.874568    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f-webhook-cert\") pod \"maas-controller-76bc7f8bb7-pppf8\" (UID: \"6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f\") " pod="opendatahub/maas-controller-76bc7f8bb7-pppf8"
Jul 08 21:18:32.877023 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.877003    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f-webhook-cert\") pod \"maas-controller-76bc7f8bb7-pppf8\" (UID: \"6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f\") " pod="opendatahub/maas-controller-76bc7f8bb7-pppf8"
Jul 08 21:18:32.881907 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.881871    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxgd2\" (UniqueName: \"kubernetes.io/projected/6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f-kube-api-access-qxgd2\") pod \"maas-controller-76bc7f8bb7-pppf8\" (UID: \"6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f\") " pod="opendatahub/maas-controller-76bc7f8bb7-pppf8"
Jul 08 21:18:32.929772 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.929740    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76bc7f8bb7-pppf8"
Jul 08 21:18:32.975766 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.975724    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq2zk\" (UniqueName: \"kubernetes.io/projected/1b392705-a2bd-4d60-9bed-0c6a1293b015-kube-api-access-pq2zk\") pod \"maas-controller-8f47cbb78-f8dgz\" (UID: \"1b392705-a2bd-4d60-9bed-0c6a1293b015\") " pod="opendatahub/maas-controller-8f47cbb78-f8dgz"
Jul 08 21:18:32.975937 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:32.975881    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b392705-a2bd-4d60-9bed-0c6a1293b015-webhook-cert\") pod \"maas-controller-8f47cbb78-f8dgz\" (UID: \"1b392705-a2bd-4d60-9bed-0c6a1293b015\") " pod="opendatahub/maas-controller-8f47cbb78-f8dgz"
Jul 08 21:18:33.051204 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:33.051171    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76bc7f8bb7-pppf8"]
Jul 08 21:18:33.054028 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:18:33.053998    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ccf6dfb_bcbe_4167_a62a_97bb386f0b9f.slice/crio-1330fbf8b9ddf36e7edddb2cc33e66fb712f817ff115e27b533122e84b610efc WatchSource:0}: Error finding container 1330fbf8b9ddf36e7edddb2cc33e66fb712f817ff115e27b533122e84b610efc: Status 404 returned error can't find the container with id 1330fbf8b9ddf36e7edddb2cc33e66fb712f817ff115e27b533122e84b610efc
Jul 08 21:18:33.076622 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:33.076578    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b392705-a2bd-4d60-9bed-0c6a1293b015-webhook-cert\") pod \"maas-controller-8f47cbb78-f8dgz\" (UID: \"1b392705-a2bd-4d60-9bed-0c6a1293b015\") " pod="opendatahub/maas-controller-8f47cbb78-f8dgz"
Jul 08 21:18:33.076736 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:33.076644    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq2zk\" (UniqueName: \"kubernetes.io/projected/1b392705-a2bd-4d60-9bed-0c6a1293b015-kube-api-access-pq2zk\") pod \"maas-controller-8f47cbb78-f8dgz\" (UID: \"1b392705-a2bd-4d60-9bed-0c6a1293b015\") " pod="opendatahub/maas-controller-8f47cbb78-f8dgz"
Jul 08 21:18:33.078810 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:33.078791    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b392705-a2bd-4d60-9bed-0c6a1293b015-webhook-cert\") pod \"maas-controller-8f47cbb78-f8dgz\" (UID: \"1b392705-a2bd-4d60-9bed-0c6a1293b015\") " pod="opendatahub/maas-controller-8f47cbb78-f8dgz"
Jul 08 21:18:33.083979 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:33.083955    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq2zk\" (UniqueName: \"kubernetes.io/projected/1b392705-a2bd-4d60-9bed-0c6a1293b015-kube-api-access-pq2zk\") pod \"maas-controller-8f47cbb78-f8dgz\" (UID: \"1b392705-a2bd-4d60-9bed-0c6a1293b015\") " pod="opendatahub/maas-controller-8f47cbb78-f8dgz"
Jul 08 21:18:33.103983 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:33.103962    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f47cbb78-f8dgz"
Jul 08 21:18:33.132089 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:33.132003    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76bc7f8bb7-pppf8" event={"ID":"6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f","Type":"ContainerStarted","Data":"1330fbf8b9ddf36e7edddb2cc33e66fb712f817ff115e27b533122e84b610efc"}
Jul 08 21:18:33.229413 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:33.229378    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f47cbb78-f8dgz"]
Jul 08 21:18:33.231884 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:18:33.231857    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b392705_a2bd_4d60_9bed_0c6a1293b015.slice/crio-a8b7a99edc7c804e2c6430471160fd228f3b766a993bfa2aa9cf3c5c20803667 WatchSource:0}: Error finding container a8b7a99edc7c804e2c6430471160fd228f3b766a993bfa2aa9cf3c5c20803667: Status 404 returned error can't find the container with id a8b7a99edc7c804e2c6430471160fd228f3b766a993bfa2aa9cf3c5c20803667
Jul 08 21:18:34.141291 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:34.141216    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f47cbb78-f8dgz" event={"ID":"1b392705-a2bd-4d60-9bed-0c6a1293b015","Type":"ContainerStarted","Data":"a8b7a99edc7c804e2c6430471160fd228f3b766a993bfa2aa9cf3c5c20803667"}
Jul 08 21:18:36.154956 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:36.154910    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76bc7f8bb7-pppf8" event={"ID":"6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f","Type":"ContainerStarted","Data":"792b890ab9fe348ea539aa730894b65ae98dd761f13c5bf2eead382d08610de3"}
Jul 08 21:18:36.155405 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:36.155033    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76bc7f8bb7-pppf8"
Jul 08 21:18:36.156751 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:36.156724    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f47cbb78-f8dgz" event={"ID":"1b392705-a2bd-4d60-9bed-0c6a1293b015","Type":"ContainerStarted","Data":"639d3d2df20511dd6eb230dcb497b9f71466eccdbf6c73e3e78e965bf5c37ebd"}
Jul 08 21:18:36.156879 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:36.156838    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8f47cbb78-f8dgz"
Jul 08 21:18:36.178489 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:36.178441    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76bc7f8bb7-pppf8" podStartSLOduration=1.979012955 podStartE2EDuration="4.178424995s" totalImagesPullingTime="2.19941204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:18:36.173132399 +0000 UTC m=+739.266935968" watchObservedRunningTime="2026-07-08 21:18:36.178424995 +0000 UTC m=+739.272228541"
Jul 08 21:18:36.192179 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:36.192135    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8f47cbb78-f8dgz" podStartSLOduration=2.159442758 podStartE2EDuration="4.192121238s" totalImagesPullingTime="2.03267848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:18:36.19053126 +0000 UTC m=+739.284334807" watchObservedRunningTime="2026-07-08 21:18:36.192121238 +0000 UTC m=+739.285924784"
Jul 08 21:18:47.166256 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:47.166226    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8f47cbb78-f8dgz"
Jul 08 21:18:47.166696 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:47.166437    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76bc7f8bb7-pppf8"
Jul 08 21:18:47.205083 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:47.205044    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76bc7f8bb7-pppf8"]
Jul 08 21:18:47.206506 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:47.206473    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-76bc7f8bb7-pppf8" podUID="6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f" containerName="manager" containerID="cri-o://792b890ab9fe348ea539aa730894b65ae98dd761f13c5bf2eead382d08610de3" gracePeriod=30
Jul 08 21:18:47.446828 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:47.446804    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76bc7f8bb7-pppf8"
Jul 08 21:18:47.482049 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:47.482029    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxgd2\" (UniqueName: \"kubernetes.io/projected/6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f-kube-api-access-qxgd2\") pod \"6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f\" (UID: \"6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f\") "
Jul 08 21:18:47.482177 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:47.482066    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f-webhook-cert\") pod \"6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f\" (UID: \"6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f\") "
Jul 08 21:18:47.484160 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:47.484132    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f-kube-api-access-qxgd2" (OuterVolumeSpecName: "kube-api-access-qxgd2") pod "6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f" (UID: "6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f"). InnerVolumeSpecName "kube-api-access-qxgd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:18:47.484254 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:47.484159    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f" (UID: "6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:18:47.582927 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:47.582901    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxgd2\" (UniqueName: \"kubernetes.io/projected/6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f-kube-api-access-qxgd2\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:18:47.582927 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:47.582923    2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f-webhook-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:18:48.211980 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:48.211945    2583 generic.go:356] "Generic (PLEG): container finished" podID="6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f" containerID="792b890ab9fe348ea539aa730894b65ae98dd761f13c5bf2eead382d08610de3" exitCode=0
Jul 08 21:18:48.212379 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:48.211988    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76bc7f8bb7-pppf8"
Jul 08 21:18:48.212379 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:48.212025    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76bc7f8bb7-pppf8" event={"ID":"6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f","Type":"ContainerDied","Data":"792b890ab9fe348ea539aa730894b65ae98dd761f13c5bf2eead382d08610de3"}
Jul 08 21:18:48.212379 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:48.212074    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76bc7f8bb7-pppf8" event={"ID":"6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f","Type":"ContainerDied","Data":"1330fbf8b9ddf36e7edddb2cc33e66fb712f817ff115e27b533122e84b610efc"}
Jul 08 21:18:48.212379 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:48.212095    2583 scope.go:117] "RemoveContainer" containerID="792b890ab9fe348ea539aa730894b65ae98dd761f13c5bf2eead382d08610de3"
Jul 08 21:18:48.221050 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:48.221035    2583 scope.go:117] "RemoveContainer" containerID="792b890ab9fe348ea539aa730894b65ae98dd761f13c5bf2eead382d08610de3"
Jul 08 21:18:48.221307 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:18:48.221289    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"792b890ab9fe348ea539aa730894b65ae98dd761f13c5bf2eead382d08610de3\": container with ID starting with 792b890ab9fe348ea539aa730894b65ae98dd761f13c5bf2eead382d08610de3 not found: ID does not exist" containerID="792b890ab9fe348ea539aa730894b65ae98dd761f13c5bf2eead382d08610de3"
Jul 08 21:18:48.221349 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:48.221316    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"792b890ab9fe348ea539aa730894b65ae98dd761f13c5bf2eead382d08610de3"} err="failed to get container status \"792b890ab9fe348ea539aa730894b65ae98dd761f13c5bf2eead382d08610de3\": rpc error: code = NotFound desc = could not find container \"792b890ab9fe348ea539aa730894b65ae98dd761f13c5bf2eead382d08610de3\": container with ID starting with 792b890ab9fe348ea539aa730894b65ae98dd761f13c5bf2eead382d08610de3 not found: ID does not exist"
Jul 08 21:18:48.232186 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:48.232164    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76bc7f8bb7-pppf8"]
Jul 08 21:18:48.234047 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:48.234023    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76bc7f8bb7-pppf8"]
Jul 08 21:18:49.434027 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:18:49.433994    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f" path="/var/lib/kubelet/pods/6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f/volumes"
Jul 08 21:19:07.431686 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.431656    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk"]
Jul 08 21:19:07.432138 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.431925    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f" containerName="manager"
Jul 08 21:19:07.432138 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.431934    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f" containerName="manager"
Jul 08 21:19:07.432138 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.431979    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ccf6dfb-bcbe-4167-a62a-97bb386f0b9f" containerName="manager"
Jul 08 21:19:07.437594 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.437568    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk"
Jul 08 21:19:07.440304 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.440277    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 08 21:19:07.440304 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.440286    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4j6cj\""
Jul 08 21:19:07.441375 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.441355    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 21:19:07.441375 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.441373    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 21:19:07.446421 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.446400    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk"]
Jul 08 21:19:07.538371 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.538346    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39f6c906-56e1-48bc-90af-772e5c7f2010-openshift-service-ca\") pod \"maas-api-78c8d5bc6b-8bbtk\" (UID: \"39f6c906-56e1-48bc-90af-772e5c7f2010\") " pod="odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk"
Jul 08 21:19:07.538549 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.538399    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgfrj\" (UniqueName: \"kubernetes.io/projected/39f6c906-56e1-48bc-90af-772e5c7f2010-kube-api-access-xgfrj\") pod \"maas-api-78c8d5bc6b-8bbtk\" (UID: \"39f6c906-56e1-48bc-90af-772e5c7f2010\") " pod="odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk"
Jul 08 21:19:07.538549 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.538434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39f6c906-56e1-48bc-90af-772e5c7f2010-maas-api-tls\") pod \"maas-api-78c8d5bc6b-8bbtk\" (UID: \"39f6c906-56e1-48bc-90af-772e5c7f2010\") " pod="odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk"
Jul 08 21:19:07.639904 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.639867    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgfrj\" (UniqueName: \"kubernetes.io/projected/39f6c906-56e1-48bc-90af-772e5c7f2010-kube-api-access-xgfrj\") pod \"maas-api-78c8d5bc6b-8bbtk\" (UID: \"39f6c906-56e1-48bc-90af-772e5c7f2010\") " pod="odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk"
Jul 08 21:19:07.640085 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.639989    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39f6c906-56e1-48bc-90af-772e5c7f2010-maas-api-tls\") pod \"maas-api-78c8d5bc6b-8bbtk\" (UID: \"39f6c906-56e1-48bc-90af-772e5c7f2010\") " pod="odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk"
Jul 08 21:19:07.640085 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.640070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39f6c906-56e1-48bc-90af-772e5c7f2010-openshift-service-ca\") pod \"maas-api-78c8d5bc6b-8bbtk\" (UID: \"39f6c906-56e1-48bc-90af-772e5c7f2010\") " pod="odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk"
Jul 08 21:19:07.640885 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.640861    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39f6c906-56e1-48bc-90af-772e5c7f2010-openshift-service-ca\") pod \"maas-api-78c8d5bc6b-8bbtk\" (UID: \"39f6c906-56e1-48bc-90af-772e5c7f2010\") " pod="odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk"
Jul 08 21:19:07.642833 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.642814    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39f6c906-56e1-48bc-90af-772e5c7f2010-maas-api-tls\") pod \"maas-api-78c8d5bc6b-8bbtk\" (UID: \"39f6c906-56e1-48bc-90af-772e5c7f2010\") " pod="odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk"
Jul 08 21:19:07.647096 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.647073    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgfrj\" (UniqueName: \"kubernetes.io/projected/39f6c906-56e1-48bc-90af-772e5c7f2010-kube-api-access-xgfrj\") pod \"maas-api-78c8d5bc6b-8bbtk\" (UID: \"39f6c906-56e1-48bc-90af-772e5c7f2010\") " pod="odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk"
Jul 08 21:19:07.748970 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.748877    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk"
Jul 08 21:19:07.886533 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.886508    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk"]
Jul 08 21:19:07.888711 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.888688    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-p54vb"]
Jul 08 21:19:07.889656 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:19:07.889625    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f6c906_56e1_48bc_90af_772e5c7f2010.slice/crio-2316d886426684766b6a2a173698190d050d2f45a0615144f5b073b1968addbf WatchSource:0}: Error finding container 2316d886426684766b6a2a173698190d050d2f45a0615144f5b073b1968addbf: Status 404 returned error can't find the container with id 2316d886426684766b6a2a173698190d050d2f45a0615144f5b073b1968addbf
Jul 08 21:19:07.891104 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.891084    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:19:07.894105 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.894085    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-p54vb"
Jul 08 21:19:07.896436 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.896416    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 08 21:19:07.896564 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.896547    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6fkf6\""
Jul 08 21:19:07.902482 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.902460    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-p54vb"]
Jul 08 21:19:07.908626 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.908606    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-sx6dk"]
Jul 08 21:19:07.912251 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.912237    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-sx6dk"
Jul 08 21:19:07.925903 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.925879    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-sx6dk"]
Jul 08 21:19:07.942301 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.942272    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2gdm\" (UniqueName: \"kubernetes.io/projected/ca970978-6b0f-46c4-a17e-d65d81b74838-kube-api-access-l2gdm\") pod \"payload-pre-processing-7964457696-p54vb\" (UID: \"ca970978-6b0f-46c4-a17e-d65d81b74838\") " pod="openshift-ingress/payload-pre-processing-7964457696-p54vb"
Jul 08 21:19:07.942448 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:07.942326    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca970978-6b0f-46c4-a17e-d65d81b74838-plugins-config-volume\") pod \"payload-pre-processing-7964457696-p54vb\" (UID: \"ca970978-6b0f-46c4-a17e-d65d81b74838\") " pod="openshift-ingress/payload-pre-processing-7964457696-p54vb"
Jul 08 21:19:08.043309 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:08.043278    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca970978-6b0f-46c4-a17e-d65d81b74838-plugins-config-volume\") pod \"payload-pre-processing-7964457696-p54vb\" (UID: \"ca970978-6b0f-46c4-a17e-d65d81b74838\") " pod="openshift-ingress/payload-pre-processing-7964457696-p54vb"
Jul 08 21:19:08.043493 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:08.043386    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j8f5\" (UniqueName: \"kubernetes.io/projected/c75416fc-7533-43b7-865b-42931c4fd865-kube-api-access-8j8f5\") pod \"payload-processing-58f86c7798-sx6dk\" (UID: \"c75416fc-7533-43b7-865b-42931c4fd865\") " pod="openshift-ingress/payload-processing-58f86c7798-sx6dk"
Jul 08 21:19:08.043493 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:08.043420    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2gdm\" (UniqueName: \"kubernetes.io/projected/ca970978-6b0f-46c4-a17e-d65d81b74838-kube-api-access-l2gdm\") pod \"payload-pre-processing-7964457696-p54vb\" (UID: \"ca970978-6b0f-46c4-a17e-d65d81b74838\") " pod="openshift-ingress/payload-pre-processing-7964457696-p54vb"
Jul 08 21:19:08.043493 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:08.043445    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c75416fc-7533-43b7-865b-42931c4fd865-plugins-config-volume\") pod \"payload-processing-58f86c7798-sx6dk\" (UID: \"c75416fc-7533-43b7-865b-42931c4fd865\") " pod="openshift-ingress/payload-processing-58f86c7798-sx6dk"
Jul 08 21:19:08.044113 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:08.044093    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca970978-6b0f-46c4-a17e-d65d81b74838-plugins-config-volume\") pod \"payload-pre-processing-7964457696-p54vb\" (UID: \"ca970978-6b0f-46c4-a17e-d65d81b74838\") " pod="openshift-ingress/payload-pre-processing-7964457696-p54vb"
Jul 08 21:19:08.052682 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:08.052661    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2gdm\" (UniqueName: \"kubernetes.io/projected/ca970978-6b0f-46c4-a17e-d65d81b74838-kube-api-access-l2gdm\") pod \"payload-pre-processing-7964457696-p54vb\" (UID: \"ca970978-6b0f-46c4-a17e-d65d81b74838\") " pod="openshift-ingress/payload-pre-processing-7964457696-p54vb"
Jul 08 21:19:08.144739 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:08.144710    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j8f5\" (UniqueName: \"kubernetes.io/projected/c75416fc-7533-43b7-865b-42931c4fd865-kube-api-access-8j8f5\") pod \"payload-processing-58f86c7798-sx6dk\" (UID: \"c75416fc-7533-43b7-865b-42931c4fd865\") " pod="openshift-ingress/payload-processing-58f86c7798-sx6dk"
Jul 08 21:19:08.144739 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:08.144743    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c75416fc-7533-43b7-865b-42931c4fd865-plugins-config-volume\") pod \"payload-processing-58f86c7798-sx6dk\" (UID: \"c75416fc-7533-43b7-865b-42931c4fd865\") " pod="openshift-ingress/payload-processing-58f86c7798-sx6dk"
Jul 08 21:19:08.145405 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:08.145386    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c75416fc-7533-43b7-865b-42931c4fd865-plugins-config-volume\") pod \"payload-processing-58f86c7798-sx6dk\" (UID: \"c75416fc-7533-43b7-865b-42931c4fd865\") " pod="openshift-ingress/payload-processing-58f86c7798-sx6dk"
Jul 08 21:19:08.154333 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:08.154306    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j8f5\" (UniqueName: \"kubernetes.io/projected/c75416fc-7533-43b7-865b-42931c4fd865-kube-api-access-8j8f5\") pod \"payload-processing-58f86c7798-sx6dk\" (UID: \"c75416fc-7533-43b7-865b-42931c4fd865\") " pod="openshift-ingress/payload-processing-58f86c7798-sx6dk"
Jul 08 21:19:08.206178 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:08.206154    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-p54vb"
Jul 08 21:19:08.222189 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:08.222169    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-sx6dk"
Jul 08 21:19:08.299018 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:08.298762    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk" event={"ID":"39f6c906-56e1-48bc-90af-772e5c7f2010","Type":"ContainerStarted","Data":"2316d886426684766b6a2a173698190d050d2f45a0615144f5b073b1968addbf"}
Jul 08 21:19:08.347851 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:08.347822    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-p54vb"]
Jul 08 21:19:08.349358 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:19:08.349331    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca970978_6b0f_46c4_a17e_d65d81b74838.slice/crio-b05f5b45a9f91766e1678b9464c2c27f66801a4b20d5a97d67d578907831253e WatchSource:0}: Error finding container b05f5b45a9f91766e1678b9464c2c27f66801a4b20d5a97d67d578907831253e: Status 404 returned error can't find the container with id b05f5b45a9f91766e1678b9464c2c27f66801a4b20d5a97d67d578907831253e
Jul 08 21:19:08.368952 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:08.368931    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-sx6dk"]
Jul 08 21:19:08.371308 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:19:08.371285    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75416fc_7533_43b7_865b_42931c4fd865.slice/crio-41a3cf784c4db7d17df4ed519052c6abc44962072ec9dac510b60b27f39f64fb WatchSource:0}: Error finding container 41a3cf784c4db7d17df4ed519052c6abc44962072ec9dac510b60b27f39f64fb: Status 404 returned error can't find the container with id 41a3cf784c4db7d17df4ed519052c6abc44962072ec9dac510b60b27f39f64fb
Jul 08 21:19:09.305148 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:09.305105    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-sx6dk" event={"ID":"c75416fc-7533-43b7-865b-42931c4fd865","Type":"ContainerStarted","Data":"41a3cf784c4db7d17df4ed519052c6abc44962072ec9dac510b60b27f39f64fb"}
Jul 08 21:19:09.306413 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:09.306381    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-p54vb" event={"ID":"ca970978-6b0f-46c4-a17e-d65d81b74838","Type":"ContainerStarted","Data":"b05f5b45a9f91766e1678b9464c2c27f66801a4b20d5a97d67d578907831253e"}
Jul 08 21:19:10.312440 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:10.312409    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-p54vb" event={"ID":"ca970978-6b0f-46c4-a17e-d65d81b74838","Type":"ContainerStarted","Data":"9a1bff717a614469f7834443c5bbd2734ffb01f9a822dfcc562026218b1c7f0a"}
Jul 08 21:19:10.312859 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:10.312527    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-p54vb"
Jul 08 21:19:10.314049 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:10.314026    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk" event={"ID":"39f6c906-56e1-48bc-90af-772e5c7f2010","Type":"ContainerStarted","Data":"f0c8c9445749c578828398fbeaab61817ef1cc69fbcd71f187589137759b6080"}
Jul 08 21:19:10.314180 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:10.314071    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk"
Jul 08 21:19:10.315677 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:10.315654    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-sx6dk" event={"ID":"c75416fc-7533-43b7-865b-42931c4fd865","Type":"ContainerStarted","Data":"d5e02f39cd7794e999e72fb2bda1d2fcae3d74686c5ba23ad199ac3d73ab609a"}
Jul 08 21:19:10.315791 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:10.315706    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-sx6dk"
Jul 08 21:19:10.327579 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:10.327540    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-p54vb" podStartSLOduration=1.459274913 podStartE2EDuration="3.327527922s" totalImagesPullingTime="1.868253009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:19:10.325491407 +0000 UTC m=+773.419294973" watchObservedRunningTime="2026-07-08 21:19:10.327527922 +0000 UTC m=+773.421331480"
Jul 08 21:19:10.340943 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:10.340897    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk" podStartSLOduration=1.011735407 podStartE2EDuration="3.340883721s" totalImagesPullingTime="2.329148314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:19:10.339093176 +0000 UTC m=+773.432896737" watchObservedRunningTime="2026-07-08 21:19:10.340883721 +0000 UTC m=+773.434687269"
Jul 08 21:19:10.354691 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:10.354644    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-sx6dk" podStartSLOduration=1.5051582479999999 podStartE2EDuration="3.354630919s" totalImagesPullingTime="1.849472671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:19:10.352020946 +0000 UTC m=+773.445824495" watchObservedRunningTime="2026-07-08 21:19:10.354630919 +0000 UTC m=+773.448434466"
Jul 08 21:19:16.326428 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:16.326399    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-78c8d5bc6b-8bbtk"
Jul 08 21:19:21.323384 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:21.323339    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7964457696-p54vb" podUID="ca970978-6b0f-46c4-a17e-d65d81b74838" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.30:9004: connect: connection refused"
Jul 08 21:19:21.323849 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:21.323635    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-sx6dk"
Jul 08 21:19:31.321603 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:19:31.321554    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-p54vb"
Jul 08 21:20:01.609847 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.609767    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"]
Jul 08 21:20:01.612512 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.612493    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.615308 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.615280    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 21:20:01.616303 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.616285    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2tfz7\""
Jul 08 21:20:01.616575 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.616556    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 21:20:01.616575 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.616570    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 08 21:20:01.626346 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.626313    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"]
Jul 08 21:20:01.680958 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.680924    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58bf86f2-6303-4811-9165-5604547223fe-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.681131 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.680975    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58bf86f2-6303-4811-9165-5604547223fe-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.681131 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.681058    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58bf86f2-6303-4811-9165-5604547223fe-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.681131 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.681088    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58bf86f2-6303-4811-9165-5604547223fe-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.681131 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.681114    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58bf86f2-6303-4811-9165-5604547223fe-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.681304 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.681203    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8n79\" (UniqueName: \"kubernetes.io/projected/58bf86f2-6303-4811-9165-5604547223fe-kube-api-access-p8n79\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.782015 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.781973    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58bf86f2-6303-4811-9165-5604547223fe-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.782015 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.782019    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58bf86f2-6303-4811-9165-5604547223fe-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.782284 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.782051    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58bf86f2-6303-4811-9165-5604547223fe-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.782284 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.782130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8n79\" (UniqueName: \"kubernetes.io/projected/58bf86f2-6303-4811-9165-5604547223fe-kube-api-access-p8n79\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.782284 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.782160    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58bf86f2-6303-4811-9165-5604547223fe-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.782284 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.782190    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58bf86f2-6303-4811-9165-5604547223fe-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.782498 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.782415    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58bf86f2-6303-4811-9165-5604547223fe-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.782498 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.782454    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58bf86f2-6303-4811-9165-5604547223fe-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.782616 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.782508    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58bf86f2-6303-4811-9165-5604547223fe-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.784329 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.784300    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58bf86f2-6303-4811-9165-5604547223fe-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.784502 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.784482    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58bf86f2-6303-4811-9165-5604547223fe-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.789919 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.789899    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8n79\" (UniqueName: \"kubernetes.io/projected/58bf86f2-6303-4811-9165-5604547223fe-kube-api-access-p8n79\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn\" (UID: \"58bf86f2-6303-4811-9165-5604547223fe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:01.922553 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:01.922462    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:02.064655 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:02.064631    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"]
Jul 08 21:20:02.067263 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:20:02.067236    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58bf86f2_6303_4811_9165_5604547223fe.slice/crio-69328606dc3ae2f622f2f93f7beae129025e1edbe873d2d2625f1f67fc041dcc WatchSource:0}: Error finding container 69328606dc3ae2f622f2f93f7beae129025e1edbe873d2d2625f1f67fc041dcc: Status 404 returned error can't find the container with id 69328606dc3ae2f622f2f93f7beae129025e1edbe873d2d2625f1f67fc041dcc
Jul 08 21:20:02.553327 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:02.553285    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn" event={"ID":"58bf86f2-6303-4811-9165-5604547223fe","Type":"ContainerStarted","Data":"69328606dc3ae2f622f2f93f7beae129025e1edbe873d2d2625f1f67fc041dcc"}
Jul 08 21:20:03.559120 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:03.559073    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn" event={"ID":"58bf86f2-6303-4811-9165-5604547223fe","Type":"ContainerStarted","Data":"0323f5f5f80c1ac5b8a6fdab6deb7e5b5a6b29945e04dc9ec98becf7db964038"}
Jul 08 21:20:03.576341 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:03.576285    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn" podStartSLOduration=1.43214985 podStartE2EDuration="2.576265999s" totalImagesPullingTime="1.144116149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:20:03.575580543 +0000 UTC m=+826.669384090" watchObservedRunningTime="2026-07-08 21:20:03.576265999 +0000 UTC m=+826.670069547"
Jul 08 21:20:07.411896 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.411862    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"]
Jul 08 21:20:07.415269 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.415246    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.417669 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.417646    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 08 21:20:07.424627 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.424604    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"]
Jul 08 21:20:07.534021 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.533986    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b30eec96-da4f-48ea-9771-558a5994498c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.534199 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.534030    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b30eec96-da4f-48ea-9771-558a5994498c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.534199 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.534058    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b30eec96-da4f-48ea-9771-558a5994498c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.534199 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.534125    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b30eec96-da4f-48ea-9771-558a5994498c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.534199 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.534193    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b30eec96-da4f-48ea-9771-558a5994498c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.534359 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.534241    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctmkj\" (UniqueName: \"kubernetes.io/projected/b30eec96-da4f-48ea-9771-558a5994498c-kube-api-access-ctmkj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.634899 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.634863    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b30eec96-da4f-48ea-9771-558a5994498c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.635088 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.634924    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctmkj\" (UniqueName: \"kubernetes.io/projected/b30eec96-da4f-48ea-9771-558a5994498c-kube-api-access-ctmkj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.635088 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.634956    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b30eec96-da4f-48ea-9771-558a5994498c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.635088 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.634988    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b30eec96-da4f-48ea-9771-558a5994498c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.635088 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.635013    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b30eec96-da4f-48ea-9771-558a5994498c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.635088 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.635054    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b30eec96-da4f-48ea-9771-558a5994498c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.635411 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.635387    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b30eec96-da4f-48ea-9771-558a5994498c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.635495 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.635445    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b30eec96-da4f-48ea-9771-558a5994498c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.635495 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.635470    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b30eec96-da4f-48ea-9771-558a5994498c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.637136 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.637113    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b30eec96-da4f-48ea-9771-558a5994498c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.637472 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.637451    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b30eec96-da4f-48ea-9771-558a5994498c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.641836 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.641813    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctmkj\" (UniqueName: \"kubernetes.io/projected/b30eec96-da4f-48ea-9771-558a5994498c-kube-api-access-ctmkj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dcrv9\" (UID: \"b30eec96-da4f-48ea-9771-558a5994498c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.725911 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.725824    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:07.854712 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:07.854686    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"]
Jul 08 21:20:07.856775 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:20:07.856749    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb30eec96_da4f_48ea_9771_558a5994498c.slice/crio-2de47d63598ebe34f5a28bae025ed39ea7411c800f21c1c34442bfe64be69349 WatchSource:0}: Error finding container 2de47d63598ebe34f5a28bae025ed39ea7411c800f21c1c34442bfe64be69349: Status 404 returned error can't find the container with id 2de47d63598ebe34f5a28bae025ed39ea7411c800f21c1c34442bfe64be69349
Jul 08 21:20:08.582052 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:08.582014    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9" event={"ID":"b30eec96-da4f-48ea-9771-558a5994498c","Type":"ContainerStarted","Data":"be21a0c2b4d0ea14b7876191bd3791fa55e148ac8c539e6683af1cc86e76ece8"}
Jul 08 21:20:08.582460 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:08.582063    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9" event={"ID":"b30eec96-da4f-48ea-9771-558a5994498c","Type":"ContainerStarted","Data":"2de47d63598ebe34f5a28bae025ed39ea7411c800f21c1c34442bfe64be69349"}
Jul 08 21:20:08.597734 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:08.597680    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9" podStartSLOduration=1.388175508 podStartE2EDuration="1.597661825s" totalImagesPullingTime="209.486317ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:20:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:20:08.597238644 +0000 UTC m=+831.691042199" watchObservedRunningTime="2026-07-08 21:20:08.597661825 +0000 UTC m=+831.691465373"
Jul 08 21:20:11.923390 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:11.923352    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:11.923886 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:11.923437    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:11.935601 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:11.935564    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:12.611548 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:12.611516    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn"
Jul 08 21:20:17.726826 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:17.726790    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:17.727205 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:17.726852    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:17.739219 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:17.739196    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:20:18.641498 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:20:18.641471    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dcrv9"
Jul 08 21:21:12.769675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:12.769644    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c7c657f66-wzq7x"]
Jul 08 21:21:12.770201 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:12.769822    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5c7c657f66-wzq7x" podUID="6ed3fec2-088a-44ef-bd86-6b991f66d2d9" containerName="authorino" containerID="cri-o://fa6cef6a8a5a57decb4f325d3fde159ee61b4d91f81005496444a35b4b1815e6" gracePeriod=30
Jul 08 21:21:13.003931 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:13.003908    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c7c657f66-wzq7x"
Jul 08 21:21:13.076978 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:13.076953    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp5d4\" (UniqueName: \"kubernetes.io/projected/6ed3fec2-088a-44ef-bd86-6b991f66d2d9-kube-api-access-fp5d4\") pod \"6ed3fec2-088a-44ef-bd86-6b991f66d2d9\" (UID: \"6ed3fec2-088a-44ef-bd86-6b991f66d2d9\") "
Jul 08 21:21:13.077150 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:13.077025    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6ed3fec2-088a-44ef-bd86-6b991f66d2d9-tls-cert\") pod \"6ed3fec2-088a-44ef-bd86-6b991f66d2d9\" (UID: \"6ed3fec2-088a-44ef-bd86-6b991f66d2d9\") "
Jul 08 21:21:13.078995 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:13.078967    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ed3fec2-088a-44ef-bd86-6b991f66d2d9-kube-api-access-fp5d4" (OuterVolumeSpecName: "kube-api-access-fp5d4") pod "6ed3fec2-088a-44ef-bd86-6b991f66d2d9" (UID: "6ed3fec2-088a-44ef-bd86-6b991f66d2d9"). InnerVolumeSpecName "kube-api-access-fp5d4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:21:13.086502 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:13.086473    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed3fec2-088a-44ef-bd86-6b991f66d2d9-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6ed3fec2-088a-44ef-bd86-6b991f66d2d9" (UID: "6ed3fec2-088a-44ef-bd86-6b991f66d2d9"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:21:13.178462 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:13.178422    2583 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6ed3fec2-088a-44ef-bd86-6b991f66d2d9-tls-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:21:13.178462 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:13.178455    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp5d4\" (UniqueName: \"kubernetes.io/projected/6ed3fec2-088a-44ef-bd86-6b991f66d2d9-kube-api-access-fp5d4\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:21:13.884512 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:13.884480    2583 generic.go:356] "Generic (PLEG): container finished" podID="6ed3fec2-088a-44ef-bd86-6b991f66d2d9" containerID="fa6cef6a8a5a57decb4f325d3fde159ee61b4d91f81005496444a35b4b1815e6" exitCode=0
Jul 08 21:21:13.885095 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:13.884525    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c7c657f66-wzq7x"
Jul 08 21:21:13.885095 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:13.884574    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c7c657f66-wzq7x" event={"ID":"6ed3fec2-088a-44ef-bd86-6b991f66d2d9","Type":"ContainerDied","Data":"fa6cef6a8a5a57decb4f325d3fde159ee61b4d91f81005496444a35b4b1815e6"}
Jul 08 21:21:13.885095 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:13.884635    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c7c657f66-wzq7x" event={"ID":"6ed3fec2-088a-44ef-bd86-6b991f66d2d9","Type":"ContainerDied","Data":"ac321b4bc49ad9c27a8910f950ff8b7a018fb744ef9771e240f301361b32fe14"}
Jul 08 21:21:13.885095 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:13.884659    2583 scope.go:117] "RemoveContainer" containerID="fa6cef6a8a5a57decb4f325d3fde159ee61b4d91f81005496444a35b4b1815e6"
Jul 08 21:21:13.893190 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:13.893171    2583 scope.go:117] "RemoveContainer" containerID="fa6cef6a8a5a57decb4f325d3fde159ee61b4d91f81005496444a35b4b1815e6"
Jul 08 21:21:13.893444 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:21:13.893423    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa6cef6a8a5a57decb4f325d3fde159ee61b4d91f81005496444a35b4b1815e6\": container with ID starting with fa6cef6a8a5a57decb4f325d3fde159ee61b4d91f81005496444a35b4b1815e6 not found: ID does not exist" containerID="fa6cef6a8a5a57decb4f325d3fde159ee61b4d91f81005496444a35b4b1815e6"
Jul 08 21:21:13.893493 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:13.893454    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa6cef6a8a5a57decb4f325d3fde159ee61b4d91f81005496444a35b4b1815e6"} err="failed to get container status \"fa6cef6a8a5a57decb4f325d3fde159ee61b4d91f81005496444a35b4b1815e6\": rpc error: code = NotFound desc = could not find container \"fa6cef6a8a5a57decb4f325d3fde159ee61b4d91f81005496444a35b4b1815e6\": container with ID starting with fa6cef6a8a5a57decb4f325d3fde159ee61b4d91f81005496444a35b4b1815e6 not found: ID does not exist"
Jul 08 21:21:13.900120 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:13.900099    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c7c657f66-wzq7x"]
Jul 08 21:21:13.903362 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:13.903345    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c7c657f66-wzq7x"]
Jul 08 21:21:15.429248 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:21:15.429218    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ed3fec2-088a-44ef-bd86-6b991f66d2d9" path="/var/lib/kubelet/pods/6ed3fec2-088a-44ef-bd86-6b991f66d2d9/volumes"
Jul 08 21:22:26.680409 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:26.680378    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8f47cbb78-f8dgz"]
Jul 08 21:22:26.682807 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:26.680602    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-8f47cbb78-f8dgz" podUID="1b392705-a2bd-4d60-9bed-0c6a1293b015" containerName="manager" containerID="cri-o://639d3d2df20511dd6eb230dcb497b9f71466eccdbf6c73e3e78e965bf5c37ebd" gracePeriod=30
Jul 08 21:22:26.926239 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:26.926215    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f47cbb78-f8dgz"
Jul 08 21:22:27.101071 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:27.101037    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq2zk\" (UniqueName: \"kubernetes.io/projected/1b392705-a2bd-4d60-9bed-0c6a1293b015-kube-api-access-pq2zk\") pod \"1b392705-a2bd-4d60-9bed-0c6a1293b015\" (UID: \"1b392705-a2bd-4d60-9bed-0c6a1293b015\") "
Jul 08 21:22:27.101250 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:27.101116    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b392705-a2bd-4d60-9bed-0c6a1293b015-webhook-cert\") pod \"1b392705-a2bd-4d60-9bed-0c6a1293b015\" (UID: \"1b392705-a2bd-4d60-9bed-0c6a1293b015\") "
Jul 08 21:22:27.103115 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:27.103078    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b392705-a2bd-4d60-9bed-0c6a1293b015-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1b392705-a2bd-4d60-9bed-0c6a1293b015" (UID: "1b392705-a2bd-4d60-9bed-0c6a1293b015"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:22:27.103234 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:27.103114    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b392705-a2bd-4d60-9bed-0c6a1293b015-kube-api-access-pq2zk" (OuterVolumeSpecName: "kube-api-access-pq2zk") pod "1b392705-a2bd-4d60-9bed-0c6a1293b015" (UID: "1b392705-a2bd-4d60-9bed-0c6a1293b015"). InnerVolumeSpecName "kube-api-access-pq2zk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:22:27.202445 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:27.202408    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq2zk\" (UniqueName: \"kubernetes.io/projected/1b392705-a2bd-4d60-9bed-0c6a1293b015-kube-api-access-pq2zk\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:22:27.202445 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:27.202439    2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b392705-a2bd-4d60-9bed-0c6a1293b015-webhook-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:22:27.216633 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:27.216602    2583 generic.go:356] "Generic (PLEG): container finished" podID="1b392705-a2bd-4d60-9bed-0c6a1293b015" containerID="639d3d2df20511dd6eb230dcb497b9f71466eccdbf6c73e3e78e965bf5c37ebd" exitCode=0
Jul 08 21:22:27.216768 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:27.216651    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f47cbb78-f8dgz"
Jul 08 21:22:27.216768 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:27.216697    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f47cbb78-f8dgz" event={"ID":"1b392705-a2bd-4d60-9bed-0c6a1293b015","Type":"ContainerDied","Data":"639d3d2df20511dd6eb230dcb497b9f71466eccdbf6c73e3e78e965bf5c37ebd"}
Jul 08 21:22:27.216768 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:27.216755    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f47cbb78-f8dgz" event={"ID":"1b392705-a2bd-4d60-9bed-0c6a1293b015","Type":"ContainerDied","Data":"a8b7a99edc7c804e2c6430471160fd228f3b766a993bfa2aa9cf3c5c20803667"}
Jul 08 21:22:27.216946 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:27.216788    2583 scope.go:117] "RemoveContainer" containerID="639d3d2df20511dd6eb230dcb497b9f71466eccdbf6c73e3e78e965bf5c37ebd"
Jul 08 21:22:27.225816 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:27.225800    2583 scope.go:117] "RemoveContainer" containerID="639d3d2df20511dd6eb230dcb497b9f71466eccdbf6c73e3e78e965bf5c37ebd"
Jul 08 21:22:27.226102 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:22:27.226073    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"639d3d2df20511dd6eb230dcb497b9f71466eccdbf6c73e3e78e965bf5c37ebd\": container with ID starting with 639d3d2df20511dd6eb230dcb497b9f71466eccdbf6c73e3e78e965bf5c37ebd not found: ID does not exist" containerID="639d3d2df20511dd6eb230dcb497b9f71466eccdbf6c73e3e78e965bf5c37ebd"
Jul 08 21:22:27.226152 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:27.226112    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"639d3d2df20511dd6eb230dcb497b9f71466eccdbf6c73e3e78e965bf5c37ebd"} err="failed to get container status \"639d3d2df20511dd6eb230dcb497b9f71466eccdbf6c73e3e78e965bf5c37ebd\": rpc error: code = NotFound desc = could not find container \"639d3d2df20511dd6eb230dcb497b9f71466eccdbf6c73e3e78e965bf5c37ebd\": container with ID starting with 639d3d2df20511dd6eb230dcb497b9f71466eccdbf6c73e3e78e965bf5c37ebd not found: ID does not exist"
Jul 08 21:22:27.238292 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:27.238268    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8f47cbb78-f8dgz"]
Jul 08 21:22:27.245308 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:27.245280    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8f47cbb78-f8dgz"]
Jul 08 21:22:27.431065 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:27.430992    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b392705-a2bd-4d60-9bed-0c6a1293b015" path="/var/lib/kubelet/pods/1b392705-a2bd-4d60-9bed-0c6a1293b015/volumes"
Jul 08 21:22:28.077374 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.077340    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8f47cbb78-gdxwg"]
Jul 08 21:22:28.077786 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.077664    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b392705-a2bd-4d60-9bed-0c6a1293b015" containerName="manager"
Jul 08 21:22:28.077786 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.077676    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b392705-a2bd-4d60-9bed-0c6a1293b015" containerName="manager"
Jul 08 21:22:28.077786 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.077697    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed3fec2-088a-44ef-bd86-6b991f66d2d9" containerName="authorino"
Jul 08 21:22:28.077786 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.077704    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed3fec2-088a-44ef-bd86-6b991f66d2d9" containerName="authorino"
Jul 08 21:22:28.077786 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.077768    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ed3fec2-088a-44ef-bd86-6b991f66d2d9" containerName="authorino"
Jul 08 21:22:28.077786 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.077777    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b392705-a2bd-4d60-9bed-0c6a1293b015" containerName="manager"
Jul 08 21:22:28.081958 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.081935    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f47cbb78-gdxwg"
Jul 08 21:22:28.085297 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.085275    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6tkmp\""
Jul 08 21:22:28.085441 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.085424    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 21:22:28.086376 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.086350    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 21:22:28.091072 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.091048    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f47cbb78-gdxwg"]
Jul 08 21:22:28.210617 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.210554    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwl9n\" (UniqueName: \"kubernetes.io/projected/1bd09752-66f6-4c7d-be94-70c7bcf7adf7-kube-api-access-qwl9n\") pod \"maas-controller-8f47cbb78-gdxwg\" (UID: \"1bd09752-66f6-4c7d-be94-70c7bcf7adf7\") " pod="opendatahub/maas-controller-8f47cbb78-gdxwg"
Jul 08 21:22:28.210787 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.210656    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bd09752-66f6-4c7d-be94-70c7bcf7adf7-webhook-cert\") pod \"maas-controller-8f47cbb78-gdxwg\" (UID: \"1bd09752-66f6-4c7d-be94-70c7bcf7adf7\") " pod="opendatahub/maas-controller-8f47cbb78-gdxwg"
Jul 08 21:22:28.311057 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.311012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bd09752-66f6-4c7d-be94-70c7bcf7adf7-webhook-cert\") pod \"maas-controller-8f47cbb78-gdxwg\" (UID: \"1bd09752-66f6-4c7d-be94-70c7bcf7adf7\") " pod="opendatahub/maas-controller-8f47cbb78-gdxwg"
Jul 08 21:22:28.311276 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.311080    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwl9n\" (UniqueName: \"kubernetes.io/projected/1bd09752-66f6-4c7d-be94-70c7bcf7adf7-kube-api-access-qwl9n\") pod \"maas-controller-8f47cbb78-gdxwg\" (UID: \"1bd09752-66f6-4c7d-be94-70c7bcf7adf7\") " pod="opendatahub/maas-controller-8f47cbb78-gdxwg"
Jul 08 21:22:28.313565 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.313540    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bd09752-66f6-4c7d-be94-70c7bcf7adf7-webhook-cert\") pod \"maas-controller-8f47cbb78-gdxwg\" (UID: \"1bd09752-66f6-4c7d-be94-70c7bcf7adf7\") " pod="opendatahub/maas-controller-8f47cbb78-gdxwg"
Jul 08 21:22:28.320859 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.320835    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwl9n\" (UniqueName: \"kubernetes.io/projected/1bd09752-66f6-4c7d-be94-70c7bcf7adf7-kube-api-access-qwl9n\") pod \"maas-controller-8f47cbb78-gdxwg\" (UID: \"1bd09752-66f6-4c7d-be94-70c7bcf7adf7\") " pod="opendatahub/maas-controller-8f47cbb78-gdxwg"
Jul 08 21:22:28.392020 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.391911    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f47cbb78-gdxwg"
Jul 08 21:22:28.531378 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:28.531283    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f47cbb78-gdxwg"]
Jul 08 21:22:28.533602 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:22:28.533558    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd09752_66f6_4c7d_be94_70c7bcf7adf7.slice/crio-e4cef688a90053189b6c3ef8b47e625c3aa45545c250003d2656a49a979bd811 WatchSource:0}: Error finding container e4cef688a90053189b6c3ef8b47e625c3aa45545c250003d2656a49a979bd811: Status 404 returned error can't find the container with id e4cef688a90053189b6c3ef8b47e625c3aa45545c250003d2656a49a979bd811
Jul 08 21:22:29.228638 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:29.228602    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f47cbb78-gdxwg" event={"ID":"1bd09752-66f6-4c7d-be94-70c7bcf7adf7","Type":"ContainerStarted","Data":"2ea44566bfad406cb253219f3ef6d458f844a474f009850733df507f7b6bf574"}
Jul 08 21:22:29.229089 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:29.228659    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8f47cbb78-gdxwg"
Jul 08 21:22:29.229089 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:29.228679    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f47cbb78-gdxwg" event={"ID":"1bd09752-66f6-4c7d-be94-70c7bcf7adf7","Type":"ContainerStarted","Data":"e4cef688a90053189b6c3ef8b47e625c3aa45545c250003d2656a49a979bd811"}
Jul 08 21:22:29.248318 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:29.248209    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8f47cbb78-gdxwg" podStartSLOduration=0.798427335 podStartE2EDuration="1.248193176s" totalImagesPullingTime="449.765841ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:22:29.245927392 +0000 UTC m=+972.339730959" watchObservedRunningTime="2026-07-08 21:22:29.248193176 +0000 UTC m=+972.341996736"
Jul 08 21:22:40.238960 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:22:40.238884    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8f47cbb78-gdxwg"
Jul 08 21:34:18.638882 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.638848    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"]
Jul 08 21:34:18.642450 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.642430    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.645089 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.645068    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-bbc0acfd-openshift-default-dockercfg-fxmxk\""
Jul 08 21:34:18.659166 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.659141    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"]
Jul 08 21:34:18.689913 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.689881    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-workload-socket\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.690042 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.689931    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a82d2946-3b19-4a33-9101-c8f37abce299-istio-podinfo\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.690042 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.690014    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-workload-certs\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.690146 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.690045    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a82d2946-3b19-4a33-9101-c8f37abce299-istio-token\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.690146 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.690065    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xznxc\" (UniqueName: \"kubernetes.io/projected/a82d2946-3b19-4a33-9101-c8f37abce299-kube-api-access-xznxc\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.690146 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.690124    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-credential-socket\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.690238 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.690160    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a82d2946-3b19-4a33-9101-c8f37abce299-istiod-ca-cert\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.690238 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.690184    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-istio-data\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.690238 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.690203    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-istio-envoy\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.791002 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.790964    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-credential-socket\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.791002 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.791009    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a82d2946-3b19-4a33-9101-c8f37abce299-istiod-ca-cert\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.791231 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.791032    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-istio-data\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.791231 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.791059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-istio-envoy\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.791231 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.791095    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-workload-socket\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.791231 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.791140    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a82d2946-3b19-4a33-9101-c8f37abce299-istio-podinfo\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.791231 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.791181    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-workload-certs\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.791231 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.791204    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a82d2946-3b19-4a33-9101-c8f37abce299-istio-token\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.791544 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.791254    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xznxc\" (UniqueName: \"kubernetes.io/projected/a82d2946-3b19-4a33-9101-c8f37abce299-kube-api-access-xznxc\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.791544 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.791414    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-credential-socket\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.791793 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.791763    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-istio-data\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.791948 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.791926    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-workload-socket\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.792017 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.791987    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-workload-certs\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.792053 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.792017    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a82d2946-3b19-4a33-9101-c8f37abce299-istiod-ca-cert\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.793390 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.793372    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-istio-envoy\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.793694 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.793667    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a82d2946-3b19-4a33-9101-c8f37abce299-istio-podinfo\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.798885 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.798857    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a82d2946-3b19-4a33-9101-c8f37abce299-istio-token\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.799195 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.799177    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xznxc\" (UniqueName: \"kubernetes.io/projected/a82d2946-3b19-4a33-9101-c8f37abce299-kube-api-access-xznxc\") pod \"e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") " pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:18.951693 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:18.951616    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:19.083238 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:19.083213    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"]
Jul 08 21:34:19.085281 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:34:19.085259    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82d2946_3b19_4a33_9101_c8f37abce299.slice/crio-8f74cc0416aec1d7b07f06bfaf60569814d9cd65fa9499e732a444e1eb5e32a1 WatchSource:0}: Error finding container 8f74cc0416aec1d7b07f06bfaf60569814d9cd65fa9499e732a444e1eb5e32a1: Status 404 returned error can't find the container with id 8f74cc0416aec1d7b07f06bfaf60569814d9cd65fa9499e732a444e1eb5e32a1
Jul 08 21:34:19.087758 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:19.087741    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:34:19.441010 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:19.440977    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85" event={"ID":"a82d2946-3b19-4a33-9101-c8f37abce299","Type":"ContainerStarted","Data":"8f74cc0416aec1d7b07f06bfaf60569814d9cd65fa9499e732a444e1eb5e32a1"}
Jul 08 21:34:19.841937 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:19.841902    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"]
Jul 08 21:34:19.846992 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:19.846967    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"
Jul 08 21:34:19.849234 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:19.849216    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-bbc0acfd-serving-cert\""
Jul 08 21:34:19.853757 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:19.853736    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"]
Jul 08 21:34:19.902305 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:19.902273    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwq7p\" (UniqueName: \"kubernetes.io/projected/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-kube-api-access-gwq7p\") pod \"maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm\" (UID: \"22782ebb-f5b8-4ec9-865f-900fb7f2eda5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"
Jul 08 21:34:19.902456 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:19.902326    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-openshift-service-ca\") pod \"maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm\" (UID: \"22782ebb-f5b8-4ec9-865f-900fb7f2eda5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"
Jul 08 21:34:19.902456 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:19.902386    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-maas-api-tls\") pod \"maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm\" (UID: \"22782ebb-f5b8-4ec9-865f-900fb7f2eda5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"
Jul 08 21:34:20.003206 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:20.003165    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwq7p\" (UniqueName: \"kubernetes.io/projected/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-kube-api-access-gwq7p\") pod \"maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm\" (UID: \"22782ebb-f5b8-4ec9-865f-900fb7f2eda5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"
Jul 08 21:34:20.003349 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:20.003248    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-openshift-service-ca\") pod \"maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm\" (UID: \"22782ebb-f5b8-4ec9-865f-900fb7f2eda5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"
Jul 08 21:34:20.003349 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:20.003299    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-maas-api-tls\") pod \"maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm\" (UID: \"22782ebb-f5b8-4ec9-865f-900fb7f2eda5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"
Jul 08 21:34:20.003434 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:34:20.003425    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-serving-cert: secret "maas-api-e2e-ait-bbc0acfd-serving-cert" not found
Jul 08 21:34:20.003504 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:34:20.003493    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-maas-api-tls podName:22782ebb-f5b8-4ec9-865f-900fb7f2eda5 nodeName:}" failed. No retries permitted until 2026-07-08 21:34:20.503470535 +0000 UTC m=+1683.597274080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-maas-api-tls") pod "maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm" (UID: "22782ebb-f5b8-4ec9-865f-900fb7f2eda5") : secret "maas-api-e2e-ait-bbc0acfd-serving-cert" not found
Jul 08 21:34:20.003907 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:20.003889    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-openshift-service-ca\") pod \"maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm\" (UID: \"22782ebb-f5b8-4ec9-865f-900fb7f2eda5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"
Jul 08 21:34:20.013398 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:20.013368    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwq7p\" (UniqueName: \"kubernetes.io/projected/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-kube-api-access-gwq7p\") pod \"maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm\" (UID: \"22782ebb-f5b8-4ec9-865f-900fb7f2eda5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"
Jul 08 21:34:20.507293 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:20.507261    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-maas-api-tls\") pod \"maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm\" (UID: \"22782ebb-f5b8-4ec9-865f-900fb7f2eda5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"
Jul 08 21:34:20.510004 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:20.509974    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-maas-api-tls\") pod \"maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm\" (UID: \"22782ebb-f5b8-4ec9-865f-900fb7f2eda5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"
Jul 08 21:34:20.759933 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:20.759792    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"
Jul 08 21:34:21.126628 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:21.126577    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"]
Jul 08 21:34:21.128370 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:34:21.128341    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22782ebb_f5b8_4ec9_865f_900fb7f2eda5.slice/crio-6a8ea49458b8c8373f8944e947c3305f53df1b8f6df00a175b81b2743ba15993 WatchSource:0}: Error finding container 6a8ea49458b8c8373f8944e947c3305f53df1b8f6df00a175b81b2743ba15993: Status 404 returned error can't find the container with id 6a8ea49458b8c8373f8944e947c3305f53df1b8f6df00a175b81b2743ba15993
Jul 08 21:34:21.454481 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:21.454362    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm" event={"ID":"22782ebb-f5b8-4ec9-865f-900fb7f2eda5","Type":"ContainerStarted","Data":"6a8ea49458b8c8373f8944e947c3305f53df1b8f6df00a175b81b2743ba15993"}
Jul 08 21:34:22.259355 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:22.259317    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:34:22.259634 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:22.259397    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:34:22.259634 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:22.259427    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:34:22.461227 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:22.461181    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85" event={"ID":"a82d2946-3b19-4a33-9101-c8f37abce299","Type":"ContainerStarted","Data":"021f32af9f7e487b3a12e9b83d4e31833bac8eaec090ddac1729e15f79df6275"}
Jul 08 21:34:22.462841 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:22.462803    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm" event={"ID":"22782ebb-f5b8-4ec9-865f-900fb7f2eda5","Type":"ContainerStarted","Data":"df103551e83ac99b33ebb15931e786f92930a90b81443acc734e6867ec6f0e16"}
Jul 08 21:34:22.462980 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:22.462942    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"
Jul 08 21:34:22.480266 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:22.480213    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85" podStartSLOduration=1.30912331 podStartE2EDuration="4.48019498s" totalImagesPullingTime="3.17107167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:22.479880604 +0000 UTC m=+1685.573684152" watchObservedRunningTime="2026-07-08 21:34:22.48019498 +0000 UTC m=+1685.573998528"
Jul 08 21:34:22.495352 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:22.495298    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm" podStartSLOduration=2.366950447 podStartE2EDuration="3.495285234s" totalImagesPullingTime="1.128334787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:34:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:22.494396454 +0000 UTC m=+1685.588200001" watchObservedRunningTime="2026-07-08 21:34:22.495285234 +0000 UTC m=+1685.589088778"
Jul 08 21:34:22.952447 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:22.952419    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:23.970912 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:23.970879    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:24.472661 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:24.472630    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:24.473500 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:24.473477    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:25.139128 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:25.139092    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"]
Jul 08 21:34:25.278944 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:25.278900    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"]
Jul 08 21:34:25.279229 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:25.279132    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm" podUID="22782ebb-f5b8-4ec9-865f-900fb7f2eda5" containerName="maas-api" containerID="cri-o://df103551e83ac99b33ebb15931e786f92930a90b81443acc734e6867ec6f0e16" gracePeriod=30
Jul 08 21:34:25.495273 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:25.495232    2583 generic.go:356] "Generic (PLEG): container finished" podID="22782ebb-f5b8-4ec9-865f-900fb7f2eda5" containerID="df103551e83ac99b33ebb15931e786f92930a90b81443acc734e6867ec6f0e16" exitCode=0
Jul 08 21:34:25.495429 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:25.495303    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm" event={"ID":"22782ebb-f5b8-4ec9-865f-900fb7f2eda5","Type":"ContainerDied","Data":"df103551e83ac99b33ebb15931e786f92930a90b81443acc734e6867ec6f0e16"}
Jul 08 21:34:25.495671 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:25.495651    2583 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85" secret="" err="secret \"e2e-ait-bbc0acfd-openshift-default-dockercfg-fxmxk\" not found"
Jul 08 21:34:25.541646 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:25.541621    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"
Jul 08 21:34:25.655025 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:25.654927    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwq7p\" (UniqueName: \"kubernetes.io/projected/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-kube-api-access-gwq7p\") pod \"22782ebb-f5b8-4ec9-865f-900fb7f2eda5\" (UID: \"22782ebb-f5b8-4ec9-865f-900fb7f2eda5\") "
Jul 08 21:34:25.655025 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:25.654970    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-openshift-service-ca\") pod \"22782ebb-f5b8-4ec9-865f-900fb7f2eda5\" (UID: \"22782ebb-f5b8-4ec9-865f-900fb7f2eda5\") "
Jul 08 21:34:25.655025 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:25.655007    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-maas-api-tls\") pod \"22782ebb-f5b8-4ec9-865f-900fb7f2eda5\" (UID: \"22782ebb-f5b8-4ec9-865f-900fb7f2eda5\") "
Jul 08 21:34:25.655327 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:25.655298    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "22782ebb-f5b8-4ec9-865f-900fb7f2eda5" (UID: "22782ebb-f5b8-4ec9-865f-900fb7f2eda5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:34:25.657117 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:25.657090    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-kube-api-access-gwq7p" (OuterVolumeSpecName: "kube-api-access-gwq7p") pod "22782ebb-f5b8-4ec9-865f-900fb7f2eda5" (UID: "22782ebb-f5b8-4ec9-865f-900fb7f2eda5"). InnerVolumeSpecName "kube-api-access-gwq7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:34:25.657189 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:25.657159    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "22782ebb-f5b8-4ec9-865f-900fb7f2eda5" (UID: "22782ebb-f5b8-4ec9-865f-900fb7f2eda5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:34:25.756464 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:25.756431    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwq7p\" (UniqueName: \"kubernetes.io/projected/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-kube-api-access-gwq7p\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:25.756464 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:25.756457    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-openshift-service-ca\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:25.756464 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:25.756469    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22782ebb-f5b8-4ec9-865f-900fb7f2eda5-maas-api-tls\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:26.501001 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:26.500974    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"
Jul 08 21:34:26.501409 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:26.501013    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm" event={"ID":"22782ebb-f5b8-4ec9-865f-900fb7f2eda5","Type":"ContainerDied","Data":"6a8ea49458b8c8373f8944e947c3305f53df1b8f6df00a175b81b2743ba15993"}
Jul 08 21:34:26.501409 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:26.501076    2583 scope.go:117] "RemoveContainer" containerID="df103551e83ac99b33ebb15931e786f92930a90b81443acc734e6867ec6f0e16"
Jul 08 21:34:26.501409 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:26.501260    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85" podUID="a82d2946-3b19-4a33-9101-c8f37abce299" containerName="istio-proxy" containerID="cri-o://021f32af9f7e487b3a12e9b83d4e31833bac8eaec090ddac1729e15f79df6275" gracePeriod=30
Jul 08 21:34:26.533205 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:26.533175    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"]
Jul 08 21:34:26.538412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:26.538392    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bbc0acfd-7b869855c6-hmpnm"]
Jul 08 21:34:27.429260 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:27.429228    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22782ebb-f5b8-4ec9-865f-900fb7f2eda5" path="/var/lib/kubelet/pods/22782ebb-f5b8-4ec9-865f-900fb7f2eda5/volumes"
Jul 08 21:34:31.952247 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:31.952219    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:32.024485 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.024406    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-credential-socket\") pod \"a82d2946-3b19-4a33-9101-c8f37abce299\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") "
Jul 08 21:34:32.024485 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.024447    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-istio-data\") pod \"a82d2946-3b19-4a33-9101-c8f37abce299\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") "
Jul 08 21:34:32.024485 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.024470    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a82d2946-3b19-4a33-9101-c8f37abce299-istio-token\") pod \"a82d2946-3b19-4a33-9101-c8f37abce299\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") "
Jul 08 21:34:32.024766 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.024506    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a82d2946-3b19-4a33-9101-c8f37abce299-istio-podinfo\") pod \"a82d2946-3b19-4a33-9101-c8f37abce299\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") "
Jul 08 21:34:32.024766 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.024545    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-workload-certs\") pod \"a82d2946-3b19-4a33-9101-c8f37abce299\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") "
Jul 08 21:34:32.024766 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.024610    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-istio-envoy\") pod \"a82d2946-3b19-4a33-9101-c8f37abce299\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") "
Jul 08 21:34:32.024766 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.024650    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xznxc\" (UniqueName: \"kubernetes.io/projected/a82d2946-3b19-4a33-9101-c8f37abce299-kube-api-access-xznxc\") pod \"a82d2946-3b19-4a33-9101-c8f37abce299\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") "
Jul 08 21:34:32.024766 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.024702    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-workload-socket\") pod \"a82d2946-3b19-4a33-9101-c8f37abce299\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") "
Jul 08 21:34:32.024766 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.024729    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a82d2946-3b19-4a33-9101-c8f37abce299-istiod-ca-cert\") pod \"a82d2946-3b19-4a33-9101-c8f37abce299\" (UID: \"a82d2946-3b19-4a33-9101-c8f37abce299\") "
Jul 08 21:34:32.024766 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.024748    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a82d2946-3b19-4a33-9101-c8f37abce299" (UID: "a82d2946-3b19-4a33-9101-c8f37abce299"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:34:32.025123 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.024906    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a82d2946-3b19-4a33-9101-c8f37abce299" (UID: "a82d2946-3b19-4a33-9101-c8f37abce299"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:34:32.025123 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.024935    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a82d2946-3b19-4a33-9101-c8f37abce299" (UID: "a82d2946-3b19-4a33-9101-c8f37abce299"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:34:32.025123 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.025014    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:32.025123 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.025035    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:32.025123 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.025053    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:32.025349 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.025205    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a82d2946-3b19-4a33-9101-c8f37abce299-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a82d2946-3b19-4a33-9101-c8f37abce299" (UID: "a82d2946-3b19-4a33-9101-c8f37abce299"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:34:32.025349 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.025296    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-istio-data" (OuterVolumeSpecName: "istio-data") pod "a82d2946-3b19-4a33-9101-c8f37abce299" (UID: "a82d2946-3b19-4a33-9101-c8f37abce299"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:34:32.027331 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.027296    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a82d2946-3b19-4a33-9101-c8f37abce299" (UID: "a82d2946-3b19-4a33-9101-c8f37abce299"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:34:32.027430 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.027327    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a82d2946-3b19-4a33-9101-c8f37abce299-istio-token" (OuterVolumeSpecName: "istio-token") pod "a82d2946-3b19-4a33-9101-c8f37abce299" (UID: "a82d2946-3b19-4a33-9101-c8f37abce299"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:34:32.027430 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.027359    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a82d2946-3b19-4a33-9101-c8f37abce299-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a82d2946-3b19-4a33-9101-c8f37abce299" (UID: "a82d2946-3b19-4a33-9101-c8f37abce299"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 21:34:32.027430 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.027383    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a82d2946-3b19-4a33-9101-c8f37abce299-kube-api-access-xznxc" (OuterVolumeSpecName: "kube-api-access-xznxc") pod "a82d2946-3b19-4a33-9101-c8f37abce299" (UID: "a82d2946-3b19-4a33-9101-c8f37abce299"). InnerVolumeSpecName "kube-api-access-xznxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:34:32.125581 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.125546    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a82d2946-3b19-4a33-9101-c8f37abce299-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:32.125581 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.125571    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:32.125581 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.125579    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a82d2946-3b19-4a33-9101-c8f37abce299-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:32.125581 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.125607    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a82d2946-3b19-4a33-9101-c8f37abce299-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:32.125839 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.125615    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a82d2946-3b19-4a33-9101-c8f37abce299-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:32.125839 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.125623    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xznxc\" (UniqueName: \"kubernetes.io/projected/a82d2946-3b19-4a33-9101-c8f37abce299-kube-api-access-xznxc\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:32.295028 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.294942    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"]
Jul 08 21:34:32.295484 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.295465    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a82d2946-3b19-4a33-9101-c8f37abce299" containerName="istio-proxy"
Jul 08 21:34:32.295484 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.295484    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a82d2946-3b19-4a33-9101-c8f37abce299" containerName="istio-proxy"
Jul 08 21:34:32.295715 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.295507    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22782ebb-f5b8-4ec9-865f-900fb7f2eda5" containerName="maas-api"
Jul 08 21:34:32.295715 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.295516    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="22782ebb-f5b8-4ec9-865f-900fb7f2eda5" containerName="maas-api"
Jul 08 21:34:32.295715 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.295610    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="22782ebb-f5b8-4ec9-865f-900fb7f2eda5" containerName="maas-api"
Jul 08 21:34:32.295715 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.295623    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a82d2946-3b19-4a33-9101-c8f37abce299" containerName="istio-proxy"
Jul 08 21:34:32.298068 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.298050    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"
Jul 08 21:34:32.300412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.300389    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-28a93421-serving-cert\""
Jul 08 21:34:32.309743 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.309722    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"]
Jul 08 21:34:32.428352 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.428309    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj8w5\" (UniqueName: \"kubernetes.io/projected/086511a1-3be7-43f5-b0df-e7bf6f0bc980-kube-api-access-nj8w5\") pod \"maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d\" (UID: \"086511a1-3be7-43f5-b0df-e7bf6f0bc980\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"
Jul 08 21:34:32.428524 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.428395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/086511a1-3be7-43f5-b0df-e7bf6f0bc980-maas-api-tls\") pod \"maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d\" (UID: \"086511a1-3be7-43f5-b0df-e7bf6f0bc980\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"
Jul 08 21:34:32.428524 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.428427    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/086511a1-3be7-43f5-b0df-e7bf6f0bc980-openshift-service-ca\") pod \"maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d\" (UID: \"086511a1-3be7-43f5-b0df-e7bf6f0bc980\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"
Jul 08 21:34:32.529375 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.529337    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/086511a1-3be7-43f5-b0df-e7bf6f0bc980-maas-api-tls\") pod \"maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d\" (UID: \"086511a1-3be7-43f5-b0df-e7bf6f0bc980\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"
Jul 08 21:34:32.529559 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.529389    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/086511a1-3be7-43f5-b0df-e7bf6f0bc980-openshift-service-ca\") pod \"maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d\" (UID: \"086511a1-3be7-43f5-b0df-e7bf6f0bc980\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"
Jul 08 21:34:32.529559 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.529440    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj8w5\" (UniqueName: \"kubernetes.io/projected/086511a1-3be7-43f5-b0df-e7bf6f0bc980-kube-api-access-nj8w5\") pod \"maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d\" (UID: \"086511a1-3be7-43f5-b0df-e7bf6f0bc980\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"
Jul 08 21:34:32.530219 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.530195    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/086511a1-3be7-43f5-b0df-e7bf6f0bc980-openshift-service-ca\") pod \"maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d\" (UID: \"086511a1-3be7-43f5-b0df-e7bf6f0bc980\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"
Jul 08 21:34:32.530645 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.530620    2583 generic.go:356] "Generic (PLEG): container finished" podID="a82d2946-3b19-4a33-9101-c8f37abce299" containerID="021f32af9f7e487b3a12e9b83d4e31833bac8eaec090ddac1729e15f79df6275" exitCode=0
Jul 08 21:34:32.530718 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.530655    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"
Jul 08 21:34:32.530718 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.530661    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85" event={"ID":"a82d2946-3b19-4a33-9101-c8f37abce299","Type":"ContainerDied","Data":"021f32af9f7e487b3a12e9b83d4e31833bac8eaec090ddac1729e15f79df6275"}
Jul 08 21:34:32.530786 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.530720    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85" event={"ID":"a82d2946-3b19-4a33-9101-c8f37abce299","Type":"ContainerDied","Data":"8f74cc0416aec1d7b07f06bfaf60569814d9cd65fa9499e732a444e1eb5e32a1"}
Jul 08 21:34:32.530786 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.530751    2583 scope.go:117] "RemoveContainer" containerID="021f32af9f7e487b3a12e9b83d4e31833bac8eaec090ddac1729e15f79df6275"
Jul 08 21:34:32.532239 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.532212    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/086511a1-3be7-43f5-b0df-e7bf6f0bc980-maas-api-tls\") pod \"maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d\" (UID: \"086511a1-3be7-43f5-b0df-e7bf6f0bc980\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"
Jul 08 21:34:32.537118 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.537095    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj8w5\" (UniqueName: \"kubernetes.io/projected/086511a1-3be7-43f5-b0df-e7bf6f0bc980-kube-api-access-nj8w5\") pod \"maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d\" (UID: \"086511a1-3be7-43f5-b0df-e7bf6f0bc980\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"
Jul 08 21:34:32.542817 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.542797    2583 scope.go:117] "RemoveContainer" containerID="021f32af9f7e487b3a12e9b83d4e31833bac8eaec090ddac1729e15f79df6275"
Jul 08 21:34:32.543084 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:34:32.543068    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"021f32af9f7e487b3a12e9b83d4e31833bac8eaec090ddac1729e15f79df6275\": container with ID starting with 021f32af9f7e487b3a12e9b83d4e31833bac8eaec090ddac1729e15f79df6275 not found: ID does not exist" containerID="021f32af9f7e487b3a12e9b83d4e31833bac8eaec090ddac1729e15f79df6275"
Jul 08 21:34:32.543135 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.543092    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"021f32af9f7e487b3a12e9b83d4e31833bac8eaec090ddac1729e15f79df6275"} err="failed to get container status \"021f32af9f7e487b3a12e9b83d4e31833bac8eaec090ddac1729e15f79df6275\": rpc error: code = NotFound desc = could not find container \"021f32af9f7e487b3a12e9b83d4e31833bac8eaec090ddac1729e15f79df6275\": container with ID starting with 021f32af9f7e487b3a12e9b83d4e31833bac8eaec090ddac1729e15f79df6275 not found: ID does not exist"
Jul 08 21:34:32.553854 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.553806    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"]
Jul 08 21:34:32.557766 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.557742    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-bbc0acfd-openshift-default-56f4f674cc-vns85"]
Jul 08 21:34:32.608380 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.608359    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"
Jul 08 21:34:32.737928 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:32.737904    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"]
Jul 08 21:34:32.740414 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:34:32.740372    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086511a1_3be7_43f5_b0df_e7bf6f0bc980.slice/crio-b498b57febe2e8f94ccebccf39b3675652dbc841c0902d9067908428ff7ed856 WatchSource:0}: Error finding container b498b57febe2e8f94ccebccf39b3675652dbc841c0902d9067908428ff7ed856: Status 404 returned error can't find the container with id b498b57febe2e8f94ccebccf39b3675652dbc841c0902d9067908428ff7ed856
Jul 08 21:34:33.432135 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:33.432053    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a82d2946-3b19-4a33-9101-c8f37abce299" path="/var/lib/kubelet/pods/a82d2946-3b19-4a33-9101-c8f37abce299/volumes"
Jul 08 21:34:33.537023 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:33.536986    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d" event={"ID":"086511a1-3be7-43f5-b0df-e7bf6f0bc980","Type":"ContainerStarted","Data":"e6bf70621229e25ceec7a2558906221c7a9db3c30c2281b62210613f1f772950"}
Jul 08 21:34:33.537203 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:33.537046    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"
Jul 08 21:34:33.537203 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:33.537067    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d" event={"ID":"086511a1-3be7-43f5-b0df-e7bf6f0bc980","Type":"ContainerStarted","Data":"b498b57febe2e8f94ccebccf39b3675652dbc841c0902d9067908428ff7ed856"}
Jul 08 21:34:33.553787 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:33.553740    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d" podStartSLOduration=1.217782405 podStartE2EDuration="1.553723675s" totalImagesPullingTime="335.94127ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:33.552041504 +0000 UTC m=+1696.645845070" watchObservedRunningTime="2026-07-08 21:34:33.553723675 +0000 UTC m=+1696.647527222"
Jul 08 21:34:37.685774 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:37.685738    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"]
Jul 08 21:34:37.686289 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:37.685981    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d" podUID="086511a1-3be7-43f5-b0df-e7bf6f0bc980" containerName="maas-api" containerID="cri-o://e6bf70621229e25ceec7a2558906221c7a9db3c30c2281b62210613f1f772950" gracePeriod=30
Jul 08 21:34:37.926312 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:37.926283    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"
Jul 08 21:34:38.074738 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.074704    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/086511a1-3be7-43f5-b0df-e7bf6f0bc980-maas-api-tls\") pod \"086511a1-3be7-43f5-b0df-e7bf6f0bc980\" (UID: \"086511a1-3be7-43f5-b0df-e7bf6f0bc980\") "
Jul 08 21:34:38.074913 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.074761    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/086511a1-3be7-43f5-b0df-e7bf6f0bc980-openshift-service-ca\") pod \"086511a1-3be7-43f5-b0df-e7bf6f0bc980\" (UID: \"086511a1-3be7-43f5-b0df-e7bf6f0bc980\") "
Jul 08 21:34:38.074913 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.074802    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nj8w5\" (UniqueName: \"kubernetes.io/projected/086511a1-3be7-43f5-b0df-e7bf6f0bc980-kube-api-access-nj8w5\") pod \"086511a1-3be7-43f5-b0df-e7bf6f0bc980\" (UID: \"086511a1-3be7-43f5-b0df-e7bf6f0bc980\") "
Jul 08 21:34:38.075154 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.075129    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/086511a1-3be7-43f5-b0df-e7bf6f0bc980-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "086511a1-3be7-43f5-b0df-e7bf6f0bc980" (UID: "086511a1-3be7-43f5-b0df-e7bf6f0bc980"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:34:38.076811 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.076788    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/086511a1-3be7-43f5-b0df-e7bf6f0bc980-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "086511a1-3be7-43f5-b0df-e7bf6f0bc980" (UID: "086511a1-3be7-43f5-b0df-e7bf6f0bc980"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:34:38.076912 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.076844    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/086511a1-3be7-43f5-b0df-e7bf6f0bc980-kube-api-access-nj8w5" (OuterVolumeSpecName: "kube-api-access-nj8w5") pod "086511a1-3be7-43f5-b0df-e7bf6f0bc980" (UID: "086511a1-3be7-43f5-b0df-e7bf6f0bc980"). InnerVolumeSpecName "kube-api-access-nj8w5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:34:38.176005 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.175968    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/086511a1-3be7-43f5-b0df-e7bf6f0bc980-openshift-service-ca\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:38.176005 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.176006    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj8w5\" (UniqueName: \"kubernetes.io/projected/086511a1-3be7-43f5-b0df-e7bf6f0bc980-kube-api-access-nj8w5\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:38.176182 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.176022    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/086511a1-3be7-43f5-b0df-e7bf6f0bc980-maas-api-tls\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:38.563830 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.563797    2583 generic.go:356] "Generic (PLEG): container finished" podID="086511a1-3be7-43f5-b0df-e7bf6f0bc980" containerID="e6bf70621229e25ceec7a2558906221c7a9db3c30c2281b62210613f1f772950" exitCode=0
Jul 08 21:34:38.564010 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.563846    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"
Jul 08 21:34:38.564010 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.563865    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d" event={"ID":"086511a1-3be7-43f5-b0df-e7bf6f0bc980","Type":"ContainerDied","Data":"e6bf70621229e25ceec7a2558906221c7a9db3c30c2281b62210613f1f772950"}
Jul 08 21:34:38.564010 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.563918    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d" event={"ID":"086511a1-3be7-43f5-b0df-e7bf6f0bc980","Type":"ContainerDied","Data":"b498b57febe2e8f94ccebccf39b3675652dbc841c0902d9067908428ff7ed856"}
Jul 08 21:34:38.564010 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.563949    2583 scope.go:117] "RemoveContainer" containerID="e6bf70621229e25ceec7a2558906221c7a9db3c30c2281b62210613f1f772950"
Jul 08 21:34:38.572789 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.572738    2583 scope.go:117] "RemoveContainer" containerID="e6bf70621229e25ceec7a2558906221c7a9db3c30c2281b62210613f1f772950"
Jul 08 21:34:38.573012 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:34:38.572988    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6bf70621229e25ceec7a2558906221c7a9db3c30c2281b62210613f1f772950\": container with ID starting with e6bf70621229e25ceec7a2558906221c7a9db3c30c2281b62210613f1f772950 not found: ID does not exist" containerID="e6bf70621229e25ceec7a2558906221c7a9db3c30c2281b62210613f1f772950"
Jul 08 21:34:38.573076 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.573019    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6bf70621229e25ceec7a2558906221c7a9db3c30c2281b62210613f1f772950"} err="failed to get container status \"e6bf70621229e25ceec7a2558906221c7a9db3c30c2281b62210613f1f772950\": rpc error: code = NotFound desc = could not find container \"e6bf70621229e25ceec7a2558906221c7a9db3c30c2281b62210613f1f772950\": container with ID starting with e6bf70621229e25ceec7a2558906221c7a9db3c30c2281b62210613f1f772950 not found: ID does not exist"
Jul 08 21:34:38.584102 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.584080    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"]
Jul 08 21:34:38.587709 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:38.587688    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28a93421-75b6cc69b9-89b7d"]
Jul 08 21:34:39.430702 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:39.430672    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="086511a1-3be7-43f5-b0df-e7bf6f0bc980" path="/var/lib/kubelet/pods/086511a1-3be7-43f5-b0df-e7bf6f0bc980/volumes"
Jul 08 21:34:49.555301 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.555265    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"]
Jul 08 21:34:49.555962 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.555696    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="086511a1-3be7-43f5-b0df-e7bf6f0bc980" containerName="maas-api"
Jul 08 21:34:49.555962 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.555740    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="086511a1-3be7-43f5-b0df-e7bf6f0bc980" containerName="maas-api"
Jul 08 21:34:49.555962 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.555848    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="086511a1-3be7-43f5-b0df-e7bf6f0bc980" containerName="maas-api"
Jul 08 21:34:49.558172 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.558152    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.562551 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.562534    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1bdcec1b-openshift-default-dockercfg-5fjkt\""
Jul 08 21:34:49.566321 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.566299    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-envoy\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.566428 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.566344    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-token\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.566428 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.566375    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istiod-ca-cert\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.566428 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.566405    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-data\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.566598 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.566437    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-workload-socket\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.566598 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.566496    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-workload-certs\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.566598 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.566535    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-podinfo\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.566598 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.566572    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-credential-socket\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.567140 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.566620    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsgn5\" (UniqueName: \"kubernetes.io/projected/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-kube-api-access-dsgn5\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.578318 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.578287    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"]
Jul 08 21:34:49.667139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.667107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-credential-socket\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.667139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.667144    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsgn5\" (UniqueName: \"kubernetes.io/projected/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-kube-api-access-dsgn5\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.667410 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.667165    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-envoy\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.667410 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.667198    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-token\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.667410 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.667315    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istiod-ca-cert\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.667410 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.667347    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-data\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.667410 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.667391    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-workload-socket\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.667759 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.667427    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-workload-certs\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.667759 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.667477    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-podinfo\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.667759 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.667626    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-credential-socket\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.667759 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.667734    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-data\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.667968 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.667873    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-workload-socket\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.667968 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.667910    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-workload-certs\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.669260 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.669235    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istiod-ca-cert\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.670550 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.670508    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-podinfo\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.671062 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.671024    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-envoy\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.674882 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.674856    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsgn5\" (UniqueName: \"kubernetes.io/projected/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-kube-api-access-dsgn5\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.675050 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.675029    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-token\") pod \"e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") " pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:49.870185 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:49.870098    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:50.001538 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.001502    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"]
Jul 08 21:34:50.002088 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:34:50.002059    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda856c2e9_8e0a_45a7_bdd9_3958b8bcc46a.slice/crio-3c52b544835ef560e0dc3cd456d5b0dab325d69bc3e57a856502d09532fd00be WatchSource:0}: Error finding container 3c52b544835ef560e0dc3cd456d5b0dab325d69bc3e57a856502d09532fd00be: Status 404 returned error can't find the container with id 3c52b544835ef560e0dc3cd456d5b0dab325d69bc3e57a856502d09532fd00be
Jul 08 21:34:50.004166 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.004133    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:34:50.004261 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.004217    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:34:50.004322 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.004263    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:34:50.620647 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.620609    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88" event={"ID":"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a","Type":"ContainerStarted","Data":"829c0f5dd9917eb5b63d42378e02b121c61822adf1466a372fd1d91d0d16f511"}
Jul 08 21:34:50.621074 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.620661    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88" event={"ID":"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a","Type":"ContainerStarted","Data":"3c52b544835ef560e0dc3cd456d5b0dab325d69bc3e57a856502d09532fd00be"}
Jul 08 21:34:50.640947 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.640899    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88" podStartSLOduration=1.640884823 podStartE2EDuration="1.640884823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:34:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:50.638465578 +0000 UTC m=+1713.732269126" watchObservedRunningTime="2026-07-08 21:34:50.640884823 +0000 UTC m=+1713.734688370"
Jul 08 21:34:50.785262 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.785228    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"]
Jul 08 21:34:50.788076 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.788054    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"
Jul 08 21:34:50.790536 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.790513    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-1bdcec1b-serving-cert\""
Jul 08 21:34:50.800105 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.800083    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"]
Jul 08 21:34:50.871230 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.871158    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:50.880122 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.880075    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c84ee8c6-190c-4fcf-b33f-4775edd1a150-maas-api-tls\") pod \"maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd\" (UID: \"c84ee8c6-190c-4fcf-b33f-4775edd1a150\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"
Jul 08 21:34:50.880269 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.880155    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c84ee8c6-190c-4fcf-b33f-4775edd1a150-openshift-service-ca\") pod \"maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd\" (UID: \"c84ee8c6-190c-4fcf-b33f-4775edd1a150\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"
Jul 08 21:34:50.880269 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.880221    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzchb\" (UniqueName: \"kubernetes.io/projected/c84ee8c6-190c-4fcf-b33f-4775edd1a150-kube-api-access-jzchb\") pod \"maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd\" (UID: \"c84ee8c6-190c-4fcf-b33f-4775edd1a150\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"
Jul 08 21:34:50.980874 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.980832    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c84ee8c6-190c-4fcf-b33f-4775edd1a150-maas-api-tls\") pod \"maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd\" (UID: \"c84ee8c6-190c-4fcf-b33f-4775edd1a150\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"
Jul 08 21:34:50.981048 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.980887    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c84ee8c6-190c-4fcf-b33f-4775edd1a150-openshift-service-ca\") pod \"maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd\" (UID: \"c84ee8c6-190c-4fcf-b33f-4775edd1a150\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"
Jul 08 21:34:50.981048 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.980962    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzchb\" (UniqueName: \"kubernetes.io/projected/c84ee8c6-190c-4fcf-b33f-4775edd1a150-kube-api-access-jzchb\") pod \"maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd\" (UID: \"c84ee8c6-190c-4fcf-b33f-4775edd1a150\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"
Jul 08 21:34:50.981677 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.981658    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c84ee8c6-190c-4fcf-b33f-4775edd1a150-openshift-service-ca\") pod \"maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd\" (UID: \"c84ee8c6-190c-4fcf-b33f-4775edd1a150\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"
Jul 08 21:34:50.983244 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.983225    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c84ee8c6-190c-4fcf-b33f-4775edd1a150-maas-api-tls\") pod \"maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd\" (UID: \"c84ee8c6-190c-4fcf-b33f-4775edd1a150\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"
Jul 08 21:34:50.991173 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:50.991149    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzchb\" (UniqueName: \"kubernetes.io/projected/c84ee8c6-190c-4fcf-b33f-4775edd1a150-kube-api-access-jzchb\") pod \"maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd\" (UID: \"c84ee8c6-190c-4fcf-b33f-4775edd1a150\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"
Jul 08 21:34:51.099456 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:51.099420    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"
Jul 08 21:34:51.228783 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:51.228751    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"]
Jul 08 21:34:51.230975 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:34:51.230945    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc84ee8c6_190c_4fcf_b33f_4775edd1a150.slice/crio-4dfea7982b21df643ec38007c12d3689c164149e0dc37627645475a63f8df575 WatchSource:0}: Error finding container 4dfea7982b21df643ec38007c12d3689c164149e0dc37627645475a63f8df575: Status 404 returned error can't find the container with id 4dfea7982b21df643ec38007c12d3689c164149e0dc37627645475a63f8df575
Jul 08 21:34:51.626407 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:51.626376    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd" event={"ID":"c84ee8c6-190c-4fcf-b33f-4775edd1a150","Type":"ContainerStarted","Data":"4dfea7982b21df643ec38007c12d3689c164149e0dc37627645475a63f8df575"}
Jul 08 21:34:51.875127 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:51.875052    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:52.632129 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:52.632091    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd" event={"ID":"c84ee8c6-190c-4fcf-b33f-4775edd1a150","Type":"ContainerStarted","Data":"cdc3e1d67bd58ac60c5e7bd6d47c5bad7f9252332b299ceac833fda1ec6e1f7f"}
Jul 08 21:34:52.632525 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:52.632229    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"
Jul 08 21:34:52.632525 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:52.632460    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:52.633196 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:52.633175    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:34:52.649439 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:52.649395    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd" podStartSLOduration=2.26433571 podStartE2EDuration="2.649381393s" totalImagesPullingTime="385.045683ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:52.647165239 +0000 UTC m=+1715.740968817" watchObservedRunningTime="2026-07-08 21:34:52.649381393 +0000 UTC m=+1715.743184940"
Jul 08 21:34:55.384100 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:55.384062    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"]
Jul 08 21:34:55.545352 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:55.545317    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"]
Jul 08 21:34:55.545599 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:55.545552    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd" podUID="c84ee8c6-190c-4fcf-b33f-4775edd1a150" containerName="maas-api" containerID="cri-o://cdc3e1d67bd58ac60c5e7bd6d47c5bad7f9252332b299ceac833fda1ec6e1f7f" gracePeriod=30
Jul 08 21:34:55.647635 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:55.647500    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88" podUID="a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a" containerName="istio-proxy" containerID="cri-o://829c0f5dd9917eb5b63d42378e02b121c61822adf1466a372fd1d91d0d16f511" gracePeriod=30
Jul 08 21:34:55.829368 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:55.829341    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"
Jul 08 21:34:55.923272 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:55.923183    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzchb\" (UniqueName: \"kubernetes.io/projected/c84ee8c6-190c-4fcf-b33f-4775edd1a150-kube-api-access-jzchb\") pod \"c84ee8c6-190c-4fcf-b33f-4775edd1a150\" (UID: \"c84ee8c6-190c-4fcf-b33f-4775edd1a150\") "
Jul 08 21:34:55.923424 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:55.923295    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c84ee8c6-190c-4fcf-b33f-4775edd1a150-maas-api-tls\") pod \"c84ee8c6-190c-4fcf-b33f-4775edd1a150\" (UID: \"c84ee8c6-190c-4fcf-b33f-4775edd1a150\") "
Jul 08 21:34:55.923424 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:55.923336    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c84ee8c6-190c-4fcf-b33f-4775edd1a150-openshift-service-ca\") pod \"c84ee8c6-190c-4fcf-b33f-4775edd1a150\" (UID: \"c84ee8c6-190c-4fcf-b33f-4775edd1a150\") "
Jul 08 21:34:55.923699 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:55.923671    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c84ee8c6-190c-4fcf-b33f-4775edd1a150-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c84ee8c6-190c-4fcf-b33f-4775edd1a150" (UID: "c84ee8c6-190c-4fcf-b33f-4775edd1a150"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:34:55.925253 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:55.925229    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c84ee8c6-190c-4fcf-b33f-4775edd1a150-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c84ee8c6-190c-4fcf-b33f-4775edd1a150" (UID: "c84ee8c6-190c-4fcf-b33f-4775edd1a150"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:34:55.925313 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:55.925283    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c84ee8c6-190c-4fcf-b33f-4775edd1a150-kube-api-access-jzchb" (OuterVolumeSpecName: "kube-api-access-jzchb") pod "c84ee8c6-190c-4fcf-b33f-4775edd1a150" (UID: "c84ee8c6-190c-4fcf-b33f-4775edd1a150"). InnerVolumeSpecName "kube-api-access-jzchb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:34:56.024927 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:56.024881    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c84ee8c6-190c-4fcf-b33f-4775edd1a150-maas-api-tls\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:56.024927 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:56.024921    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c84ee8c6-190c-4fcf-b33f-4775edd1a150-openshift-service-ca\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:56.024927 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:56.024931    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzchb\" (UniqueName: \"kubernetes.io/projected/c84ee8c6-190c-4fcf-b33f-4775edd1a150-kube-api-access-jzchb\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:34:56.653795 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:56.653756    2583 generic.go:356] "Generic (PLEG): container finished" podID="c84ee8c6-190c-4fcf-b33f-4775edd1a150" containerID="cdc3e1d67bd58ac60c5e7bd6d47c5bad7f9252332b299ceac833fda1ec6e1f7f" exitCode=0
Jul 08 21:34:56.654270 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:56.653803    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"
Jul 08 21:34:56.654270 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:56.653821    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd" event={"ID":"c84ee8c6-190c-4fcf-b33f-4775edd1a150","Type":"ContainerDied","Data":"cdc3e1d67bd58ac60c5e7bd6d47c5bad7f9252332b299ceac833fda1ec6e1f7f"}
Jul 08 21:34:56.654270 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:56.653863    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd" event={"ID":"c84ee8c6-190c-4fcf-b33f-4775edd1a150","Type":"ContainerDied","Data":"4dfea7982b21df643ec38007c12d3689c164149e0dc37627645475a63f8df575"}
Jul 08 21:34:56.654270 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:56.653885    2583 scope.go:117] "RemoveContainer" containerID="cdc3e1d67bd58ac60c5e7bd6d47c5bad7f9252332b299ceac833fda1ec6e1f7f"
Jul 08 21:34:56.668723 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:56.668695    2583 scope.go:117] "RemoveContainer" containerID="cdc3e1d67bd58ac60c5e7bd6d47c5bad7f9252332b299ceac833fda1ec6e1f7f"
Jul 08 21:34:56.669022 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:34:56.668989    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdc3e1d67bd58ac60c5e7bd6d47c5bad7f9252332b299ceac833fda1ec6e1f7f\": container with ID starting with cdc3e1d67bd58ac60c5e7bd6d47c5bad7f9252332b299ceac833fda1ec6e1f7f not found: ID does not exist" containerID="cdc3e1d67bd58ac60c5e7bd6d47c5bad7f9252332b299ceac833fda1ec6e1f7f"
Jul 08 21:34:56.669123 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:56.669033    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdc3e1d67bd58ac60c5e7bd6d47c5bad7f9252332b299ceac833fda1ec6e1f7f"} err="failed to get container status \"cdc3e1d67bd58ac60c5e7bd6d47c5bad7f9252332b299ceac833fda1ec6e1f7f\": rpc error: code = NotFound desc = could not find container \"cdc3e1d67bd58ac60c5e7bd6d47c5bad7f9252332b299ceac833fda1ec6e1f7f\": container with ID starting with cdc3e1d67bd58ac60c5e7bd6d47c5bad7f9252332b299ceac833fda1ec6e1f7f not found: ID does not exist"
Jul 08 21:34:56.687395 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:56.687365    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"]
Jul 08 21:34:56.690991 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:56.690969    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1bdcec1b-5cbf84f677-xbbqd"]
Jul 08 21:34:57.431097 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:34:57.431067    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c84ee8c6-190c-4fcf-b33f-4775edd1a150" path="/var/lib/kubelet/pods/c84ee8c6-190c-4fcf-b33f-4775edd1a150/volumes"
Jul 08 21:35:01.904113 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.904075    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:35:01.980141 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.980057    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-token\") pod \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") "
Jul 08 21:35:01.980141 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.980091    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-data\") pod \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") "
Jul 08 21:35:01.980141 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.980119    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istiod-ca-cert\") pod \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") "
Jul 08 21:35:01.980441 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.980135    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-workload-certs\") pod \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") "
Jul 08 21:35:01.980441 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.980178    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsgn5\" (UniqueName: \"kubernetes.io/projected/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-kube-api-access-dsgn5\") pod \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") "
Jul 08 21:35:01.980441 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.980209    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-credential-socket\") pod \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") "
Jul 08 21:35:01.980441 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.980247    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-workload-socket\") pod \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") "
Jul 08 21:35:01.980441 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.980279    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-podinfo\") pod \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") "
Jul 08 21:35:01.980441 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.980319    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-envoy\") pod \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\" (UID: \"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a\") "
Jul 08 21:35:01.980768 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.980441    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a" (UID: "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:35:01.980768 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.980616    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a" (UID: "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:35:01.980768 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.980705    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a" (UID: "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:35:01.980930 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.980767    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a" (UID: "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:35:01.981117 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.981090    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-data" (OuterVolumeSpecName: "istio-data") pod "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a" (UID: "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:35:01.982428 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.982396    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-token" (OuterVolumeSpecName: "istio-token") pod "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a" (UID: "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:35:01.982546 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.982509    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a" (UID: "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 21:35:01.982867 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.982841    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-kube-api-access-dsgn5" (OuterVolumeSpecName: "kube-api-access-dsgn5") pod "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a" (UID: "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a"). InnerVolumeSpecName "kube-api-access-dsgn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:35:01.982867 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:01.982843    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a" (UID: "a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:35:02.081786 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.081743    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:35:02.081786 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.081777    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:35:02.081786 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.081789    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:35:02.082037 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.081800    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:35:02.082037 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.081813    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsgn5\" (UniqueName: \"kubernetes.io/projected/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-kube-api-access-dsgn5\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:35:02.082037 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.081827    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:35:02.082037 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.081837    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:35:02.082037 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.081866    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:35:02.082037 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.081878    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:35:02.689687 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.689649    2583 generic.go:356] "Generic (PLEG): container finished" podID="a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a" containerID="829c0f5dd9917eb5b63d42378e02b121c61822adf1466a372fd1d91d0d16f511" exitCode=0
Jul 08 21:35:02.689856 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.689700    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"
Jul 08 21:35:02.689856 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.689715    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88" event={"ID":"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a","Type":"ContainerDied","Data":"829c0f5dd9917eb5b63d42378e02b121c61822adf1466a372fd1d91d0d16f511"}
Jul 08 21:35:02.689856 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.689777    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88" event={"ID":"a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a","Type":"ContainerDied","Data":"3c52b544835ef560e0dc3cd456d5b0dab325d69bc3e57a856502d09532fd00be"}
Jul 08 21:35:02.689856 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.689807    2583 scope.go:117] "RemoveContainer" containerID="829c0f5dd9917eb5b63d42378e02b121c61822adf1466a372fd1d91d0d16f511"
Jul 08 21:35:02.700549 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.699385    2583 scope.go:117] "RemoveContainer" containerID="829c0f5dd9917eb5b63d42378e02b121c61822adf1466a372fd1d91d0d16f511"
Jul 08 21:35:02.700678 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:35:02.700659    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"829c0f5dd9917eb5b63d42378e02b121c61822adf1466a372fd1d91d0d16f511\": container with ID starting with 829c0f5dd9917eb5b63d42378e02b121c61822adf1466a372fd1d91d0d16f511 not found: ID does not exist" containerID="829c0f5dd9917eb5b63d42378e02b121c61822adf1466a372fd1d91d0d16f511"
Jul 08 21:35:02.700745 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.700694    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"829c0f5dd9917eb5b63d42378e02b121c61822adf1466a372fd1d91d0d16f511"} err="failed to get container status \"829c0f5dd9917eb5b63d42378e02b121c61822adf1466a372fd1d91d0d16f511\": rpc error: code = NotFound desc = could not find container \"829c0f5dd9917eb5b63d42378e02b121c61822adf1466a372fd1d91d0d16f511\": container with ID starting with 829c0f5dd9917eb5b63d42378e02b121c61822adf1466a372fd1d91d0d16f511 not found: ID does not exist"
Jul 08 21:35:02.713617 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.713570    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"]
Jul 08 21:35:02.719238 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:02.719208    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1bdcec1b-openshift-default-986fb85f-4xx88"]
Jul 08 21:35:03.430009 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:35:03.429977    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a" path="/var/lib/kubelet/pods/a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a/volumes"
Jul 08 21:36:36.718709 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.718667    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"]
Jul 08 21:36:36.719158 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.719142    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c84ee8c6-190c-4fcf-b33f-4775edd1a150" containerName="maas-api"
Jul 08 21:36:36.719212 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.719159    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c84ee8c6-190c-4fcf-b33f-4775edd1a150" containerName="maas-api"
Jul 08 21:36:36.719212 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.719176    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a" containerName="istio-proxy"
Jul 08 21:36:36.719212 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.719181    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a" containerName="istio-proxy"
Jul 08 21:36:36.719313 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.719231    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a856c2e9-8e0a-45a7-bdd9-3958b8bcc46a" containerName="istio-proxy"
Jul 08 21:36:36.719313 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.719241    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c84ee8c6-190c-4fcf-b33f-4775edd1a150" containerName="maas-api"
Jul 08 21:36:36.722088 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.722072    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.724655 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.724633    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0483db97-openshift-default-dockercfg-66knx\""
Jul 08 21:36:36.742504 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.742473    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"]
Jul 08 21:36:36.786377 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.786330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-podinfo\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.786377 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.786373    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-workload-socket\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.786652 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.786389    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-data\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.786652 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.786410    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-token\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.786652 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.786472    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69jbf\" (UniqueName: \"kubernetes.io/projected/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-kube-api-access-69jbf\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.786652 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.786515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-workload-certs\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.786652 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.786532    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istiod-ca-cert\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.786652 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.786569    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-credential-socket\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.786652 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.786612    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-envoy\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.887010 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.886970    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-podinfo\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.887010 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.887013    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-workload-socket\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.887237 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.887031    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-data\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.887237 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.887062    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-token\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.887237 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.887093    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69jbf\" (UniqueName: \"kubernetes.io/projected/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-kube-api-access-69jbf\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.887237 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.887120    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-workload-certs\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.887237 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.887142    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istiod-ca-cert\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.887237 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.887185    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-credential-socket\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.887660 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.887627    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-data\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.887856 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.887687    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-workload-socket\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.887856 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.887689    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-envoy\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.887856 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.887730    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-credential-socket\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.887856 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.887754    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-workload-certs\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.888043 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.888004    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istiod-ca-cert\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.889688 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.889663    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-envoy\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.889784 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.889733    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-podinfo\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.894672 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.894650    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-token\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:36.894806 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:36.894789    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69jbf\" (UniqueName: \"kubernetes.io/projected/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-kube-api-access-69jbf\") pod \"e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") " pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:37.032252 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:37.032217    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:37.171279 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:37.171251    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"]
Jul 08 21:36:37.173929 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:36:37.173893    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9b2514_9dac_4911_bbf8_6f8a79549ef0.slice/crio-8944bbb36f54abb80182367ff327844817c9a16021a2477c970ba80f3dca665c WatchSource:0}: Error finding container 8944bbb36f54abb80182367ff327844817c9a16021a2477c970ba80f3dca665c: Status 404 returned error can't find the container with id 8944bbb36f54abb80182367ff327844817c9a16021a2477c970ba80f3dca665c
Jul 08 21:36:37.176482 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:37.176443    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:36:37.176582 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:37.176515    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:36:37.176582 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:37.176544    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:36:38.138021 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:38.137990    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x" event={"ID":"7a9b2514-9dac-4911-bbf8-6f8a79549ef0","Type":"ContainerStarted","Data":"ace6a2c6e3e653e984214c3fdbc1554004df2f63db8cb48648da44f5eb692a38"}
Jul 08 21:36:38.138516 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:38.138052    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x" event={"ID":"7a9b2514-9dac-4911-bbf8-6f8a79549ef0","Type":"ContainerStarted","Data":"8944bbb36f54abb80182367ff327844817c9a16021a2477c970ba80f3dca665c"}
Jul 08 21:36:38.160038 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:38.159989    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x" podStartSLOduration=2.159972493 podStartE2EDuration="2.159972493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:36:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:36:38.157020898 +0000 UTC m=+1821.250824445" watchObservedRunningTime="2026-07-08 21:36:38.159972493 +0000 UTC m=+1821.253776040"
Jul 08 21:36:39.032740 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:39.032707    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:39.037551 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:39.037530    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:39.142827 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:39.142794    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:39.143785 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:39.143768    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:40.212918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:40.212885    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"]
Jul 08 21:36:40.216383 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:40.216362    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"
Jul 08 21:36:40.218773 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:40.218753    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-0483db97-serving-cert\""
Jul 08 21:36:40.228146 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:40.228126    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"]
Jul 08 21:36:40.318940 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:40.318911    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkcs5\" (UniqueName: \"kubernetes.io/projected/f5be05da-9638-4c94-8e89-53eab95c9ea4-kube-api-access-tkcs5\") pod \"maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8\" (UID: \"f5be05da-9638-4c94-8e89-53eab95c9ea4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"
Jul 08 21:36:40.319120 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:40.319038    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5be05da-9638-4c94-8e89-53eab95c9ea4-maas-api-tls\") pod \"maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8\" (UID: \"f5be05da-9638-4c94-8e89-53eab95c9ea4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"
Jul 08 21:36:40.319120 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:40.319082    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5be05da-9638-4c94-8e89-53eab95c9ea4-openshift-service-ca\") pod \"maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8\" (UID: \"f5be05da-9638-4c94-8e89-53eab95c9ea4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"
Jul 08 21:36:40.420533 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:40.420495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5be05da-9638-4c94-8e89-53eab95c9ea4-openshift-service-ca\") pod \"maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8\" (UID: \"f5be05da-9638-4c94-8e89-53eab95c9ea4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"
Jul 08 21:36:40.420744 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:40.420563    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkcs5\" (UniqueName: \"kubernetes.io/projected/f5be05da-9638-4c94-8e89-53eab95c9ea4-kube-api-access-tkcs5\") pod \"maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8\" (UID: \"f5be05da-9638-4c94-8e89-53eab95c9ea4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"
Jul 08 21:36:40.420744 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:40.420645    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5be05da-9638-4c94-8e89-53eab95c9ea4-maas-api-tls\") pod \"maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8\" (UID: \"f5be05da-9638-4c94-8e89-53eab95c9ea4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"
Jul 08 21:36:40.420862 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:36:40.420748    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-serving-cert: secret "maas-api-e2e-mt-0483db97-serving-cert" not found
Jul 08 21:36:40.420862 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:36:40.420815    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5be05da-9638-4c94-8e89-53eab95c9ea4-maas-api-tls podName:f5be05da-9638-4c94-8e89-53eab95c9ea4 nodeName:}" failed. No retries permitted until 2026-07-08 21:36:40.92079419 +0000 UTC m=+1824.014597717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f5be05da-9638-4c94-8e89-53eab95c9ea4-maas-api-tls") pod "maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8" (UID: "f5be05da-9638-4c94-8e89-53eab95c9ea4") : secret "maas-api-e2e-mt-0483db97-serving-cert" not found
Jul 08 21:36:40.421229 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:40.421208    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5be05da-9638-4c94-8e89-53eab95c9ea4-openshift-service-ca\") pod \"maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8\" (UID: \"f5be05da-9638-4c94-8e89-53eab95c9ea4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"
Jul 08 21:36:40.430935 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:40.430906    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkcs5\" (UniqueName: \"kubernetes.io/projected/f5be05da-9638-4c94-8e89-53eab95c9ea4-kube-api-access-tkcs5\") pod \"maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8\" (UID: \"f5be05da-9638-4c94-8e89-53eab95c9ea4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"
Jul 08 21:36:40.924387 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:40.924350    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5be05da-9638-4c94-8e89-53eab95c9ea4-maas-api-tls\") pod \"maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8\" (UID: \"f5be05da-9638-4c94-8e89-53eab95c9ea4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"
Jul 08 21:36:40.926767 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:40.926740    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5be05da-9638-4c94-8e89-53eab95c9ea4-maas-api-tls\") pod \"maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8\" (UID: \"f5be05da-9638-4c94-8e89-53eab95c9ea4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"
Jul 08 21:36:41.127481 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:41.127443    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"
Jul 08 21:36:41.263502 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:41.263473    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"]
Jul 08 21:36:41.265250 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:36:41.265218    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5be05da_9638_4c94_8e89_53eab95c9ea4.slice/crio-d415a9a40f461ffbe881b77d4c9f81ac44c0b199f65cf3ff4a96845d6620579a WatchSource:0}: Error finding container d415a9a40f461ffbe881b77d4c9f81ac44c0b199f65cf3ff4a96845d6620579a: Status 404 returned error can't find the container with id d415a9a40f461ffbe881b77d4c9f81ac44c0b199f65cf3ff4a96845d6620579a
Jul 08 21:36:42.162537 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:42.162500    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8" event={"ID":"f5be05da-9638-4c94-8e89-53eab95c9ea4","Type":"ContainerStarted","Data":"d415a9a40f461ffbe881b77d4c9f81ac44c0b199f65cf3ff4a96845d6620579a"}
Jul 08 21:36:43.169362 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:43.169331    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8" event={"ID":"f5be05da-9638-4c94-8e89-53eab95c9ea4","Type":"ContainerStarted","Data":"b0fef0f774d4a46af7bca8ae77664eaa6f12145826b1f91d9288a14c14455fd8"}
Jul 08 21:36:43.169764 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:43.169444    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"
Jul 08 21:36:43.186694 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:43.186650    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8" podStartSLOduration=2.312678645 podStartE2EDuration="3.186638452s" totalImagesPullingTime="873.959807ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:36:43.184711731 +0000 UTC m=+1826.278515338" watchObservedRunningTime="2026-07-08 21:36:43.186638452 +0000 UTC m=+1826.280442000"
Jul 08 21:36:49.184387 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:49.184351    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"
Jul 08 21:36:52.229287 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:52.229254    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"]
Jul 08 21:36:52.229765 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:52.229689    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8" podUID="f5be05da-9638-4c94-8e89-53eab95c9ea4" containerName="maas-api" containerID="cri-o://b0fef0f774d4a46af7bca8ae77664eaa6f12145826b1f91d9288a14c14455fd8" gracePeriod=30
Jul 08 21:36:52.480924 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:52.480862    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"
Jul 08 21:36:52.528349 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:52.528318    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5be05da-9638-4c94-8e89-53eab95c9ea4-maas-api-tls\") pod \"f5be05da-9638-4c94-8e89-53eab95c9ea4\" (UID: \"f5be05da-9638-4c94-8e89-53eab95c9ea4\") "
Jul 08 21:36:52.528479 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:52.528384    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5be05da-9638-4c94-8e89-53eab95c9ea4-openshift-service-ca\") pod \"f5be05da-9638-4c94-8e89-53eab95c9ea4\" (UID: \"f5be05da-9638-4c94-8e89-53eab95c9ea4\") "
Jul 08 21:36:52.528479 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:52.528442    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkcs5\" (UniqueName: \"kubernetes.io/projected/f5be05da-9638-4c94-8e89-53eab95c9ea4-kube-api-access-tkcs5\") pod \"f5be05da-9638-4c94-8e89-53eab95c9ea4\" (UID: \"f5be05da-9638-4c94-8e89-53eab95c9ea4\") "
Jul 08 21:36:52.528815 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:52.528779    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5be05da-9638-4c94-8e89-53eab95c9ea4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f5be05da-9638-4c94-8e89-53eab95c9ea4" (UID: "f5be05da-9638-4c94-8e89-53eab95c9ea4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:36:52.530617 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:52.530576    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5be05da-9638-4c94-8e89-53eab95c9ea4-kube-api-access-tkcs5" (OuterVolumeSpecName: "kube-api-access-tkcs5") pod "f5be05da-9638-4c94-8e89-53eab95c9ea4" (UID: "f5be05da-9638-4c94-8e89-53eab95c9ea4"). InnerVolumeSpecName "kube-api-access-tkcs5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:36:52.530617 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:52.530602    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5be05da-9638-4c94-8e89-53eab95c9ea4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f5be05da-9638-4c94-8e89-53eab95c9ea4" (UID: "f5be05da-9638-4c94-8e89-53eab95c9ea4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:36:52.629334 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:52.629293    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5be05da-9638-4c94-8e89-53eab95c9ea4-maas-api-tls\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:36:52.629334 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:52.629317    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5be05da-9638-4c94-8e89-53eab95c9ea4-openshift-service-ca\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:36:52.629334 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:52.629327    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkcs5\" (UniqueName: \"kubernetes.io/projected/f5be05da-9638-4c94-8e89-53eab95c9ea4-kube-api-access-tkcs5\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:36:53.225205 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:53.225116    2583 generic.go:356] "Generic (PLEG): container finished" podID="f5be05da-9638-4c94-8e89-53eab95c9ea4" containerID="b0fef0f774d4a46af7bca8ae77664eaa6f12145826b1f91d9288a14c14455fd8" exitCode=0
Jul 08 21:36:53.225205 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:53.225160    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"
Jul 08 21:36:53.225477 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:53.225201    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8" event={"ID":"f5be05da-9638-4c94-8e89-53eab95c9ea4","Type":"ContainerDied","Data":"b0fef0f774d4a46af7bca8ae77664eaa6f12145826b1f91d9288a14c14455fd8"}
Jul 08 21:36:53.225477 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:53.225251    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8" event={"ID":"f5be05da-9638-4c94-8e89-53eab95c9ea4","Type":"ContainerDied","Data":"d415a9a40f461ffbe881b77d4c9f81ac44c0b199f65cf3ff4a96845d6620579a"}
Jul 08 21:36:53.225477 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:53.225278    2583 scope.go:117] "RemoveContainer" containerID="b0fef0f774d4a46af7bca8ae77664eaa6f12145826b1f91d9288a14c14455fd8"
Jul 08 21:36:53.227025 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:53.227003    2583 generic.go:356] "Generic (PLEG): container finished" podID="7a9b2514-9dac-4911-bbf8-6f8a79549ef0" containerID="ace6a2c6e3e653e984214c3fdbc1554004df2f63db8cb48648da44f5eb692a38" exitCode=0
Jul 08 21:36:53.227157 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:53.227075    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x" event={"ID":"7a9b2514-9dac-4911-bbf8-6f8a79549ef0","Type":"ContainerDied","Data":"ace6a2c6e3e653e984214c3fdbc1554004df2f63db8cb48648da44f5eb692a38"}
Jul 08 21:36:53.227423 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:53.227407    2583 scope.go:117] "RemoveContainer" containerID="ace6a2c6e3e653e984214c3fdbc1554004df2f63db8cb48648da44f5eb692a38"
Jul 08 21:36:53.228473 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:53.228438    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:36:53.228567 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:53.228535    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:36:53.228641 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:53.228602    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:36:53.237222 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:53.237206    2583 scope.go:117] "RemoveContainer" containerID="b0fef0f774d4a46af7bca8ae77664eaa6f12145826b1f91d9288a14c14455fd8"
Jul 08 21:36:53.237483 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:36:53.237450    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0fef0f774d4a46af7bca8ae77664eaa6f12145826b1f91d9288a14c14455fd8\": container with ID starting with b0fef0f774d4a46af7bca8ae77664eaa6f12145826b1f91d9288a14c14455fd8 not found: ID does not exist" containerID="b0fef0f774d4a46af7bca8ae77664eaa6f12145826b1f91d9288a14c14455fd8"
Jul 08 21:36:53.237483 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:53.237474    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0fef0f774d4a46af7bca8ae77664eaa6f12145826b1f91d9288a14c14455fd8"} err="failed to get container status \"b0fef0f774d4a46af7bca8ae77664eaa6f12145826b1f91d9288a14c14455fd8\": rpc error: code = NotFound desc = could not find container \"b0fef0f774d4a46af7bca8ae77664eaa6f12145826b1f91d9288a14c14455fd8\": container with ID starting with b0fef0f774d4a46af7bca8ae77664eaa6f12145826b1f91d9288a14c14455fd8 not found: ID does not exist"
Jul 08 21:36:53.300043 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:53.300017    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"]
Jul 08 21:36:53.315098 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:53.315075    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0483db97-f7dfb65df-g2hh8"]
Jul 08 21:36:53.430622 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:53.430566    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5be05da-9638-4c94-8e89-53eab95c9ea4" path="/var/lib/kubelet/pods/f5be05da-9638-4c94-8e89-53eab95c9ea4/volumes"
Jul 08 21:36:54.143676 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:54.143645    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:54.234601 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:54.234564    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x" event={"ID":"7a9b2514-9dac-4911-bbf8-6f8a79549ef0","Type":"ContainerStarted","Data":"c0c83a75b09a97c0ffc0c21145689c4c9f2dd4aec482d6521ee5dee36152fa58"}
Jul 08 21:36:55.032528 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:55.032489    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:36:55.033674 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:55.033652    2583 patch_prober.go:28] interesting pod/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 08 21:36:55.033785 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:55.033697    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x" podUID="7a9b2514-9dac-4911-bbf8-6f8a79549ef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 08 21:36:56.032854 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:56.032810    2583 patch_prober.go:28] interesting pod/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 08 21:36:56.033349 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:56.032874    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x" podUID="7a9b2514-9dac-4911-bbf8-6f8a79549ef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 08 21:36:57.032776 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:57.032741    2583 patch_prober.go:28] interesting pod/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 08 21:36:57.032955 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:57.032793    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x" podUID="7a9b2514-9dac-4911-bbf8-6f8a79549ef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 08 21:36:58.033448 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:58.033406    2583 patch_prober.go:28] interesting pod/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 08 21:36:58.033850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:58.033470    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x" podUID="7a9b2514-9dac-4911-bbf8-6f8a79549ef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 08 21:36:58.386607 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:58.386520    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"]
Jul 08 21:36:58.386740 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:36:58.386720    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x" podUID="7a9b2514-9dac-4911-bbf8-6f8a79549ef0" containerName="istio-proxy" containerID="cri-o://c0c83a75b09a97c0ffc0c21145689c4c9f2dd4aec482d6521ee5dee36152fa58" gracePeriod=30
Jul 08 21:37:03.639188 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.639160    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:37:03.734159 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.734050    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istiod-ca-cert\") pod \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") "
Jul 08 21:37:03.734159 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.734128    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-data\") pod \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") "
Jul 08 21:37:03.734386 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.734163    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-workload-socket\") pod \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") "
Jul 08 21:37:03.734386 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.734212    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-credential-socket\") pod \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") "
Jul 08 21:37:03.734386 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.734240    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69jbf\" (UniqueName: \"kubernetes.io/projected/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-kube-api-access-69jbf\") pod \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") "
Jul 08 21:37:03.734386 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.734265    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-envoy\") pod \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") "
Jul 08 21:37:03.734386 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.734308    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-workload-certs\") pod \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") "
Jul 08 21:37:03.734386 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.734366    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-podinfo\") pod \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") "
Jul 08 21:37:03.734714 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.734404    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-token\") pod \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\" (UID: \"7a9b2514-9dac-4911-bbf8-6f8a79549ef0\") "
Jul 08 21:37:03.734714 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.734453    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7a9b2514-9dac-4911-bbf8-6f8a79549ef0" (UID: "7a9b2514-9dac-4911-bbf8-6f8a79549ef0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:37:03.734714 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.734616    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7a9b2514-9dac-4911-bbf8-6f8a79549ef0" (UID: "7a9b2514-9dac-4911-bbf8-6f8a79549ef0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:37:03.734714 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.734637    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7a9b2514-9dac-4911-bbf8-6f8a79549ef0" (UID: "7a9b2514-9dac-4911-bbf8-6f8a79549ef0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:37:03.734714 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.734651    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7a9b2514-9dac-4911-bbf8-6f8a79549ef0" (UID: "7a9b2514-9dac-4911-bbf8-6f8a79549ef0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:37:03.734954 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.734727    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:37:03.734954 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.734740    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:37:03.734954 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.734749    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:37:03.734954 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.734757    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:37:03.735115 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.735091    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-data" (OuterVolumeSpecName: "istio-data") pod "7a9b2514-9dac-4911-bbf8-6f8a79549ef0" (UID: "7a9b2514-9dac-4911-bbf8-6f8a79549ef0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:37:03.736937 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.736910    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a9b2514-9dac-4911-bbf8-6f8a79549ef0" (UID: "7a9b2514-9dac-4911-bbf8-6f8a79549ef0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:37:03.737039 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.736937    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-kube-api-access-69jbf" (OuterVolumeSpecName: "kube-api-access-69jbf") pod "7a9b2514-9dac-4911-bbf8-6f8a79549ef0" (UID: "7a9b2514-9dac-4911-bbf8-6f8a79549ef0"). InnerVolumeSpecName "kube-api-access-69jbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:37:03.737112 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.737037    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7a9b2514-9dac-4911-bbf8-6f8a79549ef0" (UID: "7a9b2514-9dac-4911-bbf8-6f8a79549ef0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:37:03.737112 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.737059    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7a9b2514-9dac-4911-bbf8-6f8a79549ef0" (UID: "7a9b2514-9dac-4911-bbf8-6f8a79549ef0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 21:37:03.836020 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.835984    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:37:03.836020 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.836014    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69jbf\" (UniqueName: \"kubernetes.io/projected/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-kube-api-access-69jbf\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:37:03.836020 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.836030    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:37:03.836248 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.836041    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:37:03.836248 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:03.836051    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a9b2514-9dac-4911-bbf8-6f8a79549ef0-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:37:04.283039 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:04.283005    2583 generic.go:356] "Generic (PLEG): container finished" podID="7a9b2514-9dac-4911-bbf8-6f8a79549ef0" containerID="c0c83a75b09a97c0ffc0c21145689c4c9f2dd4aec482d6521ee5dee36152fa58" exitCode=0
Jul 08 21:37:04.283203 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:04.283055    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"
Jul 08 21:37:04.283203 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:04.283090    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x" event={"ID":"7a9b2514-9dac-4911-bbf8-6f8a79549ef0","Type":"ContainerDied","Data":"c0c83a75b09a97c0ffc0c21145689c4c9f2dd4aec482d6521ee5dee36152fa58"}
Jul 08 21:37:04.283203 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:04.283163    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x" event={"ID":"7a9b2514-9dac-4911-bbf8-6f8a79549ef0","Type":"ContainerDied","Data":"8944bbb36f54abb80182367ff327844817c9a16021a2477c970ba80f3dca665c"}
Jul 08 21:37:04.283203 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:04.283187    2583 scope.go:117] "RemoveContainer" containerID="c0c83a75b09a97c0ffc0c21145689c4c9f2dd4aec482d6521ee5dee36152fa58"
Jul 08 21:37:04.293617 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:04.293598    2583 scope.go:117] "RemoveContainer" containerID="ace6a2c6e3e653e984214c3fdbc1554004df2f63db8cb48648da44f5eb692a38"
Jul 08 21:37:04.301288 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:04.301268    2583 scope.go:117] "RemoveContainer" containerID="c0c83a75b09a97c0ffc0c21145689c4c9f2dd4aec482d6521ee5dee36152fa58"
Jul 08 21:37:04.301509 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:37:04.301490    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0c83a75b09a97c0ffc0c21145689c4c9f2dd4aec482d6521ee5dee36152fa58\": container with ID starting with c0c83a75b09a97c0ffc0c21145689c4c9f2dd4aec482d6521ee5dee36152fa58 not found: ID does not exist" containerID="c0c83a75b09a97c0ffc0c21145689c4c9f2dd4aec482d6521ee5dee36152fa58"
Jul 08 21:37:04.301556 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:04.301517    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c83a75b09a97c0ffc0c21145689c4c9f2dd4aec482d6521ee5dee36152fa58"} err="failed to get container status \"c0c83a75b09a97c0ffc0c21145689c4c9f2dd4aec482d6521ee5dee36152fa58\": rpc error: code = NotFound desc = could not find container \"c0c83a75b09a97c0ffc0c21145689c4c9f2dd4aec482d6521ee5dee36152fa58\": container with ID starting with c0c83a75b09a97c0ffc0c21145689c4c9f2dd4aec482d6521ee5dee36152fa58 not found: ID does not exist"
Jul 08 21:37:04.301556 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:04.301533    2583 scope.go:117] "RemoveContainer" containerID="ace6a2c6e3e653e984214c3fdbc1554004df2f63db8cb48648da44f5eb692a38"
Jul 08 21:37:04.301752 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:37:04.301735    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ace6a2c6e3e653e984214c3fdbc1554004df2f63db8cb48648da44f5eb692a38\": container with ID starting with ace6a2c6e3e653e984214c3fdbc1554004df2f63db8cb48648da44f5eb692a38 not found: ID does not exist" containerID="ace6a2c6e3e653e984214c3fdbc1554004df2f63db8cb48648da44f5eb692a38"
Jul 08 21:37:04.301797 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:04.301757    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ace6a2c6e3e653e984214c3fdbc1554004df2f63db8cb48648da44f5eb692a38"} err="failed to get container status \"ace6a2c6e3e653e984214c3fdbc1554004df2f63db8cb48648da44f5eb692a38\": rpc error: code = NotFound desc = could not find container \"ace6a2c6e3e653e984214c3fdbc1554004df2f63db8cb48648da44f5eb692a38\": container with ID starting with ace6a2c6e3e653e984214c3fdbc1554004df2f63db8cb48648da44f5eb692a38 not found: ID does not exist"
Jul 08 21:37:04.306811 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:04.306790    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"]
Jul 08 21:37:04.310078 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:04.310057    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0483db97-openshift-default-b6799bd7f-bh59x"]
Jul 08 21:37:05.430260 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:05.430229    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a9b2514-9dac-4911-bbf8-6f8a79549ef0" path="/var/lib/kubelet/pods/7a9b2514-9dac-4911-bbf8-6f8a79549ef0/volumes"
Jul 08 21:37:18.073371 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.073318    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"]
Jul 08 21:37:18.073859 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.073842    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9b2514-9dac-4911-bbf8-6f8a79549ef0" containerName="istio-proxy"
Jul 08 21:37:18.073909 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.073864    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9b2514-9dac-4911-bbf8-6f8a79549ef0" containerName="istio-proxy"
Jul 08 21:37:18.073909 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.073898    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9b2514-9dac-4911-bbf8-6f8a79549ef0" containerName="istio-proxy"
Jul 08 21:37:18.073974 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.073908    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9b2514-9dac-4911-bbf8-6f8a79549ef0" containerName="istio-proxy"
Jul 08 21:37:18.073974 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.073919    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5be05da-9638-4c94-8e89-53eab95c9ea4" containerName="maas-api"
Jul 08 21:37:18.073974 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.073929    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5be05da-9638-4c94-8e89-53eab95c9ea4" containerName="maas-api"
Jul 08 21:37:18.074081 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.074017    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a9b2514-9dac-4911-bbf8-6f8a79549ef0" containerName="istio-proxy"
Jul 08 21:37:18.074081 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.074033    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5be05da-9638-4c94-8e89-53eab95c9ea4" containerName="maas-api"
Jul 08 21:37:18.077431 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.077411    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.079853 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.079833    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b837af85-openshift-default-dockercfg-l28cl\""
Jul 08 21:37:18.090054 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.090029    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"]
Jul 08 21:37:18.160354 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.160308    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-credential-socket\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.160354 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.160351    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-istio-envoy\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.160623 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.160381    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-workload-socket\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.160623 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.160408    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-istio-data\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.160623 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.160444    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-workload-certs\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.160623 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.160459    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9175b512-8f94-45e2-b4d6-871927fae02d-istio-token\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.160623 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.160489    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9175b512-8f94-45e2-b4d6-871927fae02d-istio-podinfo\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.160623 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.160527    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9175b512-8f94-45e2-b4d6-871927fae02d-istiod-ca-cert\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.160623 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.160559    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs6wh\" (UniqueName: \"kubernetes.io/projected/9175b512-8f94-45e2-b4d6-871927fae02d-kube-api-access-bs6wh\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.261305 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.261268    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-istio-envoy\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.261305 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.261310    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-workload-socket\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.261533 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.261330    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-istio-data\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.261533 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.261464    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-workload-certs\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.261533 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.261501    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9175b512-8f94-45e2-b4d6-871927fae02d-istio-token\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.261712 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.261542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9175b512-8f94-45e2-b4d6-871927fae02d-istio-podinfo\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.261712 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.261575    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9175b512-8f94-45e2-b4d6-871927fae02d-istiod-ca-cert\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.261815 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.261715    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-istio-data\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.261815 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.261739    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs6wh\" (UniqueName: \"kubernetes.io/projected/9175b512-8f94-45e2-b4d6-871927fae02d-kube-api-access-bs6wh\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.261815 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.261799    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-workload-socket\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.261974 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.261836    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-credential-socket\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.261974 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.261887    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-workload-certs\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.262147 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.262115    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-credential-socket\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.262236 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.262223    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9175b512-8f94-45e2-b4d6-871927fae02d-istiod-ca-cert\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.263706 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.263689    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-istio-envoy\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.263978 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.263960    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9175b512-8f94-45e2-b4d6-871927fae02d-istio-podinfo\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.269692 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.269668    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9175b512-8f94-45e2-b4d6-871927fae02d-istio-token\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.270155 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.270131    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs6wh\" (UniqueName: \"kubernetes.io/projected/9175b512-8f94-45e2-b4d6-871927fae02d-kube-api-access-bs6wh\") pod \"e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") " pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.387522 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.387427    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:18.517156 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.517132    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"]
Jul 08 21:37:18.519002 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:37:18.518974    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9175b512_8f94_45e2_b4d6_871927fae02d.slice/crio-cd916f826cb572eaea78741d39dd53eba091688f338a72d14b6774e9dfe44932 WatchSource:0}: Error finding container cd916f826cb572eaea78741d39dd53eba091688f338a72d14b6774e9dfe44932: Status 404 returned error can't find the container with id cd916f826cb572eaea78741d39dd53eba091688f338a72d14b6774e9dfe44932
Jul 08 21:37:18.521176 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.521141    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:37:18.521290 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.521227    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:37:18.521290 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:18.521273    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:37:19.353931 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:19.353896    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h" event={"ID":"9175b512-8f94-45e2-b4d6-871927fae02d","Type":"ContainerStarted","Data":"e39e4e4530ef70ec2cd9fef4be3f09e4478fa2e55565bed9b4e6c0b79b2f9498"}
Jul 08 21:37:19.354365 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:19.353958    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h" event={"ID":"9175b512-8f94-45e2-b4d6-871927fae02d","Type":"ContainerStarted","Data":"cd916f826cb572eaea78741d39dd53eba091688f338a72d14b6774e9dfe44932"}
Jul 08 21:37:19.374057 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:19.374004    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h" podStartSLOduration=1.373987727 podStartE2EDuration="1.373987727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:37:19.37228921 +0000 UTC m=+1862.466092811" watchObservedRunningTime="2026-07-08 21:37:19.373987727 +0000 UTC m=+1862.467791274"
Jul 08 21:37:19.388097 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:19.388060    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:19.392842 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:19.392818    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:20.359605 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:20.359554    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:20.360449 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:20.360430    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:21.617125 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:21.617087    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"]
Jul 08 21:37:21.617621 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:21.617604    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a9b2514-9dac-4911-bbf8-6f8a79549ef0" containerName="istio-proxy"
Jul 08 21:37:21.619697 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:21.619680    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"
Jul 08 21:37:21.621973 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:21.621956    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b837af85-serving-cert\""
Jul 08 21:37:21.630571 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:21.630544    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"]
Jul 08 21:37:21.793963 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:21.793923    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z6mc\" (UniqueName: \"kubernetes.io/projected/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-kube-api-access-5z6mc\") pod \"maas-api-e2e-mt-b837af85-8677c777d4-8v57l\" (UID: \"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"
Jul 08 21:37:21.793963 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:21.793981    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-maas-api-tls\") pod \"maas-api-e2e-mt-b837af85-8677c777d4-8v57l\" (UID: \"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"
Jul 08 21:37:21.794222 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:21.794083    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-openshift-service-ca\") pod \"maas-api-e2e-mt-b837af85-8677c777d4-8v57l\" (UID: \"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"
Jul 08 21:37:21.894870 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:21.894781    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-openshift-service-ca\") pod \"maas-api-e2e-mt-b837af85-8677c777d4-8v57l\" (UID: \"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"
Jul 08 21:37:21.894870 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:21.894825    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z6mc\" (UniqueName: \"kubernetes.io/projected/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-kube-api-access-5z6mc\") pod \"maas-api-e2e-mt-b837af85-8677c777d4-8v57l\" (UID: \"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"
Jul 08 21:37:21.894870 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:21.894865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-maas-api-tls\") pod \"maas-api-e2e-mt-b837af85-8677c777d4-8v57l\" (UID: \"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"
Jul 08 21:37:21.895464 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:21.895440    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-openshift-service-ca\") pod \"maas-api-e2e-mt-b837af85-8677c777d4-8v57l\" (UID: \"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"
Jul 08 21:37:21.897349 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:21.897325    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-maas-api-tls\") pod \"maas-api-e2e-mt-b837af85-8677c777d4-8v57l\" (UID: \"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"
Jul 08 21:37:21.903053 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:21.903025    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z6mc\" (UniqueName: \"kubernetes.io/projected/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-kube-api-access-5z6mc\") pod \"maas-api-e2e-mt-b837af85-8677c777d4-8v57l\" (UID: \"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"
Jul 08 21:37:21.932050 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:21.932018    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"
Jul 08 21:37:22.066833 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:22.066804    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"]
Jul 08 21:37:22.069425 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:37:22.069392    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ea3bbc_ff9b_4bfe_a8ad_57979a6cffdc.slice/crio-bdaf72fcb137f2615dc6e42c0a0428d941739d3c8f78e0696e8435711ae7f320 WatchSource:0}: Error finding container bdaf72fcb137f2615dc6e42c0a0428d941739d3c8f78e0696e8435711ae7f320: Status 404 returned error can't find the container with id bdaf72fcb137f2615dc6e42c0a0428d941739d3c8f78e0696e8435711ae7f320
Jul 08 21:37:22.371020 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:22.370979    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l" event={"ID":"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc","Type":"ContainerStarted","Data":"bdaf72fcb137f2615dc6e42c0a0428d941739d3c8f78e0696e8435711ae7f320"}
Jul 08 21:37:23.377517 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:23.377484    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l" event={"ID":"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc","Type":"ContainerStarted","Data":"1d38163c2787d65c8323eb1d30d5f64750b2733595afc3932bddc96c379cdd88"}
Jul 08 21:37:23.377951 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:23.377624    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"
Jul 08 21:37:23.393215 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:23.393168    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l" podStartSLOduration=1.948677479 podStartE2EDuration="2.393155165s" totalImagesPullingTime="444.477686ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:37:23.392249735 +0000 UTC m=+1866.486053282" watchObservedRunningTime="2026-07-08 21:37:23.393155165 +0000 UTC m=+1866.486958711"
Jul 08 21:37:29.388887 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:29.388855    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"
Jul 08 21:37:34.433349 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:34.433317    2583 generic.go:356] "Generic (PLEG): container finished" podID="9175b512-8f94-45e2-b4d6-871927fae02d" containerID="e39e4e4530ef70ec2cd9fef4be3f09e4478fa2e55565bed9b4e6c0b79b2f9498" exitCode=0
Jul 08 21:37:34.433815 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:34.433391    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h" event={"ID":"9175b512-8f94-45e2-b4d6-871927fae02d","Type":"ContainerDied","Data":"e39e4e4530ef70ec2cd9fef4be3f09e4478fa2e55565bed9b4e6c0b79b2f9498"}
Jul 08 21:37:34.433815 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:34.433774    2583 scope.go:117] "RemoveContainer" containerID="e39e4e4530ef70ec2cd9fef4be3f09e4478fa2e55565bed9b4e6c0b79b2f9498"
Jul 08 21:37:34.437181 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:34.437149    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:37:34.437294 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:34.437235    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:37:34.437294 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:34.437280    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:37:35.359825 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:35.359782    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:35.439598 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:35.439564    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h" event={"ID":"9175b512-8f94-45e2-b4d6-871927fae02d","Type":"ContainerStarted","Data":"073a71ac27b5d5a3f486d3a6414e4f80e835b06c7c033564b8ef3ec4bfd166a0"}
Jul 08 21:37:36.388051 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:36.388016    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:36.388977 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:36.388950    2583 patch_prober.go:28] interesting pod/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 08 21:37:36.389097 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:36.389032    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h" podUID="9175b512-8f94-45e2-b4d6-871927fae02d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 08 21:37:37.387964 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:37.387929    2583 patch_prober.go:28] interesting pod/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 08 21:37:37.388347 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:37.388014    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h" podUID="9175b512-8f94-45e2-b4d6-871927fae02d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 08 21:37:38.388095 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:38.388059    2583 patch_prober.go:28] interesting pod/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 08 21:37:38.388485 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:38.388113    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h" podUID="9175b512-8f94-45e2-b4d6-871927fae02d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 08 21:37:39.391324 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:39.391293    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:39.391771 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:39.391544    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:39.392226 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:39.392210    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:37:54.496062 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:54.496033    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"]
Jul 08 21:37:54.496667 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:54.496240    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l" podUID="20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc" containerName="maas-api" containerID="cri-o://1d38163c2787d65c8323eb1d30d5f64750b2733595afc3932bddc96c379cdd88" gracePeriod=30
Jul 08 21:37:54.742302 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:54.742276    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"
Jul 08 21:37:54.813010 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:54.812979    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5z6mc\" (UniqueName: \"kubernetes.io/projected/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-kube-api-access-5z6mc\") pod \"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc\" (UID: \"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc\") "
Jul 08 21:37:54.813180 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:54.813062    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-openshift-service-ca\") pod \"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc\" (UID: \"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc\") "
Jul 08 21:37:54.813180 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:54.813122    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-maas-api-tls\") pod \"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc\" (UID: \"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc\") "
Jul 08 21:37:54.813509 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:54.813481    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc" (UID: "20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:37:54.815105 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:54.815081    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-kube-api-access-5z6mc" (OuterVolumeSpecName: "kube-api-access-5z6mc") pod "20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc" (UID: "20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc"). InnerVolumeSpecName "kube-api-access-5z6mc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:37:54.815206 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:54.815129    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc" (UID: "20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:37:54.913877 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:54.913848    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-openshift-service-ca\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:37:54.913877 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:54.913873    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-maas-api-tls\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:37:54.913877 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:54.913882    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5z6mc\" (UniqueName: \"kubernetes.io/projected/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc-kube-api-access-5z6mc\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:37:55.531896 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:55.531810    2583 generic.go:356] "Generic (PLEG): container finished" podID="20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc" containerID="1d38163c2787d65c8323eb1d30d5f64750b2733595afc3932bddc96c379cdd88" exitCode=0
Jul 08 21:37:55.531896 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:55.531851    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l" event={"ID":"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc","Type":"ContainerDied","Data":"1d38163c2787d65c8323eb1d30d5f64750b2733595afc3932bddc96c379cdd88"}
Jul 08 21:37:55.532428 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:55.531908    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l" event={"ID":"20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc","Type":"ContainerDied","Data":"bdaf72fcb137f2615dc6e42c0a0428d941739d3c8f78e0696e8435711ae7f320"}
Jul 08 21:37:55.532428 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:55.531857    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"
Jul 08 21:37:55.532428 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:55.531930    2583 scope.go:117] "RemoveContainer" containerID="1d38163c2787d65c8323eb1d30d5f64750b2733595afc3932bddc96c379cdd88"
Jul 08 21:37:55.540781 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:55.540762    2583 scope.go:117] "RemoveContainer" containerID="1d38163c2787d65c8323eb1d30d5f64750b2733595afc3932bddc96c379cdd88"
Jul 08 21:37:55.541090 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:37:55.541072    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d38163c2787d65c8323eb1d30d5f64750b2733595afc3932bddc96c379cdd88\": container with ID starting with 1d38163c2787d65c8323eb1d30d5f64750b2733595afc3932bddc96c379cdd88 not found: ID does not exist" containerID="1d38163c2787d65c8323eb1d30d5f64750b2733595afc3932bddc96c379cdd88"
Jul 08 21:37:55.541139 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:55.541096    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d38163c2787d65c8323eb1d30d5f64750b2733595afc3932bddc96c379cdd88"} err="failed to get container status \"1d38163c2787d65c8323eb1d30d5f64750b2733595afc3932bddc96c379cdd88\": rpc error: code = NotFound desc = could not find container \"1d38163c2787d65c8323eb1d30d5f64750b2733595afc3932bddc96c379cdd88\": container with ID starting with 1d38163c2787d65c8323eb1d30d5f64750b2733595afc3932bddc96c379cdd88 not found: ID does not exist"
Jul 08 21:37:55.548929 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:55.548897    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"]
Jul 08 21:37:55.552637 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:55.552612    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b837af85-8677c777d4-8v57l"]
Jul 08 21:37:57.430002 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:37:57.429970    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc" path="/var/lib/kubelet/pods/20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc/volumes"
Jul 08 21:38:47.864747 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:47.864709    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"]
Jul 08 21:38:47.865171 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:47.864950    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h" podUID="9175b512-8f94-45e2-b4d6-871927fae02d" containerName="istio-proxy" containerID="cri-o://073a71ac27b5d5a3f486d3a6414e4f80e835b06c7c033564b8ef3ec4bfd166a0" gracePeriod=30
Jul 08 21:38:53.111122 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.111094    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:38:53.214153 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.214062    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-istio-envoy\") pod \"9175b512-8f94-45e2-b4d6-871927fae02d\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") "
Jul 08 21:38:53.214153 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.214112    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bs6wh\" (UniqueName: \"kubernetes.io/projected/9175b512-8f94-45e2-b4d6-871927fae02d-kube-api-access-bs6wh\") pod \"9175b512-8f94-45e2-b4d6-871927fae02d\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") "
Jul 08 21:38:53.214388 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.214159    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-istio-data\") pod \"9175b512-8f94-45e2-b4d6-871927fae02d\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") "
Jul 08 21:38:53.214388 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.214210    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-credential-socket\") pod \"9175b512-8f94-45e2-b4d6-871927fae02d\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") "
Jul 08 21:38:53.214388 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.214240    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-workload-socket\") pod \"9175b512-8f94-45e2-b4d6-871927fae02d\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") "
Jul 08 21:38:53.214388 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.214263    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9175b512-8f94-45e2-b4d6-871927fae02d-istio-token\") pod \"9175b512-8f94-45e2-b4d6-871927fae02d\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") "
Jul 08 21:38:53.214388 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.214314    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9175b512-8f94-45e2-b4d6-871927fae02d-istiod-ca-cert\") pod \"9175b512-8f94-45e2-b4d6-871927fae02d\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") "
Jul 08 21:38:53.214388 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.214344    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-workload-certs\") pod \"9175b512-8f94-45e2-b4d6-871927fae02d\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") "
Jul 08 21:38:53.214738 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.214497    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9175b512-8f94-45e2-b4d6-871927fae02d" (UID: "9175b512-8f94-45e2-b4d6-871927fae02d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:38:53.214738 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.214568    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9175b512-8f94-45e2-b4d6-871927fae02d-istio-podinfo\") pod \"9175b512-8f94-45e2-b4d6-871927fae02d\" (UID: \"9175b512-8f94-45e2-b4d6-871927fae02d\") "
Jul 08 21:38:53.214738 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.214572    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9175b512-8f94-45e2-b4d6-871927fae02d" (UID: "9175b512-8f94-45e2-b4d6-871927fae02d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:38:53.214738 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.214634    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9175b512-8f94-45e2-b4d6-871927fae02d" (UID: "9175b512-8f94-45e2-b4d6-871927fae02d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:38:53.214923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.214793    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9175b512-8f94-45e2-b4d6-871927fae02d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9175b512-8f94-45e2-b4d6-871927fae02d" (UID: "9175b512-8f94-45e2-b4d6-871927fae02d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:38:53.214923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.214902    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:38:53.214923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.214919    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9175b512-8f94-45e2-b4d6-871927fae02d-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:38:53.215078 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.214933    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:38:53.215078 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.214945    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:38:53.215193 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.215171    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-istio-data" (OuterVolumeSpecName: "istio-data") pod "9175b512-8f94-45e2-b4d6-871927fae02d" (UID: "9175b512-8f94-45e2-b4d6-871927fae02d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:38:53.216427 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.216401    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9175b512-8f94-45e2-b4d6-871927fae02d-kube-api-access-bs6wh" (OuterVolumeSpecName: "kube-api-access-bs6wh") pod "9175b512-8f94-45e2-b4d6-871927fae02d" (UID: "9175b512-8f94-45e2-b4d6-871927fae02d"). InnerVolumeSpecName "kube-api-access-bs6wh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:38:53.216547 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.216449    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9175b512-8f94-45e2-b4d6-871927fae02d" (UID: "9175b512-8f94-45e2-b4d6-871927fae02d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:38:53.216547 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.216524    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9175b512-8f94-45e2-b4d6-871927fae02d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9175b512-8f94-45e2-b4d6-871927fae02d" (UID: "9175b512-8f94-45e2-b4d6-871927fae02d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 21:38:53.216821 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.216799    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9175b512-8f94-45e2-b4d6-871927fae02d-istio-token" (OuterVolumeSpecName: "istio-token") pod "9175b512-8f94-45e2-b4d6-871927fae02d" (UID: "9175b512-8f94-45e2-b4d6-871927fae02d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:38:53.315642 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.315605    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9175b512-8f94-45e2-b4d6-871927fae02d-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:38:53.315642 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.315637    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9175b512-8f94-45e2-b4d6-871927fae02d-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:38:53.315642 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.315649    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:38:53.315881 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.315661    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs6wh\" (UniqueName: \"kubernetes.io/projected/9175b512-8f94-45e2-b4d6-871927fae02d-kube-api-access-bs6wh\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:38:53.315881 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.315673    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9175b512-8f94-45e2-b4d6-871927fae02d-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:38:53.803872 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.803837    2583 generic.go:356] "Generic (PLEG): container finished" podID="9175b512-8f94-45e2-b4d6-871927fae02d" containerID="073a71ac27b5d5a3f486d3a6414e4f80e835b06c7c033564b8ef3ec4bfd166a0" exitCode=0
Jul 08 21:38:53.804064 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.803881    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"
Jul 08 21:38:53.804064 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.803916    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h" event={"ID":"9175b512-8f94-45e2-b4d6-871927fae02d","Type":"ContainerDied","Data":"073a71ac27b5d5a3f486d3a6414e4f80e835b06c7c033564b8ef3ec4bfd166a0"}
Jul 08 21:38:53.804064 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.803970    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h" event={"ID":"9175b512-8f94-45e2-b4d6-871927fae02d","Type":"ContainerDied","Data":"cd916f826cb572eaea78741d39dd53eba091688f338a72d14b6774e9dfe44932"}
Jul 08 21:38:53.804064 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.803992    2583 scope.go:117] "RemoveContainer" containerID="073a71ac27b5d5a3f486d3a6414e4f80e835b06c7c033564b8ef3ec4bfd166a0"
Jul 08 21:38:53.812419 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.812397    2583 scope.go:117] "RemoveContainer" containerID="e39e4e4530ef70ec2cd9fef4be3f09e4478fa2e55565bed9b4e6c0b79b2f9498"
Jul 08 21:38:53.819942 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.819928    2583 scope.go:117] "RemoveContainer" containerID="073a71ac27b5d5a3f486d3a6414e4f80e835b06c7c033564b8ef3ec4bfd166a0"
Jul 08 21:38:53.820223 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:38:53.820198    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"073a71ac27b5d5a3f486d3a6414e4f80e835b06c7c033564b8ef3ec4bfd166a0\": container with ID starting with 073a71ac27b5d5a3f486d3a6414e4f80e835b06c7c033564b8ef3ec4bfd166a0 not found: ID does not exist" containerID="073a71ac27b5d5a3f486d3a6414e4f80e835b06c7c033564b8ef3ec4bfd166a0"
Jul 08 21:38:53.820279 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.820234    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"073a71ac27b5d5a3f486d3a6414e4f80e835b06c7c033564b8ef3ec4bfd166a0"} err="failed to get container status \"073a71ac27b5d5a3f486d3a6414e4f80e835b06c7c033564b8ef3ec4bfd166a0\": rpc error: code = NotFound desc = could not find container \"073a71ac27b5d5a3f486d3a6414e4f80e835b06c7c033564b8ef3ec4bfd166a0\": container with ID starting with 073a71ac27b5d5a3f486d3a6414e4f80e835b06c7c033564b8ef3ec4bfd166a0 not found: ID does not exist"
Jul 08 21:38:53.820279 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.820254    2583 scope.go:117] "RemoveContainer" containerID="e39e4e4530ef70ec2cd9fef4be3f09e4478fa2e55565bed9b4e6c0b79b2f9498"
Jul 08 21:38:53.820485 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:38:53.820467    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e39e4e4530ef70ec2cd9fef4be3f09e4478fa2e55565bed9b4e6c0b79b2f9498\": container with ID starting with e39e4e4530ef70ec2cd9fef4be3f09e4478fa2e55565bed9b4e6c0b79b2f9498 not found: ID does not exist" containerID="e39e4e4530ef70ec2cd9fef4be3f09e4478fa2e55565bed9b4e6c0b79b2f9498"
Jul 08 21:38:53.820536 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.820495    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e39e4e4530ef70ec2cd9fef4be3f09e4478fa2e55565bed9b4e6c0b79b2f9498"} err="failed to get container status \"e39e4e4530ef70ec2cd9fef4be3f09e4478fa2e55565bed9b4e6c0b79b2f9498\": rpc error: code = NotFound desc = could not find container \"e39e4e4530ef70ec2cd9fef4be3f09e4478fa2e55565bed9b4e6c0b79b2f9498\": container with ID starting with e39e4e4530ef70ec2cd9fef4be3f09e4478fa2e55565bed9b4e6c0b79b2f9498 not found: ID does not exist"
Jul 08 21:38:53.825017 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.824995    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"]
Jul 08 21:38:53.829228 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:53.829209    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b837af85-openshift-default-7fc5898675-lqm2h"]
Jul 08 21:38:55.430186 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:38:55.430145    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9175b512-8f94-45e2-b4d6-871927fae02d" path="/var/lib/kubelet/pods/9175b512-8f94-45e2-b4d6-871927fae02d/volumes"
Jul 08 21:39:43.792719 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.792677    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"]
Jul 08 21:39:43.793245 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.793144    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9175b512-8f94-45e2-b4d6-871927fae02d" containerName="istio-proxy"
Jul 08 21:39:43.793245 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.793162    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9175b512-8f94-45e2-b4d6-871927fae02d" containerName="istio-proxy"
Jul 08 21:39:43.793245 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.793186    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc" containerName="maas-api"
Jul 08 21:39:43.793245 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.793194    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc" containerName="maas-api"
Jul 08 21:39:43.793457 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.793289    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9175b512-8f94-45e2-b4d6-871927fae02d" containerName="istio-proxy"
Jul 08 21:39:43.793457 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.793303    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="20ea3bbc-ff9b-4bfe-a8ad-57979a6cffdc" containerName="maas-api"
Jul 08 21:39:43.796356 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.796335    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:43.799795 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.799777    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a8920c-openshift-default-dockercfg-48rjr\""
Jul 08 21:39:43.814047 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.814022    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"]
Jul 08 21:39:43.937632 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.937572    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-workload-socket\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:43.937632 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.937632    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-credential-socket\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:43.937873 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.937654    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-istio-data\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:43.937873 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.937720    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a48c093-00f8-43d6-a927-f326da525bac-istio-podinfo\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:43.937873 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.937765    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-workload-certs\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:43.937873 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.937786    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a48c093-00f8-43d6-a927-f326da525bac-istiod-ca-cert\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:43.938027 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.937881    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-istio-envoy\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:43.938027 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.937920    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a48c093-00f8-43d6-a927-f326da525bac-istio-token\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:43.938027 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:43.937963    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzhpp\" (UniqueName: \"kubernetes.io/projected/5a48c093-00f8-43d6-a927-f326da525bac-kube-api-access-dzhpp\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.039105 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.039072    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-workload-socket\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.039105 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.039107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-credential-socket\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.039344 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.039122    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-istio-data\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.039344 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.039145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a48c093-00f8-43d6-a927-f326da525bac-istio-podinfo\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.039344 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.039179    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-workload-certs\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.039344 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.039208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a48c093-00f8-43d6-a927-f326da525bac-istiod-ca-cert\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.039344 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.039256    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-istio-envoy\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.039344 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.039280    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a48c093-00f8-43d6-a927-f326da525bac-istio-token\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.039344 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.039307    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzhpp\" (UniqueName: \"kubernetes.io/projected/5a48c093-00f8-43d6-a927-f326da525bac-kube-api-access-dzhpp\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.039707 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.039529    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-workload-socket\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.039707 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.039629    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-credential-socket\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.039826 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.039811    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-istio-data\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.039884 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.039854    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-workload-certs\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.040101 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.040080    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a48c093-00f8-43d6-a927-f326da525bac-istiod-ca-cert\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.041611 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.041577    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-istio-envoy\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.041709 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.041691    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a48c093-00f8-43d6-a927-f326da525bac-istio-podinfo\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.048687 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.048612    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a48c093-00f8-43d6-a927-f326da525bac-istio-token\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.048848 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.048830    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzhpp\" (UniqueName: \"kubernetes.io/projected/5a48c093-00f8-43d6-a927-f326da525bac-kube-api-access-dzhpp\") pod \"e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") " pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.106334 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.106298    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:44.248524 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.248497    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"]
Jul 08 21:39:44.250615 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:39:44.250567    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a48c093_00f8_43d6_a927_f326da525bac.slice/crio-a346ee09563dae430c19dc130ed7171b38420ffbda192a34693812bf2c766daf WatchSource:0}: Error finding container a346ee09563dae430c19dc130ed7171b38420ffbda192a34693812bf2c766daf: Status 404 returned error can't find the container with id a346ee09563dae430c19dc130ed7171b38420ffbda192a34693812bf2c766daf
Jul 08 21:39:44.253066 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.253035    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:39:44.253133 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.253100    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:39:44.253133 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:44.253129    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:39:45.040105 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:45.040071    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb" event={"ID":"5a48c093-00f8-43d6-a927-f326da525bac","Type":"ContainerStarted","Data":"4cd9aac5752bb3369fa248bf7f00f6a77b81ddfdae1b7ff1a6ccb1becaeb2079"}
Jul 08 21:39:45.040494 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:45.040126    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb" event={"ID":"5a48c093-00f8-43d6-a927-f326da525bac","Type":"ContainerStarted","Data":"a346ee09563dae430c19dc130ed7171b38420ffbda192a34693812bf2c766daf"}
Jul 08 21:39:45.078315 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:45.078264    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb" podStartSLOduration=2.0782489650000002 podStartE2EDuration="2.078248965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:39:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:39:45.075650235 +0000 UTC m=+2008.169453795" watchObservedRunningTime="2026-07-08 21:39:45.078248965 +0000 UTC m=+2008.172052512"
Jul 08 21:39:45.106902 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:45.106874    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:45.111460 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:45.111437    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:46.045210 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:46.045180    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:46.046244 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:46.046227    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:39:47.185033 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.184997    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"]
Jul 08 21:39:47.185404 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.185314    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9175b512-8f94-45e2-b4d6-871927fae02d" containerName="istio-proxy"
Jul 08 21:39:47.185404 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.185324    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9175b512-8f94-45e2-b4d6-871927fae02d" containerName="istio-proxy"
Jul 08 21:39:47.185404 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.185383    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9175b512-8f94-45e2-b4d6-871927fae02d" containerName="istio-proxy"
Jul 08 21:39:47.188399 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.188379    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"
Jul 08 21:39:47.193948 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.193930    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-a8920c-serving-cert\""
Jul 08 21:39:47.221449 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.221427    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"]
Jul 08 21:39:47.367625 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.367573    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjk9h\" (UniqueName: \"kubernetes.io/projected/7e57d746-eff5-429b-92ce-4c09176ebd35-kube-api-access-mjk9h\") pod \"maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm\" (UID: \"7e57d746-eff5-429b-92ce-4c09176ebd35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"
Jul 08 21:39:47.367763 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.367661    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e57d746-eff5-429b-92ce-4c09176ebd35-maas-api-tls\") pod \"maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm\" (UID: \"7e57d746-eff5-429b-92ce-4c09176ebd35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"
Jul 08 21:39:47.367763 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.367693    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e57d746-eff5-429b-92ce-4c09176ebd35-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm\" (UID: \"7e57d746-eff5-429b-92ce-4c09176ebd35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"
Jul 08 21:39:47.468195 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.468111    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e57d746-eff5-429b-92ce-4c09176ebd35-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm\" (UID: \"7e57d746-eff5-429b-92ce-4c09176ebd35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"
Jul 08 21:39:47.468195 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.468167    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjk9h\" (UniqueName: \"kubernetes.io/projected/7e57d746-eff5-429b-92ce-4c09176ebd35-kube-api-access-mjk9h\") pod \"maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm\" (UID: \"7e57d746-eff5-429b-92ce-4c09176ebd35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"
Jul 08 21:39:47.468377 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.468227    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e57d746-eff5-429b-92ce-4c09176ebd35-maas-api-tls\") pod \"maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm\" (UID: \"7e57d746-eff5-429b-92ce-4c09176ebd35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"
Jul 08 21:39:47.468857 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.468827    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e57d746-eff5-429b-92ce-4c09176ebd35-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm\" (UID: \"7e57d746-eff5-429b-92ce-4c09176ebd35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"
Jul 08 21:39:47.470534 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.470511    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e57d746-eff5-429b-92ce-4c09176ebd35-maas-api-tls\") pod \"maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm\" (UID: \"7e57d746-eff5-429b-92ce-4c09176ebd35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"
Jul 08 21:39:47.483295 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.483268    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjk9h\" (UniqueName: \"kubernetes.io/projected/7e57d746-eff5-429b-92ce-4c09176ebd35-kube-api-access-mjk9h\") pod \"maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm\" (UID: \"7e57d746-eff5-429b-92ce-4c09176ebd35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"
Jul 08 21:39:47.499244 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.499218    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"
Jul 08 21:39:47.639561 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.639535    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"]
Jul 08 21:39:47.641375 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:39:47.641343    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e57d746_eff5_429b_92ce_4c09176ebd35.slice/crio-4639f122d04333fa853fb8f572ecd1f353bd3163f309a5b227fe075e5e597905 WatchSource:0}: Error finding container 4639f122d04333fa853fb8f572ecd1f353bd3163f309a5b227fe075e5e597905: Status 404 returned error can't find the container with id 4639f122d04333fa853fb8f572ecd1f353bd3163f309a5b227fe075e5e597905
Jul 08 21:39:47.642713 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:47.642696    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:39:48.055328 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:48.055290    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm" event={"ID":"7e57d746-eff5-429b-92ce-4c09176ebd35","Type":"ContainerStarted","Data":"4639f122d04333fa853fb8f572ecd1f353bd3163f309a5b227fe075e5e597905"}
Jul 08 21:39:49.061601 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:49.061552    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm" event={"ID":"7e57d746-eff5-429b-92ce-4c09176ebd35","Type":"ContainerStarted","Data":"2359721b069a750a9e386b8d06ac081c9d13fe6c26d51c465f48207970295e2b"}
Jul 08 21:39:49.061975 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:49.061630    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"
Jul 08 21:39:49.080960 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:49.080912    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm" podStartSLOduration=1.491958691 podStartE2EDuration="2.08089431s" totalImagesPullingTime="588.935619ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:39:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:39:49.080164712 +0000 UTC m=+2012.173968300" watchObservedRunningTime="2026-07-08 21:39:49.08089431 +0000 UTC m=+2012.174697860"
Jul 08 21:39:52.268802 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.268378    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"]
Jul 08 21:39:52.273512 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.273485    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.276866 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.276840    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e687ba-openshift-default-dockercfg-k6dj4\""
Jul 08 21:39:52.287079 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.287058    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"]
Jul 08 21:39:52.415055 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.415023    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-credential-socket\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.415055 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.415057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-envoy\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.415267 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.415086    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-podinfo\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.415267 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.415104    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b5120e5-2dac-440b-b0c9-092ce100dd04-istiod-ca-cert\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.415267 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.415128    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-workload-certs\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.415267 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.415188    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x57sb\" (UniqueName: \"kubernetes.io/projected/0b5120e5-2dac-440b-b0c9-092ce100dd04-kube-api-access-x57sb\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.415267 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.415210    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-workload-socket\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.415267 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.415224    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-data\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.415267 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.415239    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-token\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.515959 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.515910    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-workload-socket\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.515959 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.515959    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-data\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.516217 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.515976    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-token\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.516217 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.516009    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-credential-socket\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.516217 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.516026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-envoy\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.516217 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.516052    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-podinfo\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.516217 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.516069    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b5120e5-2dac-440b-b0c9-092ce100dd04-istiod-ca-cert\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.516217 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.516091    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-workload-certs\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.516217 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.516163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x57sb\" (UniqueName: \"kubernetes.io/projected/0b5120e5-2dac-440b-b0c9-092ce100dd04-kube-api-access-x57sb\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.516520 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.516443    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-data\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.516520 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.516471    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-workload-socket\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.516669 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.516628    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-credential-socket\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.516739 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.516716    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-workload-certs\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.517010 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.516994    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b5120e5-2dac-440b-b0c9-092ce100dd04-istiod-ca-cert\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.518369 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.518347    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-envoy\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.518601 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.518571    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-podinfo\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.524980 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.524926    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-token\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.525221 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.525200    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x57sb\" (UniqueName: \"kubernetes.io/projected/0b5120e5-2dac-440b-b0c9-092ce100dd04-kube-api-access-x57sb\") pod \"e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") " pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.583773 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.583746    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:52.715533 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.715506    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"]
Jul 08 21:39:52.717178 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:39:52.717146    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b5120e5_2dac_440b_b0c9_092ce100dd04.slice/crio-ca5a52f8ae144215b0084cff20c0c066e508cb81a03db2cfbc04064a268883a7 WatchSource:0}: Error finding container ca5a52f8ae144215b0084cff20c0c066e508cb81a03db2cfbc04064a268883a7: Status 404 returned error can't find the container with id ca5a52f8ae144215b0084cff20c0c066e508cb81a03db2cfbc04064a268883a7
Jul 08 21:39:52.719391 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.719350    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:39:52.719469 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.719436    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:39:52.719506 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:52.719478    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:39:53.082260 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:53.082169    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg" event={"ID":"0b5120e5-2dac-440b-b0c9-092ce100dd04","Type":"ContainerStarted","Data":"07d535a78b8a1724a2a96a4e54a32c908b0bbd5314f06663980aa842f052e25f"}
Jul 08 21:39:53.082260 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:53.082225    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg" event={"ID":"0b5120e5-2dac-440b-b0c9-092ce100dd04","Type":"ContainerStarted","Data":"ca5a52f8ae144215b0084cff20c0c066e508cb81a03db2cfbc04064a268883a7"}
Jul 08 21:39:53.104949 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:53.104904    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg" podStartSLOduration=1.104887815 podStartE2EDuration="1.104887815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:39:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:39:53.102756779 +0000 UTC m=+2016.196560365" watchObservedRunningTime="2026-07-08 21:39:53.104887815 +0000 UTC m=+2016.198691362"
Jul 08 21:39:53.584908 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:53.584878    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:53.590065 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:53.590044    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:54.086743 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:54.086712    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:54.087485 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:54.087466    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:39:55.071541 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:55.071511    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"
Jul 08 21:39:55.094405 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:55.094372    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"]
Jul 08 21:39:55.098412 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:55.098395    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"
Jul 08 21:39:55.100843 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:55.100822    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-e687ba-serving-cert\""
Jul 08 21:39:55.106442 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:55.106416    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"]
Jul 08 21:39:55.134174 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:55.134113    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cb3b4c2-62cd-4539-b994-94e6786f3be6-maas-api-tls\") pod \"maas-api-e2e-inf-b-e687ba-87f678488-24z58\" (UID: \"7cb3b4c2-62cd-4539-b994-94e6786f3be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"
Jul 08 21:39:55.134358 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:55.134313    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cb3b4c2-62cd-4539-b994-94e6786f3be6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e687ba-87f678488-24z58\" (UID: \"7cb3b4c2-62cd-4539-b994-94e6786f3be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"
Jul 08 21:39:55.134421 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:55.134384    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8frnn\" (UniqueName: \"kubernetes.io/projected/7cb3b4c2-62cd-4539-b994-94e6786f3be6-kube-api-access-8frnn\") pod \"maas-api-e2e-inf-b-e687ba-87f678488-24z58\" (UID: \"7cb3b4c2-62cd-4539-b994-94e6786f3be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"
Jul 08 21:39:55.235242 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:55.235207    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cb3b4c2-62cd-4539-b994-94e6786f3be6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e687ba-87f678488-24z58\" (UID: \"7cb3b4c2-62cd-4539-b994-94e6786f3be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"
Jul 08 21:39:55.235450 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:55.235271    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8frnn\" (UniqueName: \"kubernetes.io/projected/7cb3b4c2-62cd-4539-b994-94e6786f3be6-kube-api-access-8frnn\") pod \"maas-api-e2e-inf-b-e687ba-87f678488-24z58\" (UID: \"7cb3b4c2-62cd-4539-b994-94e6786f3be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"
Jul 08 21:39:55.235450 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:55.235350    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cb3b4c2-62cd-4539-b994-94e6786f3be6-maas-api-tls\") pod \"maas-api-e2e-inf-b-e687ba-87f678488-24z58\" (UID: \"7cb3b4c2-62cd-4539-b994-94e6786f3be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"
Jul 08 21:39:55.235450 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:39:55.235440    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-serving-cert: secret "maas-api-e2e-inf-b-e687ba-serving-cert" not found
Jul 08 21:39:55.235642 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:39:55.235506    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cb3b4c2-62cd-4539-b994-94e6786f3be6-maas-api-tls podName:7cb3b4c2-62cd-4539-b994-94e6786f3be6 nodeName:}" failed. No retries permitted until 2026-07-08 21:39:55.73548529 +0000 UTC m=+2018.829288834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7cb3b4c2-62cd-4539-b994-94e6786f3be6-maas-api-tls") pod "maas-api-e2e-inf-b-e687ba-87f678488-24z58" (UID: "7cb3b4c2-62cd-4539-b994-94e6786f3be6") : secret "maas-api-e2e-inf-b-e687ba-serving-cert" not found
Jul 08 21:39:55.236063 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:55.236041    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cb3b4c2-62cd-4539-b994-94e6786f3be6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e687ba-87f678488-24z58\" (UID: \"7cb3b4c2-62cd-4539-b994-94e6786f3be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"
Jul 08 21:39:55.249918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:55.249889    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8frnn\" (UniqueName: \"kubernetes.io/projected/7cb3b4c2-62cd-4539-b994-94e6786f3be6-kube-api-access-8frnn\") pod \"maas-api-e2e-inf-b-e687ba-87f678488-24z58\" (UID: \"7cb3b4c2-62cd-4539-b994-94e6786f3be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"
Jul 08 21:39:55.738842 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:55.738799    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cb3b4c2-62cd-4539-b994-94e6786f3be6-maas-api-tls\") pod \"maas-api-e2e-inf-b-e687ba-87f678488-24z58\" (UID: \"7cb3b4c2-62cd-4539-b994-94e6786f3be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"
Jul 08 21:39:55.741242 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:55.741215    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cb3b4c2-62cd-4539-b994-94e6786f3be6-maas-api-tls\") pod \"maas-api-e2e-inf-b-e687ba-87f678488-24z58\" (UID: \"7cb3b4c2-62cd-4539-b994-94e6786f3be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"
Jul 08 21:39:56.011907 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:56.011871    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"
Jul 08 21:39:56.178519 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:56.178397    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"]
Jul 08 21:39:56.191621 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:39:56.191576    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cb3b4c2_62cd_4539_b994_94e6786f3be6.slice/crio-3784c9ca008c974e26c9a405dba46c1a06683f2276d3d874de25dbfadddbaa5c WatchSource:0}: Error finding container 3784c9ca008c974e26c9a405dba46c1a06683f2276d3d874de25dbfadddbaa5c: Status 404 returned error can't find the container with id 3784c9ca008c974e26c9a405dba46c1a06683f2276d3d874de25dbfadddbaa5c
Jul 08 21:39:57.108352 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:57.108320    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58" event={"ID":"7cb3b4c2-62cd-4539-b994-94e6786f3be6","Type":"ContainerStarted","Data":"5fa7d29787175100d5a04619d4b4157e37b844a010f970a54d280a120c61258a"}
Jul 08 21:39:57.108566 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:57.108374    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58" event={"ID":"7cb3b4c2-62cd-4539-b994-94e6786f3be6","Type":"ContainerStarted","Data":"3784c9ca008c974e26c9a405dba46c1a06683f2276d3d874de25dbfadddbaa5c"}
Jul 08 21:39:57.108566 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:57.108395    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"
Jul 08 21:39:57.134986 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:39:57.134930    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58" podStartSLOduration=1.727300562 podStartE2EDuration="2.13491522s" totalImagesPullingTime="407.614658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:39:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:39:57.13315292 +0000 UTC m=+2020.226956472" watchObservedRunningTime="2026-07-08 21:39:57.13491522 +0000 UTC m=+2020.228718767"
Jul 08 21:40:02.022821 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:02.022357    2583 patch_prober.go:28] interesting pod/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:38360->10.134.0.44:15021: read: connection reset by peer" start-of-body=
Jul 08 21:40:02.022821 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:02.022430    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb" podUID="5a48c093-00f8-43d6-a927-f326da525bac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:38360->10.134.0.44:15021: read: connection reset by peer"
Jul 08 21:40:02.029919 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:40:02.029890    2583 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@4-20799-0.service\": RecentStats: unable to find data in memory cache]"
Jul 08 21:40:02.135333 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:02.135299    2583 generic.go:356] "Generic (PLEG): container finished" podID="5a48c093-00f8-43d6-a927-f326da525bac" containerID="4cd9aac5752bb3369fa248bf7f00f6a77b81ddfdae1b7ff1a6ccb1becaeb2079" exitCode=0
Jul 08 21:40:02.135507 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:02.135372    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb" event={"ID":"5a48c093-00f8-43d6-a927-f326da525bac","Type":"ContainerDied","Data":"4cd9aac5752bb3369fa248bf7f00f6a77b81ddfdae1b7ff1a6ccb1becaeb2079"}
Jul 08 21:40:02.135800 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:02.135786    2583 scope.go:117] "RemoveContainer" containerID="4cd9aac5752bb3369fa248bf7f00f6a77b81ddfdae1b7ff1a6ccb1becaeb2079"
Jul 08 21:40:02.136814 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:02.136785    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:40:02.136927 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:02.136866    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:40:02.136927 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:02.136916    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:40:03.118731 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:03.118700    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"
Jul 08 21:40:03.142685 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:03.142655    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb" event={"ID":"5a48c093-00f8-43d6-a927-f326da525bac","Type":"ContainerStarted","Data":"e3a953ec3ca4e5cafb807671cfb80b348da4c19ddd554dd7103030f68b11f30c"}
Jul 08 21:40:04.107257 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:04.107215    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:40:04.107474 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:04.107276    2583 patch_prober.go:28] interesting pod/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 08 21:40:04.107474 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:04.107355    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb" podUID="5a48c093-00f8-43d6-a927-f326da525bac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 08 21:40:05.108016 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:05.107970    2583 patch_prober.go:28] interesting pod/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 08 21:40:05.108413 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:05.108036    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb" podUID="5a48c093-00f8-43d6-a927-f326da525bac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 08 21:40:06.106762 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:06.106676    2583 patch_prober.go:28] interesting pod/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 08 21:40:06.106762 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:06.106745    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb" podUID="5a48c093-00f8-43d6-a927-f326da525bac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 08 21:40:07.107085 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:07.107049    2583 patch_prober.go:28] interesting pod/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 08 21:40:07.107479 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:07.107109    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb" podUID="5a48c093-00f8-43d6-a927-f326da525bac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 08 21:40:08.110488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:08.110450    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:40:08.110958 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:08.110824    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:40:08.111563 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:08.111544    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:40:09.088220 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:09.088180    2583 patch_prober.go:28] interesting pod/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 08 21:40:09.088419 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:09.088237    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg" podUID="0b5120e5-2dac-440b-b0c9-092ce100dd04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 08 21:40:09.178325 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:09.178232    2583 generic.go:356] "Generic (PLEG): container finished" podID="0b5120e5-2dac-440b-b0c9-092ce100dd04" containerID="07d535a78b8a1724a2a96a4e54a32c908b0bbd5314f06663980aa842f052e25f" exitCode=0
Jul 08 21:40:09.178325 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:09.178311    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg" event={"ID":"0b5120e5-2dac-440b-b0c9-092ce100dd04","Type":"ContainerDied","Data":"07d535a78b8a1724a2a96a4e54a32c908b0bbd5314f06663980aa842f052e25f"}
Jul 08 21:40:09.178858 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:09.178843    2583 scope.go:117] "RemoveContainer" containerID="07d535a78b8a1724a2a96a4e54a32c908b0bbd5314f06663980aa842f052e25f"
Jul 08 21:40:09.179779 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:09.179754    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:40:09.179860 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:09.179846    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:40:09.179905 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:09.179885    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:40:10.186817 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:10.186784    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg" event={"ID":"0b5120e5-2dac-440b-b0c9-092ce100dd04","Type":"ContainerStarted","Data":"820e2f004ab4a7c391ccb7239b4851171c2ebd093d8024b7f58f12b2962734ab"}
Jul 08 21:40:10.584847 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:10.584810    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:40:10.585068 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:10.585037    2583 patch_prober.go:28] interesting pod/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 08 21:40:10.585162 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:10.585098    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg" podUID="0b5120e5-2dac-440b-b0c9-092ce100dd04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 08 21:40:11.585129 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:11.585089    2583 patch_prober.go:28] interesting pod/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 08 21:40:11.585528 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:11.585152    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg" podUID="0b5120e5-2dac-440b-b0c9-092ce100dd04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 08 21:40:12.584464 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:12.584425    2583 patch_prober.go:28] interesting pod/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 08 21:40:12.584666 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:12.584499    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg" podUID="0b5120e5-2dac-440b-b0c9-092ce100dd04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 08 21:40:13.584925 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:13.584891    2583 patch_prober.go:28] interesting pod/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 08 21:40:13.585309 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:13.584943    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg" podUID="0b5120e5-2dac-440b-b0c9-092ce100dd04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 08 21:40:14.588804 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:14.588774    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:40:14.589181 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:14.589036    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:40:14.589798 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:40:14.589779    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:41:15.478415 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:15.478325    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"]
Jul 08 21:41:15.479266 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:15.479205    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm" podUID="7e57d746-eff5-429b-92ce-4c09176ebd35" containerName="maas-api" containerID="cri-o://2359721b069a750a9e386b8d06ac081c9d13fe6c26d51c465f48207970295e2b" gracePeriod=30
Jul 08 21:41:15.732130 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:15.732070    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"
Jul 08 21:41:15.863224 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:15.863191    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjk9h\" (UniqueName: \"kubernetes.io/projected/7e57d746-eff5-429b-92ce-4c09176ebd35-kube-api-access-mjk9h\") pod \"7e57d746-eff5-429b-92ce-4c09176ebd35\" (UID: \"7e57d746-eff5-429b-92ce-4c09176ebd35\") "
Jul 08 21:41:15.863394 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:15.863286    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e57d746-eff5-429b-92ce-4c09176ebd35-maas-api-tls\") pod \"7e57d746-eff5-429b-92ce-4c09176ebd35\" (UID: \"7e57d746-eff5-429b-92ce-4c09176ebd35\") "
Jul 08 21:41:15.863394 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:15.863321    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e57d746-eff5-429b-92ce-4c09176ebd35-openshift-service-ca\") pod \"7e57d746-eff5-429b-92ce-4c09176ebd35\" (UID: \"7e57d746-eff5-429b-92ce-4c09176ebd35\") "
Jul 08 21:41:15.863763 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:15.863731    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e57d746-eff5-429b-92ce-4c09176ebd35-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7e57d746-eff5-429b-92ce-4c09176ebd35" (UID: "7e57d746-eff5-429b-92ce-4c09176ebd35"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:41:15.865251 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:15.865231    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e57d746-eff5-429b-92ce-4c09176ebd35-kube-api-access-mjk9h" (OuterVolumeSpecName: "kube-api-access-mjk9h") pod "7e57d746-eff5-429b-92ce-4c09176ebd35" (UID: "7e57d746-eff5-429b-92ce-4c09176ebd35"). InnerVolumeSpecName "kube-api-access-mjk9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:41:15.865342 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:15.865326    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e57d746-eff5-429b-92ce-4c09176ebd35-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7e57d746-eff5-429b-92ce-4c09176ebd35" (UID: "7e57d746-eff5-429b-92ce-4c09176ebd35"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:41:15.964667 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:15.964628    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e57d746-eff5-429b-92ce-4c09176ebd35-maas-api-tls\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:41:15.964667 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:15.964659    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e57d746-eff5-429b-92ce-4c09176ebd35-openshift-service-ca\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:41:15.964865 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:15.964677    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjk9h\" (UniqueName: \"kubernetes.io/projected/7e57d746-eff5-429b-92ce-4c09176ebd35-kube-api-access-mjk9h\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:41:16.509338 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:16.509300    2583 generic.go:356] "Generic (PLEG): container finished" podID="7e57d746-eff5-429b-92ce-4c09176ebd35" containerID="2359721b069a750a9e386b8d06ac081c9d13fe6c26d51c465f48207970295e2b" exitCode=0
Jul 08 21:41:16.509756 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:16.509346    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"
Jul 08 21:41:16.509756 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:16.509386    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm" event={"ID":"7e57d746-eff5-429b-92ce-4c09176ebd35","Type":"ContainerDied","Data":"2359721b069a750a9e386b8d06ac081c9d13fe6c26d51c465f48207970295e2b"}
Jul 08 21:41:16.509756 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:16.509437    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm" event={"ID":"7e57d746-eff5-429b-92ce-4c09176ebd35","Type":"ContainerDied","Data":"4639f122d04333fa853fb8f572ecd1f353bd3163f309a5b227fe075e5e597905"}
Jul 08 21:41:16.509756 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:16.509463    2583 scope.go:117] "RemoveContainer" containerID="2359721b069a750a9e386b8d06ac081c9d13fe6c26d51c465f48207970295e2b"
Jul 08 21:41:16.518406 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:16.518391    2583 scope.go:117] "RemoveContainer" containerID="2359721b069a750a9e386b8d06ac081c9d13fe6c26d51c465f48207970295e2b"
Jul 08 21:41:16.518667 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:41:16.518649    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2359721b069a750a9e386b8d06ac081c9d13fe6c26d51c465f48207970295e2b\": container with ID starting with 2359721b069a750a9e386b8d06ac081c9d13fe6c26d51c465f48207970295e2b not found: ID does not exist" containerID="2359721b069a750a9e386b8d06ac081c9d13fe6c26d51c465f48207970295e2b"
Jul 08 21:41:16.518784 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:16.518673    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2359721b069a750a9e386b8d06ac081c9d13fe6c26d51c465f48207970295e2b"} err="failed to get container status \"2359721b069a750a9e386b8d06ac081c9d13fe6c26d51c465f48207970295e2b\": rpc error: code = NotFound desc = could not find container \"2359721b069a750a9e386b8d06ac081c9d13fe6c26d51c465f48207970295e2b\": container with ID starting with 2359721b069a750a9e386b8d06ac081c9d13fe6c26d51c465f48207970295e2b not found: ID does not exist"
Jul 08 21:41:16.531436 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:16.531404    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"]
Jul 08 21:41:16.534980 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:16.534961    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a8920c-5888fcd9c-td2rm"]
Jul 08 21:41:17.430740 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:17.430708    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e57d746-eff5-429b-92ce-4c09176ebd35" path="/var/lib/kubelet/pods/7e57d746-eff5-429b-92ce-4c09176ebd35/volumes"
Jul 08 21:41:57.228015 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:57.227982    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"]
Jul 08 21:41:57.228571 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:57.228238    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb" podUID="5a48c093-00f8-43d6-a927-f326da525bac" containerName="istio-proxy" containerID="cri-o://e3a953ec3ca4e5cafb807671cfb80b348da4c19ddd554dd7103030f68b11f30c" gracePeriod=30
Jul 08 21:41:58.428910 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.428863    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"]
Jul 08 21:41:58.429343 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.429162    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58" podUID="7cb3b4c2-62cd-4539-b994-94e6786f3be6" containerName="maas-api" containerID="cri-o://5fa7d29787175100d5a04619d4b4157e37b844a010f970a54d280a120c61258a" gracePeriod=30
Jul 08 21:41:58.685246 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.685186    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"
Jul 08 21:41:58.707471 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.707444    2583 generic.go:356] "Generic (PLEG): container finished" podID="7cb3b4c2-62cd-4539-b994-94e6786f3be6" containerID="5fa7d29787175100d5a04619d4b4157e37b844a010f970a54d280a120c61258a" exitCode=0
Jul 08 21:41:58.707675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.707485    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"
Jul 08 21:41:58.707675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.707522    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58" event={"ID":"7cb3b4c2-62cd-4539-b994-94e6786f3be6","Type":"ContainerDied","Data":"5fa7d29787175100d5a04619d4b4157e37b844a010f970a54d280a120c61258a"}
Jul 08 21:41:58.707675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.707573    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58" event={"ID":"7cb3b4c2-62cd-4539-b994-94e6786f3be6","Type":"ContainerDied","Data":"3784c9ca008c974e26c9a405dba46c1a06683f2276d3d874de25dbfadddbaa5c"}
Jul 08 21:41:58.707675 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.707617    2583 scope.go:117] "RemoveContainer" containerID="5fa7d29787175100d5a04619d4b4157e37b844a010f970a54d280a120c61258a"
Jul 08 21:41:58.717002 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.716980    2583 scope.go:117] "RemoveContainer" containerID="5fa7d29787175100d5a04619d4b4157e37b844a010f970a54d280a120c61258a"
Jul 08 21:41:58.717266 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:41:58.717248    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fa7d29787175100d5a04619d4b4157e37b844a010f970a54d280a120c61258a\": container with ID starting with 5fa7d29787175100d5a04619d4b4157e37b844a010f970a54d280a120c61258a not found: ID does not exist" containerID="5fa7d29787175100d5a04619d4b4157e37b844a010f970a54d280a120c61258a"
Jul 08 21:41:58.717322 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.717275    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fa7d29787175100d5a04619d4b4157e37b844a010f970a54d280a120c61258a"} err="failed to get container status \"5fa7d29787175100d5a04619d4b4157e37b844a010f970a54d280a120c61258a\": rpc error: code = NotFound desc = could not find container \"5fa7d29787175100d5a04619d4b4157e37b844a010f970a54d280a120c61258a\": container with ID starting with 5fa7d29787175100d5a04619d4b4157e37b844a010f970a54d280a120c61258a not found: ID does not exist"
Jul 08 21:41:58.832221 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.832186    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8frnn\" (UniqueName: \"kubernetes.io/projected/7cb3b4c2-62cd-4539-b994-94e6786f3be6-kube-api-access-8frnn\") pod \"7cb3b4c2-62cd-4539-b994-94e6786f3be6\" (UID: \"7cb3b4c2-62cd-4539-b994-94e6786f3be6\") "
Jul 08 21:41:58.832413 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.832243    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cb3b4c2-62cd-4539-b994-94e6786f3be6-maas-api-tls\") pod \"7cb3b4c2-62cd-4539-b994-94e6786f3be6\" (UID: \"7cb3b4c2-62cd-4539-b994-94e6786f3be6\") "
Jul 08 21:41:58.832413 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.832266    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cb3b4c2-62cd-4539-b994-94e6786f3be6-openshift-service-ca\") pod \"7cb3b4c2-62cd-4539-b994-94e6786f3be6\" (UID: \"7cb3b4c2-62cd-4539-b994-94e6786f3be6\") "
Jul 08 21:41:58.832707 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.832682    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cb3b4c2-62cd-4539-b994-94e6786f3be6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7cb3b4c2-62cd-4539-b994-94e6786f3be6" (UID: "7cb3b4c2-62cd-4539-b994-94e6786f3be6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:41:58.834345 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.834311    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cb3b4c2-62cd-4539-b994-94e6786f3be6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7cb3b4c2-62cd-4539-b994-94e6786f3be6" (UID: "7cb3b4c2-62cd-4539-b994-94e6786f3be6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:41:58.834443 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.834364    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cb3b4c2-62cd-4539-b994-94e6786f3be6-kube-api-access-8frnn" (OuterVolumeSpecName: "kube-api-access-8frnn") pod "7cb3b4c2-62cd-4539-b994-94e6786f3be6" (UID: "7cb3b4c2-62cd-4539-b994-94e6786f3be6"). InnerVolumeSpecName "kube-api-access-8frnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:41:58.932913 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.932879    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8frnn\" (UniqueName: \"kubernetes.io/projected/7cb3b4c2-62cd-4539-b994-94e6786f3be6-kube-api-access-8frnn\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:41:58.932913 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.932908    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cb3b4c2-62cd-4539-b994-94e6786f3be6-maas-api-tls\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:41:58.932913 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:58.932917    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cb3b4c2-62cd-4539-b994-94e6786f3be6-openshift-service-ca\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:41:59.030136 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:59.030096    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"]
Jul 08 21:41:59.037610 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:59.037572    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e687ba-87f678488-24z58"]
Jul 08 21:41:59.429646 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:41:59.429556    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cb3b4c2-62cd-4539-b994-94e6786f3be6" path="/var/lib/kubelet/pods/7cb3b4c2-62cd-4539-b994-94e6786f3be6/volumes"
Jul 08 21:42:02.270912 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:42:02.270881    2583 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a48c093_00f8_43d6_a927_f326da525bac.slice/crio-conmon-e3a953ec3ca4e5cafb807671cfb80b348da4c19ddd554dd7103030f68b11f30c.scope\": RecentStats: unable to find data in memory cache]"
Jul 08 21:42:02.484294 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.484258    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:42:02.565687 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.565646    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-istio-data\") pod \"5a48c093-00f8-43d6-a927-f326da525bac\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") "
Jul 08 21:42:02.565687 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.565685    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-workload-certs\") pod \"5a48c093-00f8-43d6-a927-f326da525bac\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") "
Jul 08 21:42:02.565924 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.565720    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a48c093-00f8-43d6-a927-f326da525bac-istiod-ca-cert\") pod \"5a48c093-00f8-43d6-a927-f326da525bac\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") "
Jul 08 21:42:02.565924 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.565747    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a48c093-00f8-43d6-a927-f326da525bac-istio-token\") pod \"5a48c093-00f8-43d6-a927-f326da525bac\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") "
Jul 08 21:42:02.565924 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.565771    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzhpp\" (UniqueName: \"kubernetes.io/projected/5a48c093-00f8-43d6-a927-f326da525bac-kube-api-access-dzhpp\") pod \"5a48c093-00f8-43d6-a927-f326da525bac\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") "
Jul 08 21:42:02.565924 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.565803    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-workload-socket\") pod \"5a48c093-00f8-43d6-a927-f326da525bac\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") "
Jul 08 21:42:02.566110 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.565934    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-credential-socket\") pod \"5a48c093-00f8-43d6-a927-f326da525bac\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") "
Jul 08 21:42:02.566110 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.565966    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a48c093-00f8-43d6-a927-f326da525bac-istio-podinfo\") pod \"5a48c093-00f8-43d6-a927-f326da525bac\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") "
Jul 08 21:42:02.566110 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.566046    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5a48c093-00f8-43d6-a927-f326da525bac" (UID: "5a48c093-00f8-43d6-a927-f326da525bac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:02.566110 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.566066    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-istio-envoy\") pod \"5a48c093-00f8-43d6-a927-f326da525bac\" (UID: \"5a48c093-00f8-43d6-a927-f326da525bac\") "
Jul 08 21:42:02.566326 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.566263    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5a48c093-00f8-43d6-a927-f326da525bac" (UID: "5a48c093-00f8-43d6-a927-f326da525bac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:02.566326 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.566313    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a48c093-00f8-43d6-a927-f326da525bac-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5a48c093-00f8-43d6-a927-f326da525bac" (UID: "5a48c093-00f8-43d6-a927-f326da525bac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:42:02.566459 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.566396    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a48c093-00f8-43d6-a927-f326da525bac-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:02.566610 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.566477    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:02.566610 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.566492    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:02.566610 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.566468    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5a48c093-00f8-43d6-a927-f326da525bac" (UID: "5a48c093-00f8-43d6-a927-f326da525bac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:02.566808 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.566649    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-istio-data" (OuterVolumeSpecName: "istio-data") pod "5a48c093-00f8-43d6-a927-f326da525bac" (UID: "5a48c093-00f8-43d6-a927-f326da525bac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:02.568189 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.568160    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a48c093-00f8-43d6-a927-f326da525bac-istio-token" (OuterVolumeSpecName: "istio-token") pod "5a48c093-00f8-43d6-a927-f326da525bac" (UID: "5a48c093-00f8-43d6-a927-f326da525bac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:42:02.568314 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.568291    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a48c093-00f8-43d6-a927-f326da525bac-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5a48c093-00f8-43d6-a927-f326da525bac" (UID: "5a48c093-00f8-43d6-a927-f326da525bac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 21:42:02.568541 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.568522    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5a48c093-00f8-43d6-a927-f326da525bac" (UID: "5a48c093-00f8-43d6-a927-f326da525bac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:02.568649 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.568629    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a48c093-00f8-43d6-a927-f326da525bac-kube-api-access-dzhpp" (OuterVolumeSpecName: "kube-api-access-dzhpp") pod "5a48c093-00f8-43d6-a927-f326da525bac" (UID: "5a48c093-00f8-43d6-a927-f326da525bac"). InnerVolumeSpecName "kube-api-access-dzhpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:42:02.667861 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.667825    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:02.667861 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.667857    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a48c093-00f8-43d6-a927-f326da525bac-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:02.667861 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.667866    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:02.668117 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.667874    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a48c093-00f8-43d6-a927-f326da525bac-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:02.668117 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.667882    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a48c093-00f8-43d6-a927-f326da525bac-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:02.668117 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.667890    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzhpp\" (UniqueName: \"kubernetes.io/projected/5a48c093-00f8-43d6-a927-f326da525bac-kube-api-access-dzhpp\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:02.729042 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.729003    2583 generic.go:356] "Generic (PLEG): container finished" podID="5a48c093-00f8-43d6-a927-f326da525bac" containerID="e3a953ec3ca4e5cafb807671cfb80b348da4c19ddd554dd7103030f68b11f30c" exitCode=0
Jul 08 21:42:02.729203 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.729073    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"
Jul 08 21:42:02.729203 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.729091    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb" event={"ID":"5a48c093-00f8-43d6-a927-f326da525bac","Type":"ContainerDied","Data":"e3a953ec3ca4e5cafb807671cfb80b348da4c19ddd554dd7103030f68b11f30c"}
Jul 08 21:42:02.729203 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.729176    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb" event={"ID":"5a48c093-00f8-43d6-a927-f326da525bac","Type":"ContainerDied","Data":"a346ee09563dae430c19dc130ed7171b38420ffbda192a34693812bf2c766daf"}
Jul 08 21:42:02.729203 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.729199    2583 scope.go:117] "RemoveContainer" containerID="e3a953ec3ca4e5cafb807671cfb80b348da4c19ddd554dd7103030f68b11f30c"
Jul 08 21:42:02.738558 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.738540    2583 scope.go:117] "RemoveContainer" containerID="4cd9aac5752bb3369fa248bf7f00f6a77b81ddfdae1b7ff1a6ccb1becaeb2079"
Jul 08 21:42:02.746888 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.746868    2583 scope.go:117] "RemoveContainer" containerID="e3a953ec3ca4e5cafb807671cfb80b348da4c19ddd554dd7103030f68b11f30c"
Jul 08 21:42:02.747148 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:42:02.747124    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3a953ec3ca4e5cafb807671cfb80b348da4c19ddd554dd7103030f68b11f30c\": container with ID starting with e3a953ec3ca4e5cafb807671cfb80b348da4c19ddd554dd7103030f68b11f30c not found: ID does not exist" containerID="e3a953ec3ca4e5cafb807671cfb80b348da4c19ddd554dd7103030f68b11f30c"
Jul 08 21:42:02.747194 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.747156    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3a953ec3ca4e5cafb807671cfb80b348da4c19ddd554dd7103030f68b11f30c"} err="failed to get container status \"e3a953ec3ca4e5cafb807671cfb80b348da4c19ddd554dd7103030f68b11f30c\": rpc error: code = NotFound desc = could not find container \"e3a953ec3ca4e5cafb807671cfb80b348da4c19ddd554dd7103030f68b11f30c\": container with ID starting with e3a953ec3ca4e5cafb807671cfb80b348da4c19ddd554dd7103030f68b11f30c not found: ID does not exist"
Jul 08 21:42:02.747194 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.747173    2583 scope.go:117] "RemoveContainer" containerID="4cd9aac5752bb3369fa248bf7f00f6a77b81ddfdae1b7ff1a6ccb1becaeb2079"
Jul 08 21:42:02.747390 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:42:02.747374    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cd9aac5752bb3369fa248bf7f00f6a77b81ddfdae1b7ff1a6ccb1becaeb2079\": container with ID starting with 4cd9aac5752bb3369fa248bf7f00f6a77b81ddfdae1b7ff1a6ccb1becaeb2079 not found: ID does not exist" containerID="4cd9aac5752bb3369fa248bf7f00f6a77b81ddfdae1b7ff1a6ccb1becaeb2079"
Jul 08 21:42:02.747436 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.747393    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cd9aac5752bb3369fa248bf7f00f6a77b81ddfdae1b7ff1a6ccb1becaeb2079"} err="failed to get container status \"4cd9aac5752bb3369fa248bf7f00f6a77b81ddfdae1b7ff1a6ccb1becaeb2079\": rpc error: code = NotFound desc = could not find container \"4cd9aac5752bb3369fa248bf7f00f6a77b81ddfdae1b7ff1a6ccb1becaeb2079\": container with ID starting with 4cd9aac5752bb3369fa248bf7f00f6a77b81ddfdae1b7ff1a6ccb1becaeb2079 not found: ID does not exist"
Jul 08 21:42:02.750565 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.750543    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"]
Jul 08 21:42:02.756007 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:02.755986    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a8920c-openshift-default-748fd47787-fw9tb"]
Jul 08 21:42:03.430282 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:03.430248    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a48c093-00f8-43d6-a927-f326da525bac" path="/var/lib/kubelet/pods/5a48c093-00f8-43d6-a927-f326da525bac/volumes"
Jul 08 21:42:04.113538 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:04.113509    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"]
Jul 08 21:42:04.113797 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:04.113770    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg" podUID="0b5120e5-2dac-440b-b0c9-092ce100dd04" containerName="istio-proxy" containerID="cri-o://820e2f004ab4a7c391ccb7239b4851171c2ebd093d8024b7f58f12b2962734ab" gracePeriod=30
Jul 08 21:42:05.026210 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.026173    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"]
Jul 08 21:42:05.026800 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.026781    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e57d746-eff5-429b-92ce-4c09176ebd35" containerName="maas-api"
Jul 08 21:42:05.026800 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.026802    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e57d746-eff5-429b-92ce-4c09176ebd35" containerName="maas-api"
Jul 08 21:42:05.026909 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.026818    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a48c093-00f8-43d6-a927-f326da525bac" containerName="istio-proxy"
Jul 08 21:42:05.026909 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.026826    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a48c093-00f8-43d6-a927-f326da525bac" containerName="istio-proxy"
Jul 08 21:42:05.026909 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.026841    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cb3b4c2-62cd-4539-b994-94e6786f3be6" containerName="maas-api"
Jul 08 21:42:05.026909 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.026847    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cb3b4c2-62cd-4539-b994-94e6786f3be6" containerName="maas-api"
Jul 08 21:42:05.026909 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.026901    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cb3b4c2-62cd-4539-b994-94e6786f3be6" containerName="maas-api"
Jul 08 21:42:05.026909 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.026910    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a48c093-00f8-43d6-a927-f326da525bac" containerName="istio-proxy"
Jul 08 21:42:05.027116 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.026919    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e57d746-eff5-429b-92ce-4c09176ebd35" containerName="maas-api"
Jul 08 21:42:05.031376 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.031355    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.034043 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.034025    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-021d24-openshift-default-dockercfg-rdps5\""
Jul 08 21:42:05.040969 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.040945    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"]
Jul 08 21:42:05.191199 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.191168    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31dba540-6878-4515-bd35-fc007746af4c-istio-token\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.191397 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.191211    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-workload-socket\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.191397 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.191236    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31dba540-6878-4515-bd35-fc007746af4c-istio-podinfo\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.191397 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.191254    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-istio-envoy\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.191397 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.191318    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-istio-data\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.191397 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.191373    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31dba540-6878-4515-bd35-fc007746af4c-istiod-ca-cert\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.191641 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.191437    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psg7k\" (UniqueName: \"kubernetes.io/projected/31dba540-6878-4515-bd35-fc007746af4c-kube-api-access-psg7k\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.191641 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.191501    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-credential-socket\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.191641 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.191527    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-workload-certs\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.292279 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.292199    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psg7k\" (UniqueName: \"kubernetes.io/projected/31dba540-6878-4515-bd35-fc007746af4c-kube-api-access-psg7k\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.292279 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.292253    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-credential-socket\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.292488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.292281    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-workload-certs\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.292488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.292316    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31dba540-6878-4515-bd35-fc007746af4c-istio-token\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.292488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.292352    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-workload-socket\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.292488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.292387    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31dba540-6878-4515-bd35-fc007746af4c-istio-podinfo\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.292488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.292412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-istio-envoy\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.292488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.292445    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-istio-data\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.292488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.292476    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31dba540-6878-4515-bd35-fc007746af4c-istiod-ca-cert\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.292904 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.292711    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-workload-certs\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.292904 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.292810    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-credential-socket\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.292904 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.292831    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-istio-data\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.292904 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.292862    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-workload-socket\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.293221 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.293200    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31dba540-6878-4515-bd35-fc007746af4c-istiod-ca-cert\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.294662 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.294639    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-istio-envoy\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.294861 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.294845    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31dba540-6878-4515-bd35-fc007746af4c-istio-podinfo\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.300111 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.300089    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31dba540-6878-4515-bd35-fc007746af4c-istio-token\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.300206 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.300160    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psg7k\" (UniqueName: \"kubernetes.io/projected/31dba540-6878-4515-bd35-fc007746af4c-kube-api-access-psg7k\") pod \"e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") " pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.342518 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.342489    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:05.479971 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.479942    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"]
Jul 08 21:42:05.482187 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:42:05.482159    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31dba540_6878_4515_bd35_fc007746af4c.slice/crio-0733f99c072ee9d2e6c91a0dfba3576e08c1a34c37fc3a47eb9e5e23cbad4001 WatchSource:0}: Error finding container 0733f99c072ee9d2e6c91a0dfba3576e08c1a34c37fc3a47eb9e5e23cbad4001: Status 404 returned error can't find the container with id 0733f99c072ee9d2e6c91a0dfba3576e08c1a34c37fc3a47eb9e5e23cbad4001
Jul 08 21:42:05.484106 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.484073    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:05.484222 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.484153    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:05.484222 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.484200    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:05.745625 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.745529    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8" event={"ID":"31dba540-6878-4515-bd35-fc007746af4c","Type":"ContainerStarted","Data":"7fb83be270ae9ec1ec85ff0d2362d8f8970940f57f2820dbc2f9c50981d824a6"}
Jul 08 21:42:05.745625 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.745578    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8" event={"ID":"31dba540-6878-4515-bd35-fc007746af4c","Type":"ContainerStarted","Data":"0733f99c072ee9d2e6c91a0dfba3576e08c1a34c37fc3a47eb9e5e23cbad4001"}
Jul 08 21:42:05.766083 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:05.766036    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8" podStartSLOduration=0.766021611 podStartE2EDuration="766.021611ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:42:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:42:05.763667489 +0000 UTC m=+2148.857471052" watchObservedRunningTime="2026-07-08 21:42:05.766021611 +0000 UTC m=+2148.859825158"
Jul 08 21:42:06.343379 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:06.343343    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:06.348233 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:06.348210    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:06.750429 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:06.750339    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:06.751485 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:06.751467    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:07.799511 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:07.799472    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"]
Jul 08 21:42:07.800057 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:07.800039    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a48c093-00f8-43d6-a927-f326da525bac" containerName="istio-proxy"
Jul 08 21:42:07.800114 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:07.800060    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a48c093-00f8-43d6-a927-f326da525bac" containerName="istio-proxy"
Jul 08 21:42:07.800171 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:07.800158    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a48c093-00f8-43d6-a927-f326da525bac" containerName="istio-proxy"
Jul 08 21:42:07.803279 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:07.803255    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"
Jul 08 21:42:07.805832 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:07.805808    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-021d24-serving-cert\""
Jul 08 21:42:07.811290 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:07.811264    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"]
Jul 08 21:42:07.913832 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:07.913803    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-openshift-service-ca\") pod \"maas-api-e2e-api-a-021d24-65b796d7b-7tnjd\" (UID: \"06e4a74b-7959-4f10-bc63-e1bfefb74ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"
Jul 08 21:42:07.914031 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:07.913844    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-maas-api-tls\") pod \"maas-api-e2e-api-a-021d24-65b796d7b-7tnjd\" (UID: \"06e4a74b-7959-4f10-bc63-e1bfefb74ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"
Jul 08 21:42:07.914031 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:07.914022    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49xwm\" (UniqueName: \"kubernetes.io/projected/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-kube-api-access-49xwm\") pod \"maas-api-e2e-api-a-021d24-65b796d7b-7tnjd\" (UID: \"06e4a74b-7959-4f10-bc63-e1bfefb74ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"
Jul 08 21:42:08.014951 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:08.014909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-openshift-service-ca\") pod \"maas-api-e2e-api-a-021d24-65b796d7b-7tnjd\" (UID: \"06e4a74b-7959-4f10-bc63-e1bfefb74ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"
Jul 08 21:42:08.014951 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:08.014956    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-maas-api-tls\") pod \"maas-api-e2e-api-a-021d24-65b796d7b-7tnjd\" (UID: \"06e4a74b-7959-4f10-bc63-e1bfefb74ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"
Jul 08 21:42:08.015158 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:08.015031    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49xwm\" (UniqueName: \"kubernetes.io/projected/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-kube-api-access-49xwm\") pod \"maas-api-e2e-api-a-021d24-65b796d7b-7tnjd\" (UID: \"06e4a74b-7959-4f10-bc63-e1bfefb74ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"
Jul 08 21:42:08.015705 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:08.015684    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-openshift-service-ca\") pod \"maas-api-e2e-api-a-021d24-65b796d7b-7tnjd\" (UID: \"06e4a74b-7959-4f10-bc63-e1bfefb74ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"
Jul 08 21:42:08.017496 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:08.017477    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-maas-api-tls\") pod \"maas-api-e2e-api-a-021d24-65b796d7b-7tnjd\" (UID: \"06e4a74b-7959-4f10-bc63-e1bfefb74ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"
Jul 08 21:42:08.024758 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:08.024735    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49xwm\" (UniqueName: \"kubernetes.io/projected/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-kube-api-access-49xwm\") pod \"maas-api-e2e-api-a-021d24-65b796d7b-7tnjd\" (UID: \"06e4a74b-7959-4f10-bc63-e1bfefb74ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"
Jul 08 21:42:08.115765 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:08.115669    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"
Jul 08 21:42:08.249932 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:08.249910    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"]
Jul 08 21:42:08.252247 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:42:08.252220    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e4a74b_7959_4f10_bc63_e1bfefb74ef0.slice/crio-5ca3194c8c66c1d2c8346b108e5d4b4221e2ff7ce33737b5989a9535b597bcbe WatchSource:0}: Error finding container 5ca3194c8c66c1d2c8346b108e5d4b4221e2ff7ce33737b5989a9535b597bcbe: Status 404 returned error can't find the container with id 5ca3194c8c66c1d2c8346b108e5d4b4221e2ff7ce33737b5989a9535b597bcbe
Jul 08 21:42:08.760639 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:08.760608    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd" event={"ID":"06e4a74b-7959-4f10-bc63-e1bfefb74ef0","Type":"ContainerStarted","Data":"2f9485376e8a431d0693f9a40d1f87ba873cf14648ac134bdb368a3fa8756473"}
Jul 08 21:42:08.760789 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:08.760672    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd" event={"ID":"06e4a74b-7959-4f10-bc63-e1bfefb74ef0","Type":"ContainerStarted","Data":"5ca3194c8c66c1d2c8346b108e5d4b4221e2ff7ce33737b5989a9535b597bcbe"}
Jul 08 21:42:08.760789 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:08.760705    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"
Jul 08 21:42:08.782468 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:08.782414    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd" podStartSLOduration=1.365124539 podStartE2EDuration="1.782398489s" totalImagesPullingTime="417.27395ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:42:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:42:08.780763014 +0000 UTC m=+2151.874566561" watchObservedRunningTime="2026-07-08 21:42:08.782398489 +0000 UTC m=+2151.876202035"
Jul 08 21:42:09.371425 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.371403    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:42:09.529883 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.529858    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-token\") pod \"0b5120e5-2dac-440b-b0c9-092ce100dd04\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") "
Jul 08 21:42:09.530041 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.529901    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-envoy\") pod \"0b5120e5-2dac-440b-b0c9-092ce100dd04\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") "
Jul 08 21:42:09.530041 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.529917    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-podinfo\") pod \"0b5120e5-2dac-440b-b0c9-092ce100dd04\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") "
Jul 08 21:42:09.530041 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.529955    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-workload-certs\") pod \"0b5120e5-2dac-440b-b0c9-092ce100dd04\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") "
Jul 08 21:42:09.530041 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.529981    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-workload-socket\") pod \"0b5120e5-2dac-440b-b0c9-092ce100dd04\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") "
Jul 08 21:42:09.530041 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.530004    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-credential-socket\") pod \"0b5120e5-2dac-440b-b0c9-092ce100dd04\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") "
Jul 08 21:42:09.530041 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.530026    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-data\") pod \"0b5120e5-2dac-440b-b0c9-092ce100dd04\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") "
Jul 08 21:42:09.530369 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.530053    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b5120e5-2dac-440b-b0c9-092ce100dd04-istiod-ca-cert\") pod \"0b5120e5-2dac-440b-b0c9-092ce100dd04\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") "
Jul 08 21:42:09.530369 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.530076    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x57sb\" (UniqueName: \"kubernetes.io/projected/0b5120e5-2dac-440b-b0c9-092ce100dd04-kube-api-access-x57sb\") pod \"0b5120e5-2dac-440b-b0c9-092ce100dd04\" (UID: \"0b5120e5-2dac-440b-b0c9-092ce100dd04\") "
Jul 08 21:42:09.530369 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.530335    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0b5120e5-2dac-440b-b0c9-092ce100dd04" (UID: "0b5120e5-2dac-440b-b0c9-092ce100dd04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:09.530369 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.530351    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0b5120e5-2dac-440b-b0c9-092ce100dd04" (UID: "0b5120e5-2dac-440b-b0c9-092ce100dd04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:09.530369 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.530365    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0b5120e5-2dac-440b-b0c9-092ce100dd04" (UID: "0b5120e5-2dac-440b-b0c9-092ce100dd04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:09.530745 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.530655    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b5120e5-2dac-440b-b0c9-092ce100dd04-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0b5120e5-2dac-440b-b0c9-092ce100dd04" (UID: "0b5120e5-2dac-440b-b0c9-092ce100dd04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:42:09.531037 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.531013    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-data" (OuterVolumeSpecName: "istio-data") pod "0b5120e5-2dac-440b-b0c9-092ce100dd04" (UID: "0b5120e5-2dac-440b-b0c9-092ce100dd04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:09.532239 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.532209    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-token" (OuterVolumeSpecName: "istio-token") pod "0b5120e5-2dac-440b-b0c9-092ce100dd04" (UID: "0b5120e5-2dac-440b-b0c9-092ce100dd04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:42:09.532325 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.532247    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b5120e5-2dac-440b-b0c9-092ce100dd04-kube-api-access-x57sb" (OuterVolumeSpecName: "kube-api-access-x57sb") pod "0b5120e5-2dac-440b-b0c9-092ce100dd04" (UID: "0b5120e5-2dac-440b-b0c9-092ce100dd04"). InnerVolumeSpecName "kube-api-access-x57sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:42:09.532504 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.532488    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0b5120e5-2dac-440b-b0c9-092ce100dd04" (UID: "0b5120e5-2dac-440b-b0c9-092ce100dd04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:09.532542 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.532515    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0b5120e5-2dac-440b-b0c9-092ce100dd04" (UID: "0b5120e5-2dac-440b-b0c9-092ce100dd04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 21:42:09.631351 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.631311    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:09.631351 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.631343    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:09.631351 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.631355    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:09.631610 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.631367    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:09.631610 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.631378    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:09.631610 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.631389    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:09.631610 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.631400    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b5120e5-2dac-440b-b0c9-092ce100dd04-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:09.631610 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.631410    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x57sb\" (UniqueName: \"kubernetes.io/projected/0b5120e5-2dac-440b-b0c9-092ce100dd04-kube-api-access-x57sb\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:09.631610 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.631422    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b5120e5-2dac-440b-b0c9-092ce100dd04-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:09.767031 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.766999    2583 generic.go:356] "Generic (PLEG): container finished" podID="0b5120e5-2dac-440b-b0c9-092ce100dd04" containerID="820e2f004ab4a7c391ccb7239b4851171c2ebd093d8024b7f58f12b2962734ab" exitCode=0
Jul 08 21:42:09.767205 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.767047    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"
Jul 08 21:42:09.767205 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.767098    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg" event={"ID":"0b5120e5-2dac-440b-b0c9-092ce100dd04","Type":"ContainerDied","Data":"820e2f004ab4a7c391ccb7239b4851171c2ebd093d8024b7f58f12b2962734ab"}
Jul 08 21:42:09.767205 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.767150    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg" event={"ID":"0b5120e5-2dac-440b-b0c9-092ce100dd04","Type":"ContainerDied","Data":"ca5a52f8ae144215b0084cff20c0c066e508cb81a03db2cfbc04064a268883a7"}
Jul 08 21:42:09.767205 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.767173    2583 scope.go:117] "RemoveContainer" containerID="820e2f004ab4a7c391ccb7239b4851171c2ebd093d8024b7f58f12b2962734ab"
Jul 08 21:42:09.776508 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.776492    2583 scope.go:117] "RemoveContainer" containerID="07d535a78b8a1724a2a96a4e54a32c908b0bbd5314f06663980aa842f052e25f"
Jul 08 21:42:09.784768 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.784730    2583 scope.go:117] "RemoveContainer" containerID="820e2f004ab4a7c391ccb7239b4851171c2ebd093d8024b7f58f12b2962734ab"
Jul 08 21:42:09.785012 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:42:09.784990    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"820e2f004ab4a7c391ccb7239b4851171c2ebd093d8024b7f58f12b2962734ab\": container with ID starting with 820e2f004ab4a7c391ccb7239b4851171c2ebd093d8024b7f58f12b2962734ab not found: ID does not exist" containerID="820e2f004ab4a7c391ccb7239b4851171c2ebd093d8024b7f58f12b2962734ab"
Jul 08 21:42:09.785054 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.785016    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"820e2f004ab4a7c391ccb7239b4851171c2ebd093d8024b7f58f12b2962734ab"} err="failed to get container status \"820e2f004ab4a7c391ccb7239b4851171c2ebd093d8024b7f58f12b2962734ab\": rpc error: code = NotFound desc = could not find container \"820e2f004ab4a7c391ccb7239b4851171c2ebd093d8024b7f58f12b2962734ab\": container with ID starting with 820e2f004ab4a7c391ccb7239b4851171c2ebd093d8024b7f58f12b2962734ab not found: ID does not exist"
Jul 08 21:42:09.785054 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.785035    2583 scope.go:117] "RemoveContainer" containerID="07d535a78b8a1724a2a96a4e54a32c908b0bbd5314f06663980aa842f052e25f"
Jul 08 21:42:09.785264 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:42:09.785244    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07d535a78b8a1724a2a96a4e54a32c908b0bbd5314f06663980aa842f052e25f\": container with ID starting with 07d535a78b8a1724a2a96a4e54a32c908b0bbd5314f06663980aa842f052e25f not found: ID does not exist" containerID="07d535a78b8a1724a2a96a4e54a32c908b0bbd5314f06663980aa842f052e25f"
Jul 08 21:42:09.785312 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.785268    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07d535a78b8a1724a2a96a4e54a32c908b0bbd5314f06663980aa842f052e25f"} err="failed to get container status \"07d535a78b8a1724a2a96a4e54a32c908b0bbd5314f06663980aa842f052e25f\": rpc error: code = NotFound desc = could not find container \"07d535a78b8a1724a2a96a4e54a32c908b0bbd5314f06663980aa842f052e25f\": container with ID starting with 07d535a78b8a1724a2a96a4e54a32c908b0bbd5314f06663980aa842f052e25f not found: ID does not exist"
Jul 08 21:42:09.793184 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.793161    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"]
Jul 08 21:42:09.796071 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:09.796046    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e687ba-openshift-default-5cd4ccf5c7-4knqg"]
Jul 08 21:42:11.430168 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:11.430120    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b5120e5-2dac-440b-b0c9-092ce100dd04" path="/var/lib/kubelet/pods/0b5120e5-2dac-440b-b0c9-092ce100dd04/volumes"
Jul 08 21:42:13.089253 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.089215    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"]
Jul 08 21:42:13.089820 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.089799    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b5120e5-2dac-440b-b0c9-092ce100dd04" containerName="istio-proxy"
Jul 08 21:42:13.089886 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.089823    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b5120e5-2dac-440b-b0c9-092ce100dd04" containerName="istio-proxy"
Jul 08 21:42:13.089936 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.089924    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b5120e5-2dac-440b-b0c9-092ce100dd04" containerName="istio-proxy"
Jul 08 21:42:13.089972 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.089941    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b5120e5-2dac-440b-b0c9-092ce100dd04" containerName="istio-proxy"
Jul 08 21:42:13.093634 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.093611    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.096455 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.096426    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-1f32fa-openshift-default-dockercfg-phbrp\""
Jul 08 21:42:13.103895 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.103872    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"]
Jul 08 21:42:13.263245 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.263209    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-workload-socket\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.263486 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.263262    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-istio-envoy\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.263486 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.263301    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97f08999-959a-4550-9b98-675dad8fb62a-istiod-ca-cert\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.263486 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.263329    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxsl9\" (UniqueName: \"kubernetes.io/projected/97f08999-959a-4550-9b98-675dad8fb62a-kube-api-access-xxsl9\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.263486 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.263361    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-credential-socket\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.263908 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.263526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-workload-certs\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.263908 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.263651    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97f08999-959a-4550-9b98-675dad8fb62a-istio-podinfo\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.263908 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.263683    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97f08999-959a-4550-9b98-675dad8fb62a-istio-token\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.263908 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.263758    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-istio-data\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.364556 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.364470    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-credential-socket\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.364556 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.364529    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-workload-certs\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.364556 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.364551    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97f08999-959a-4550-9b98-675dad8fb62a-istio-podinfo\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.364844 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.364569    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97f08999-959a-4550-9b98-675dad8fb62a-istio-token\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.364844 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.364609    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-istio-data\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.364844 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.364644    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-workload-socket\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.364844 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.364664    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-istio-envoy\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.364844 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.364692    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97f08999-959a-4550-9b98-675dad8fb62a-istiod-ca-cert\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.364844 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.364711    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxsl9\" (UniqueName: \"kubernetes.io/projected/97f08999-959a-4550-9b98-675dad8fb62a-kube-api-access-xxsl9\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.365147 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.364923    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-credential-socket\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.365147 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.364953    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-workload-certs\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.365147 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.365066    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-workload-socket\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.365147 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.365094    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-istio-data\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.365422 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.365404    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97f08999-959a-4550-9b98-675dad8fb62a-istiod-ca-cert\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.366970 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.366951    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-istio-envoy\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.367102 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.367084    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97f08999-959a-4550-9b98-675dad8fb62a-istio-podinfo\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.372217 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.372195    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97f08999-959a-4550-9b98-675dad8fb62a-istio-token\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.374045 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.374021    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxsl9\" (UniqueName: \"kubernetes.io/projected/97f08999-959a-4550-9b98-675dad8fb62a-kube-api-access-xxsl9\") pod \"e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") " pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.406339 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.406316    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:13.539371 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.539348    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"]
Jul 08 21:42:13.541619 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:42:13.541573    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f08999_959a_4550_9b98_675dad8fb62a.slice/crio-d65ea240736f62df7c68c083b3da7e96abe3204b83ebcd3d99e5960e29dec636 WatchSource:0}: Error finding container d65ea240736f62df7c68c083b3da7e96abe3204b83ebcd3d99e5960e29dec636: Status 404 returned error can't find the container with id d65ea240736f62df7c68c083b3da7e96abe3204b83ebcd3d99e5960e29dec636
Jul 08 21:42:13.543901 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.543871    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:13.543966 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.543936    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:13.544007 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.543965    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:13.789370 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.789336    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s" event={"ID":"97f08999-959a-4550-9b98-675dad8fb62a","Type":"ContainerStarted","Data":"956cf5fc18f6b3eefefb3cb233b28f3085613aa5164cc02c927431b9fc2f3ee7"}
Jul 08 21:42:13.789579 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.789400    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s" event={"ID":"97f08999-959a-4550-9b98-675dad8fb62a","Type":"ContainerStarted","Data":"d65ea240736f62df7c68c083b3da7e96abe3204b83ebcd3d99e5960e29dec636"}
Jul 08 21:42:13.811644 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:13.811571    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s" podStartSLOduration=0.81155715 podStartE2EDuration="811.55715ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:42:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:42:13.810649868 +0000 UTC m=+2156.904453442" watchObservedRunningTime="2026-07-08 21:42:13.81155715 +0000 UTC m=+2156.905360696"
Jul 08 21:42:14.406673 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:14.406643    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:14.411130 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:14.411109    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:14.773487 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:14.773461    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"
Jul 08 21:42:14.793972 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:14.793944    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:14.794949 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:14.794931    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:15.836718 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:15.836682    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"]
Jul 08 21:42:15.837252 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:15.837234    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b5120e5-2dac-440b-b0c9-092ce100dd04" containerName="istio-proxy"
Jul 08 21:42:15.837300 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:15.837255    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b5120e5-2dac-440b-b0c9-092ce100dd04" containerName="istio-proxy"
Jul 08 21:42:15.840859 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:15.840840    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"
Jul 08 21:42:15.843170 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:15.843150    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-1f32fa-serving-cert\""
Jul 08 21:42:15.850726 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:15.850701    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"]
Jul 08 21:42:15.885455 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:15.885423    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6162d760-c724-4c71-a810-a1ccc21672dd-maas-api-tls\") pod \"maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn\" (UID: \"6162d760-c724-4c71-a810-a1ccc21672dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"
Jul 08 21:42:15.885554 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:15.885531    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2kmf\" (UniqueName: \"kubernetes.io/projected/6162d760-c724-4c71-a810-a1ccc21672dd-kube-api-access-n2kmf\") pod \"maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn\" (UID: \"6162d760-c724-4c71-a810-a1ccc21672dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"
Jul 08 21:42:15.885661 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:15.885641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6162d760-c724-4c71-a810-a1ccc21672dd-openshift-service-ca\") pod \"maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn\" (UID: \"6162d760-c724-4c71-a810-a1ccc21672dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"
Jul 08 21:42:15.986307 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:15.986274    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2kmf\" (UniqueName: \"kubernetes.io/projected/6162d760-c724-4c71-a810-a1ccc21672dd-kube-api-access-n2kmf\") pod \"maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn\" (UID: \"6162d760-c724-4c71-a810-a1ccc21672dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"
Jul 08 21:42:15.986485 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:15.986327    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6162d760-c724-4c71-a810-a1ccc21672dd-openshift-service-ca\") pod \"maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn\" (UID: \"6162d760-c724-4c71-a810-a1ccc21672dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"
Jul 08 21:42:15.986485 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:15.986433    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6162d760-c724-4c71-a810-a1ccc21672dd-maas-api-tls\") pod \"maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn\" (UID: \"6162d760-c724-4c71-a810-a1ccc21672dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"
Jul 08 21:42:15.986748 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:42:15.986714    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-serving-cert: secret "maas-api-e2e-api-b-1f32fa-serving-cert" not found
Jul 08 21:42:15.986880 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:42:15.986792    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6162d760-c724-4c71-a810-a1ccc21672dd-maas-api-tls podName:6162d760-c724-4c71-a810-a1ccc21672dd nodeName:}" failed. No retries permitted until 2026-07-08 21:42:16.486771197 +0000 UTC m=+2159.580574726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6162d760-c724-4c71-a810-a1ccc21672dd-maas-api-tls") pod "maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn" (UID: "6162d760-c724-4c71-a810-a1ccc21672dd") : secret "maas-api-e2e-api-b-1f32fa-serving-cert" not found
Jul 08 21:42:15.987092 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:15.987074    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6162d760-c724-4c71-a810-a1ccc21672dd-openshift-service-ca\") pod \"maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn\" (UID: \"6162d760-c724-4c71-a810-a1ccc21672dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"
Jul 08 21:42:15.999427 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:15.999406    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2kmf\" (UniqueName: \"kubernetes.io/projected/6162d760-c724-4c71-a810-a1ccc21672dd-kube-api-access-n2kmf\") pod \"maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn\" (UID: \"6162d760-c724-4c71-a810-a1ccc21672dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"
Jul 08 21:42:16.490390 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:16.490355    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6162d760-c724-4c71-a810-a1ccc21672dd-maas-api-tls\") pod \"maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn\" (UID: \"6162d760-c724-4c71-a810-a1ccc21672dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"
Jul 08 21:42:16.492811 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:16.492788    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6162d760-c724-4c71-a810-a1ccc21672dd-maas-api-tls\") pod \"maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn\" (UID: \"6162d760-c724-4c71-a810-a1ccc21672dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"
Jul 08 21:42:16.755099 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:16.755066    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"
Jul 08 21:42:16.895021 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:16.894987    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"]
Jul 08 21:42:16.896954 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:42:16.896927    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6162d760_c724_4c71_a810_a1ccc21672dd.slice/crio-2c3e075a53fc354ce71265ab94e6646715884e02c83f403bdeaa0c3e4ffc93ab WatchSource:0}: Error finding container 2c3e075a53fc354ce71265ab94e6646715884e02c83f403bdeaa0c3e4ffc93ab: Status 404 returned error can't find the container with id 2c3e075a53fc354ce71265ab94e6646715884e02c83f403bdeaa0c3e4ffc93ab
Jul 08 21:42:17.812061 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:17.812026    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn" event={"ID":"6162d760-c724-4c71-a810-a1ccc21672dd","Type":"ContainerStarted","Data":"49873bef089373cf71922297495398e8d709201eb08ec5b830bc65beb89baa68"}
Jul 08 21:42:17.812260 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:17.812081    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn" event={"ID":"6162d760-c724-4c71-a810-a1ccc21672dd","Type":"ContainerStarted","Data":"2c3e075a53fc354ce71265ab94e6646715884e02c83f403bdeaa0c3e4ffc93ab"}
Jul 08 21:42:17.812260 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:17.812120    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"
Jul 08 21:42:17.830452 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:17.830407    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn" podStartSLOduration=2.295212533 podStartE2EDuration="2.830392069s" totalImagesPullingTime="535.179536ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:42:17.828204075 +0000 UTC m=+2160.922007623" watchObservedRunningTime="2026-07-08 21:42:17.830392069 +0000 UTC m=+2160.924195615"
Jul 08 21:42:22.792771 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:22.792724    2583 patch_prober.go:28] interesting pod/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 21:42:22.793271 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:22.792788    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8" podUID="31dba540-6878-4515-bd35-fc007746af4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 21:42:23.823691 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:23.823662    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"
Jul 08 21:42:24.846802 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:24.846770    2583 generic.go:356] "Generic (PLEG): container finished" podID="31dba540-6878-4515-bd35-fc007746af4c" containerID="7fb83be270ae9ec1ec85ff0d2362d8f8970940f57f2820dbc2f9c50981d824a6" exitCode=0
Jul 08 21:42:24.847217 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:24.846826    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8" event={"ID":"31dba540-6878-4515-bd35-fc007746af4c","Type":"ContainerDied","Data":"7fb83be270ae9ec1ec85ff0d2362d8f8970940f57f2820dbc2f9c50981d824a6"}
Jul 08 21:42:24.847217 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:24.847192    2583 scope.go:117] "RemoveContainer" containerID="7fb83be270ae9ec1ec85ff0d2362d8f8970940f57f2820dbc2f9c50981d824a6"
Jul 08 21:42:24.848335 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:24.848301    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:24.848406 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:24.848392    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:24.848482 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:24.848467    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:25.854033 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:25.853996    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8" event={"ID":"31dba540-6878-4515-bd35-fc007746af4c","Type":"ContainerStarted","Data":"c4f5265f9e14c0b5650a59defd9c95345cacfd1e59ad59340ed1746715cfe643"}
Jul 08 21:42:26.343084 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:26.343046    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:26.343396 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:26.343361    2583 patch_prober.go:28] interesting pod/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 08 21:42:26.343445 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:26.343422    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8" podUID="31dba540-6878-4515-bd35-fc007746af4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 08 21:42:27.343033 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:27.342996    2583 patch_prober.go:28] interesting pod/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 08 21:42:27.343463 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:27.343049    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8" podUID="31dba540-6878-4515-bd35-fc007746af4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 08 21:42:28.342944 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:28.342901    2583 patch_prober.go:28] interesting pod/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 08 21:42:28.343198 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:28.342964    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8" podUID="31dba540-6878-4515-bd35-fc007746af4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 08 21:42:29.294263 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.294221    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"]
Jul 08 21:42:29.294791 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.294733    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd" podUID="06e4a74b-7959-4f10-bc63-e1bfefb74ef0" containerName="maas-api" containerID="cri-o://2f9485376e8a431d0693f9a40d1f87ba873cf14648ac134bdb368a3fa8756473" gracePeriod=30
Jul 08 21:42:29.343812 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.343769    2583 patch_prober.go:28] interesting pod/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 08 21:42:29.344178 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.343839    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8" podUID="31dba540-6878-4515-bd35-fc007746af4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 08 21:42:29.625211 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.625182    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"
Jul 08 21:42:29.711657 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.711623    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-maas-api-tls\") pod \"06e4a74b-7959-4f10-bc63-e1bfefb74ef0\" (UID: \"06e4a74b-7959-4f10-bc63-e1bfefb74ef0\") "
Jul 08 21:42:29.711821 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.711681    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-openshift-service-ca\") pod \"06e4a74b-7959-4f10-bc63-e1bfefb74ef0\" (UID: \"06e4a74b-7959-4f10-bc63-e1bfefb74ef0\") "
Jul 08 21:42:29.711821 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.711708    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49xwm\" (UniqueName: \"kubernetes.io/projected/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-kube-api-access-49xwm\") pod \"06e4a74b-7959-4f10-bc63-e1bfefb74ef0\" (UID: \"06e4a74b-7959-4f10-bc63-e1bfefb74ef0\") "
Jul 08 21:42:29.712135 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.712099    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "06e4a74b-7959-4f10-bc63-e1bfefb74ef0" (UID: "06e4a74b-7959-4f10-bc63-e1bfefb74ef0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:42:29.713924 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.713887    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "06e4a74b-7959-4f10-bc63-e1bfefb74ef0" (UID: "06e4a74b-7959-4f10-bc63-e1bfefb74ef0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:42:29.714133 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.714099    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-kube-api-access-49xwm" (OuterVolumeSpecName: "kube-api-access-49xwm") pod "06e4a74b-7959-4f10-bc63-e1bfefb74ef0" (UID: "06e4a74b-7959-4f10-bc63-e1bfefb74ef0"). InnerVolumeSpecName "kube-api-access-49xwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:42:29.812550 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.812515    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-maas-api-tls\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:29.812550 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.812544    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-openshift-service-ca\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:29.812550 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.812554    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49xwm\" (UniqueName: \"kubernetes.io/projected/06e4a74b-7959-4f10-bc63-e1bfefb74ef0-kube-api-access-49xwm\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:29.881334 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.881241    2583 generic.go:356] "Generic (PLEG): container finished" podID="06e4a74b-7959-4f10-bc63-e1bfefb74ef0" containerID="2f9485376e8a431d0693f9a40d1f87ba873cf14648ac134bdb368a3fa8756473" exitCode=0
Jul 08 21:42:29.881334 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.881293    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"
Jul 08 21:42:29.881572 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.881329    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd" event={"ID":"06e4a74b-7959-4f10-bc63-e1bfefb74ef0","Type":"ContainerDied","Data":"2f9485376e8a431d0693f9a40d1f87ba873cf14648ac134bdb368a3fa8756473"}
Jul 08 21:42:29.881572 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.881384    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd" event={"ID":"06e4a74b-7959-4f10-bc63-e1bfefb74ef0","Type":"ContainerDied","Data":"5ca3194c8c66c1d2c8346b108e5d4b4221e2ff7ce33737b5989a9535b597bcbe"}
Jul 08 21:42:29.881572 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.881416    2583 scope.go:117] "RemoveContainer" containerID="2f9485376e8a431d0693f9a40d1f87ba873cf14648ac134bdb368a3fa8756473"
Jul 08 21:42:29.896075 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.896050    2583 scope.go:117] "RemoveContainer" containerID="2f9485376e8a431d0693f9a40d1f87ba873cf14648ac134bdb368a3fa8756473"
Jul 08 21:42:29.896395 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:42:29.896373    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f9485376e8a431d0693f9a40d1f87ba873cf14648ac134bdb368a3fa8756473\": container with ID starting with 2f9485376e8a431d0693f9a40d1f87ba873cf14648ac134bdb368a3fa8756473 not found: ID does not exist" containerID="2f9485376e8a431d0693f9a40d1f87ba873cf14648ac134bdb368a3fa8756473"
Jul 08 21:42:29.896474 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.896404    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f9485376e8a431d0693f9a40d1f87ba873cf14648ac134bdb368a3fa8756473"} err="failed to get container status \"2f9485376e8a431d0693f9a40d1f87ba873cf14648ac134bdb368a3fa8756473\": rpc error: code = NotFound desc = could not find container \"2f9485376e8a431d0693f9a40d1f87ba873cf14648ac134bdb368a3fa8756473\": container with ID starting with 2f9485376e8a431d0693f9a40d1f87ba873cf14648ac134bdb368a3fa8756473 not found: ID does not exist"
Jul 08 21:42:29.905703 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.905671    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"]
Jul 08 21:42:29.907459 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:29.907439    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-021d24-65b796d7b-7tnjd"]
Jul 08 21:42:30.346264 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:30.346237    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:30.346678 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:30.346532    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:30.347330 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:30.347314    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:30.836814 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:30.836781    2583 patch_prober.go:28] interesting pod/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 21:42:30.836983 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:30.836870    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s" podUID="97f08999-959a-4550-9b98-675dad8fb62a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 21:42:31.429865 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:31.429833    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06e4a74b-7959-4f10-bc63-e1bfefb74ef0" path="/var/lib/kubelet/pods/06e4a74b-7959-4f10-bc63-e1bfefb74ef0/volumes"
Jul 08 21:42:31.897465 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:31.897430    2583 generic.go:356] "Generic (PLEG): container finished" podID="97f08999-959a-4550-9b98-675dad8fb62a" containerID="956cf5fc18f6b3eefefb3cb233b28f3085613aa5164cc02c927431b9fc2f3ee7" exitCode=0
Jul 08 21:42:31.897690 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:31.897476    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s" event={"ID":"97f08999-959a-4550-9b98-675dad8fb62a","Type":"ContainerDied","Data":"956cf5fc18f6b3eefefb3cb233b28f3085613aa5164cc02c927431b9fc2f3ee7"}
Jul 08 21:42:31.897984 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:31.897968    2583 scope.go:117] "RemoveContainer" containerID="956cf5fc18f6b3eefefb3cb233b28f3085613aa5164cc02c927431b9fc2f3ee7"
Jul 08 21:42:31.899086 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:31.899056    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:31.899167 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:31.899135    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:31.899219 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:31.899190    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:32.904385 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:32.904348    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s" event={"ID":"97f08999-959a-4550-9b98-675dad8fb62a","Type":"ContainerStarted","Data":"e5b5841d3e43f79f360c1a33e3032dcf2ea26bd6c4fcb2278b23ab47549e9f9a"}
Jul 08 21:42:33.407211 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:33.407177    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:33.407470 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:33.407448    2583 patch_prober.go:28] interesting pod/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 08 21:42:33.407524 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:33.407509    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s" podUID="97f08999-959a-4550-9b98-675dad8fb62a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 08 21:42:34.407639 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:34.407581    2583 patch_prober.go:28] interesting pod/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 08 21:42:34.408033 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:34.407660    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s" podUID="97f08999-959a-4550-9b98-675dad8fb62a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 08 21:42:35.074268 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:35.074232    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"]
Jul 08 21:42:35.074751 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:35.074719    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8" podUID="31dba540-6878-4515-bd35-fc007746af4c" containerName="istio-proxy" containerID="cri-o://c4f5265f9e14c0b5650a59defd9c95345cacfd1e59ad59340ed1746715cfe643" gracePeriod=30
Jul 08 21:42:35.407094 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:35.407002    2583 patch_prober.go:28] interesting pod/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 08 21:42:35.407094 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:35.407074    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s" podUID="97f08999-959a-4550-9b98-675dad8fb62a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 08 21:42:36.157576 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.157541    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"]
Jul 08 21:42:36.158097 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.157808    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn" podUID="6162d760-c724-4c71-a810-a1ccc21672dd" containerName="maas-api" containerID="cri-o://49873bef089373cf71922297495398e8d709201eb08ec5b830bc65beb89baa68" gracePeriod=30
Jul 08 21:42:36.407321 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.407287    2583 patch_prober.go:28] interesting pod/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 08 21:42:36.407488 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.407350    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s" podUID="97f08999-959a-4550-9b98-675dad8fb62a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 08 21:42:36.436611 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.436574    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"
Jul 08 21:42:36.485061 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.485032    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6162d760-c724-4c71-a810-a1ccc21672dd-maas-api-tls\") pod \"6162d760-c724-4c71-a810-a1ccc21672dd\" (UID: \"6162d760-c724-4c71-a810-a1ccc21672dd\") "
Jul 08 21:42:36.485250 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.485120    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6162d760-c724-4c71-a810-a1ccc21672dd-openshift-service-ca\") pod \"6162d760-c724-4c71-a810-a1ccc21672dd\" (UID: \"6162d760-c724-4c71-a810-a1ccc21672dd\") "
Jul 08 21:42:36.485250 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.485190    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2kmf\" (UniqueName: \"kubernetes.io/projected/6162d760-c724-4c71-a810-a1ccc21672dd-kube-api-access-n2kmf\") pod \"6162d760-c724-4c71-a810-a1ccc21672dd\" (UID: \"6162d760-c724-4c71-a810-a1ccc21672dd\") "
Jul 08 21:42:36.485965 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.485926    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6162d760-c724-4c71-a810-a1ccc21672dd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6162d760-c724-4c71-a810-a1ccc21672dd" (UID: "6162d760-c724-4c71-a810-a1ccc21672dd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:42:36.487911 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.487884    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6162d760-c724-4c71-a810-a1ccc21672dd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6162d760-c724-4c71-a810-a1ccc21672dd" (UID: "6162d760-c724-4c71-a810-a1ccc21672dd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:42:36.488247 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.488218    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6162d760-c724-4c71-a810-a1ccc21672dd-kube-api-access-n2kmf" (OuterVolumeSpecName: "kube-api-access-n2kmf") pod "6162d760-c724-4c71-a810-a1ccc21672dd" (UID: "6162d760-c724-4c71-a810-a1ccc21672dd"). InnerVolumeSpecName "kube-api-access-n2kmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:42:36.586329 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.586292    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6162d760-c724-4c71-a810-a1ccc21672dd-maas-api-tls\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:36.586329 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.586323    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6162d760-c724-4c71-a810-a1ccc21672dd-openshift-service-ca\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:36.586329 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.586333    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2kmf\" (UniqueName: \"kubernetes.io/projected/6162d760-c724-4c71-a810-a1ccc21672dd-kube-api-access-n2kmf\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:36.924496 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.924457    2583 generic.go:356] "Generic (PLEG): container finished" podID="6162d760-c724-4c71-a810-a1ccc21672dd" containerID="49873bef089373cf71922297495398e8d709201eb08ec5b830bc65beb89baa68" exitCode=0
Jul 08 21:42:36.924700 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.924504    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"
Jul 08 21:42:36.924700 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.924529    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn" event={"ID":"6162d760-c724-4c71-a810-a1ccc21672dd","Type":"ContainerDied","Data":"49873bef089373cf71922297495398e8d709201eb08ec5b830bc65beb89baa68"}
Jul 08 21:42:36.924700 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.924581    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn" event={"ID":"6162d760-c724-4c71-a810-a1ccc21672dd","Type":"ContainerDied","Data":"2c3e075a53fc354ce71265ab94e6646715884e02c83f403bdeaa0c3e4ffc93ab"}
Jul 08 21:42:36.924700 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.924641    2583 scope.go:117] "RemoveContainer" containerID="49873bef089373cf71922297495398e8d709201eb08ec5b830bc65beb89baa68"
Jul 08 21:42:36.940177 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.940157    2583 scope.go:117] "RemoveContainer" containerID="49873bef089373cf71922297495398e8d709201eb08ec5b830bc65beb89baa68"
Jul 08 21:42:36.940471 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:42:36.940447    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49873bef089373cf71922297495398e8d709201eb08ec5b830bc65beb89baa68\": container with ID starting with 49873bef089373cf71922297495398e8d709201eb08ec5b830bc65beb89baa68 not found: ID does not exist" containerID="49873bef089373cf71922297495398e8d709201eb08ec5b830bc65beb89baa68"
Jul 08 21:42:36.940546 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.940482    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49873bef089373cf71922297495398e8d709201eb08ec5b830bc65beb89baa68"} err="failed to get container status \"49873bef089373cf71922297495398e8d709201eb08ec5b830bc65beb89baa68\": rpc error: code = NotFound desc = could not find container \"49873bef089373cf71922297495398e8d709201eb08ec5b830bc65beb89baa68\": container with ID starting with 49873bef089373cf71922297495398e8d709201eb08ec5b830bc65beb89baa68 not found: ID does not exist"
Jul 08 21:42:36.952212 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.952191    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"]
Jul 08 21:42:36.956414 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:36.956395    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1f32fa-7b84c86947-8kdbn"]
Jul 08 21:42:37.410173 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:37.410142    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:37.410541 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:37.410412    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:37.411058 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:37.411044    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:37.429943 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:37.429917    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6162d760-c724-4c71-a810-a1ccc21672dd" path="/var/lib/kubelet/pods/6162d760-c724-4c71-a810-a1ccc21672dd/volumes"
Jul 08 21:42:40.333171 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.333151    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:40.420508 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.420428    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-workload-socket\") pod \"31dba540-6878-4515-bd35-fc007746af4c\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") "
Jul 08 21:42:40.420508 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.420476    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-workload-certs\") pod \"31dba540-6878-4515-bd35-fc007746af4c\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") "
Jul 08 21:42:40.420508 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.420499    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-istio-envoy\") pod \"31dba540-6878-4515-bd35-fc007746af4c\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") "
Jul 08 21:42:40.420802 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.420535    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-istio-data\") pod \"31dba540-6878-4515-bd35-fc007746af4c\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") "
Jul 08 21:42:40.420802 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.420554    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psg7k\" (UniqueName: \"kubernetes.io/projected/31dba540-6878-4515-bd35-fc007746af4c-kube-api-access-psg7k\") pod \"31dba540-6878-4515-bd35-fc007746af4c\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") "
Jul 08 21:42:40.420802 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.420612    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31dba540-6878-4515-bd35-fc007746af4c-istio-token\") pod \"31dba540-6878-4515-bd35-fc007746af4c\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") "
Jul 08 21:42:40.420802 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.420647    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31dba540-6878-4515-bd35-fc007746af4c-istio-podinfo\") pod \"31dba540-6878-4515-bd35-fc007746af4c\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") "
Jul 08 21:42:40.420802 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.420671    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31dba540-6878-4515-bd35-fc007746af4c-istiod-ca-cert\") pod \"31dba540-6878-4515-bd35-fc007746af4c\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") "
Jul 08 21:42:40.420802 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.420690    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-credential-socket\") pod \"31dba540-6878-4515-bd35-fc007746af4c\" (UID: \"31dba540-6878-4515-bd35-fc007746af4c\") "
Jul 08 21:42:40.420802 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.420740    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "31dba540-6878-4515-bd35-fc007746af4c" (UID: "31dba540-6878-4515-bd35-fc007746af4c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:40.421179 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.420876    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "31dba540-6878-4515-bd35-fc007746af4c" (UID: "31dba540-6878-4515-bd35-fc007746af4c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:40.421179 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.420987    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "31dba540-6878-4515-bd35-fc007746af4c" (UID: "31dba540-6878-4515-bd35-fc007746af4c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:40.421179 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.421026    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:40.421179 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.421047    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:40.421179 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.421145    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31dba540-6878-4515-bd35-fc007746af4c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "31dba540-6878-4515-bd35-fc007746af4c" (UID: "31dba540-6878-4515-bd35-fc007746af4c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:42:40.421560 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.421532    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-istio-data" (OuterVolumeSpecName: "istio-data") pod "31dba540-6878-4515-bd35-fc007746af4c" (UID: "31dba540-6878-4515-bd35-fc007746af4c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:40.422785 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.422759    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "31dba540-6878-4515-bd35-fc007746af4c" (UID: "31dba540-6878-4515-bd35-fc007746af4c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:40.422868 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.422809    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31dba540-6878-4515-bd35-fc007746af4c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "31dba540-6878-4515-bd35-fc007746af4c" (UID: "31dba540-6878-4515-bd35-fc007746af4c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 21:42:40.422868 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.422852    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31dba540-6878-4515-bd35-fc007746af4c-kube-api-access-psg7k" (OuterVolumeSpecName: "kube-api-access-psg7k") pod "31dba540-6878-4515-bd35-fc007746af4c" (UID: "31dba540-6878-4515-bd35-fc007746af4c"). InnerVolumeSpecName "kube-api-access-psg7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:42:40.422947 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.422904    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31dba540-6878-4515-bd35-fc007746af4c-istio-token" (OuterVolumeSpecName: "istio-token") pod "31dba540-6878-4515-bd35-fc007746af4c" (UID: "31dba540-6878-4515-bd35-fc007746af4c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:42:40.521957 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.521930    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31dba540-6878-4515-bd35-fc007746af4c-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:40.521957 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.521961    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31dba540-6878-4515-bd35-fc007746af4c-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:40.522178 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.521975    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31dba540-6878-4515-bd35-fc007746af4c-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:40.522178 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.521988    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:40.522178 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.522001    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:40.522178 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.522016    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31dba540-6878-4515-bd35-fc007746af4c-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:40.522178 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.522029    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psg7k\" (UniqueName: \"kubernetes.io/projected/31dba540-6878-4515-bd35-fc007746af4c-kube-api-access-psg7k\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:40.946502 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.946462    2583 generic.go:356] "Generic (PLEG): container finished" podID="31dba540-6878-4515-bd35-fc007746af4c" containerID="c4f5265f9e14c0b5650a59defd9c95345cacfd1e59ad59340ed1746715cfe643" exitCode=0
Jul 08 21:42:40.946725 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.946515    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8" event={"ID":"31dba540-6878-4515-bd35-fc007746af4c","Type":"ContainerDied","Data":"c4f5265f9e14c0b5650a59defd9c95345cacfd1e59ad59340ed1746715cfe643"}
Jul 08 21:42:40.946725 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.946521    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"
Jul 08 21:42:40.946725 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.946624    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8" event={"ID":"31dba540-6878-4515-bd35-fc007746af4c","Type":"ContainerDied","Data":"0733f99c072ee9d2e6c91a0dfba3576e08c1a34c37fc3a47eb9e5e23cbad4001"}
Jul 08 21:42:40.946725 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.946656    2583 scope.go:117] "RemoveContainer" containerID="c4f5265f9e14c0b5650a59defd9c95345cacfd1e59ad59340ed1746715cfe643"
Jul 08 21:42:40.956258 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.956242    2583 scope.go:117] "RemoveContainer" containerID="7fb83be270ae9ec1ec85ff0d2362d8f8970940f57f2820dbc2f9c50981d824a6"
Jul 08 21:42:40.963942 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.963926    2583 scope.go:117] "RemoveContainer" containerID="c4f5265f9e14c0b5650a59defd9c95345cacfd1e59ad59340ed1746715cfe643"
Jul 08 21:42:40.964173 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:42:40.964155    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4f5265f9e14c0b5650a59defd9c95345cacfd1e59ad59340ed1746715cfe643\": container with ID starting with c4f5265f9e14c0b5650a59defd9c95345cacfd1e59ad59340ed1746715cfe643 not found: ID does not exist" containerID="c4f5265f9e14c0b5650a59defd9c95345cacfd1e59ad59340ed1746715cfe643"
Jul 08 21:42:40.964236 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.964180    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4f5265f9e14c0b5650a59defd9c95345cacfd1e59ad59340ed1746715cfe643"} err="failed to get container status \"c4f5265f9e14c0b5650a59defd9c95345cacfd1e59ad59340ed1746715cfe643\": rpc error: code = NotFound desc = could not find container \"c4f5265f9e14c0b5650a59defd9c95345cacfd1e59ad59340ed1746715cfe643\": container with ID starting with c4f5265f9e14c0b5650a59defd9c95345cacfd1e59ad59340ed1746715cfe643 not found: ID does not exist"
Jul 08 21:42:40.964236 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.964196    2583 scope.go:117] "RemoveContainer" containerID="7fb83be270ae9ec1ec85ff0d2362d8f8970940f57f2820dbc2f9c50981d824a6"
Jul 08 21:42:40.964420 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:42:40.964402    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fb83be270ae9ec1ec85ff0d2362d8f8970940f57f2820dbc2f9c50981d824a6\": container with ID starting with 7fb83be270ae9ec1ec85ff0d2362d8f8970940f57f2820dbc2f9c50981d824a6 not found: ID does not exist" containerID="7fb83be270ae9ec1ec85ff0d2362d8f8970940f57f2820dbc2f9c50981d824a6"
Jul 08 21:42:40.964461 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.964427    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fb83be270ae9ec1ec85ff0d2362d8f8970940f57f2820dbc2f9c50981d824a6"} err="failed to get container status \"7fb83be270ae9ec1ec85ff0d2362d8f8970940f57f2820dbc2f9c50981d824a6\": rpc error: code = NotFound desc = could not find container \"7fb83be270ae9ec1ec85ff0d2362d8f8970940f57f2820dbc2f9c50981d824a6\": container with ID starting with 7fb83be270ae9ec1ec85ff0d2362d8f8970940f57f2820dbc2f9c50981d824a6 not found: ID does not exist"
Jul 08 21:42:40.968097 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.968075    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"]
Jul 08 21:42:40.973704 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:40.973683    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-021d24-openshift-default-6d4797b7c7-kqkk8"]
Jul 08 21:42:41.429977 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:41.429946    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31dba540-6878-4515-bd35-fc007746af4c" path="/var/lib/kubelet/pods/31dba540-6878-4515-bd35-fc007746af4c/volumes"
Jul 08 21:42:42.124168 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:42.124131    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"]
Jul 08 21:42:42.124343 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:42.124325    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s" podUID="97f08999-959a-4550-9b98-675dad8fb62a" containerName="istio-proxy" containerID="cri-o://e5b5841d3e43f79f360c1a33e3032dcf2ea26bd6c4fcb2278b23ab47549e9f9a" gracePeriod=30
Jul 08 21:42:42.993150 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:42.993114    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"]
Jul 08 21:42:42.993631 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:42.993612    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31dba540-6878-4515-bd35-fc007746af4c" containerName="istio-proxy"
Jul 08 21:42:42.993721 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:42.993634    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="31dba540-6878-4515-bd35-fc007746af4c" containerName="istio-proxy"
Jul 08 21:42:42.993721 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:42.993647    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31dba540-6878-4515-bd35-fc007746af4c" containerName="istio-proxy"
Jul 08 21:42:42.993721 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:42.993655    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="31dba540-6878-4515-bd35-fc007746af4c" containerName="istio-proxy"
Jul 08 21:42:42.993721 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:42.993681    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6162d760-c724-4c71-a810-a1ccc21672dd" containerName="maas-api"
Jul 08 21:42:42.993721 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:42.993692    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6162d760-c724-4c71-a810-a1ccc21672dd" containerName="maas-api"
Jul 08 21:42:42.993721 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:42.993710    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e4a74b-7959-4f10-bc63-e1bfefb74ef0" containerName="maas-api"
Jul 08 21:42:42.993721 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:42.993721    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e4a74b-7959-4f10-bc63-e1bfefb74ef0" containerName="maas-api"
Jul 08 21:42:42.994053 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:42.993805    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="06e4a74b-7959-4f10-bc63-e1bfefb74ef0" containerName="maas-api"
Jul 08 21:42:42.994053 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:42.993817    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6162d760-c724-4c71-a810-a1ccc21672dd" containerName="maas-api"
Jul 08 21:42:42.994053 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:42.993828    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="31dba540-6878-4515-bd35-fc007746af4c" containerName="istio-proxy"
Jul 08 21:42:42.994053 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:42.993839    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="31dba540-6878-4515-bd35-fc007746af4c" containerName="istio-proxy"
Jul 08 21:42:42.997343 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:42.997323    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:42.999915 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:42.999897    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-fbb91c-openshift-default-dockercfg-5nsx6\""
Jul 08 21:42:43.008444 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.008422    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"]
Jul 08 21:42:43.142709 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.142679    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-envoy\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.142871 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.142719    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-workload-socket\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.142871 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.142743    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-data\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.142871 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.142813    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-credential-socket\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.142871 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.142846    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n87jd\" (UniqueName: \"kubernetes.io/projected/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-kube-api-access-n87jd\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.143038 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.142872    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istiod-ca-cert\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.143038 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.142938    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-podinfo\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.143038 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.142972    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-token\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.143038 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.142991    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-workload-certs\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.244180 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.244078    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-token\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.244180 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.244135    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-workload-certs\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.244180 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.244165    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-envoy\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.244456 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.244195    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-workload-socket\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.244456 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.244220    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-data\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.244456 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.244259    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-credential-socket\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.244456 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.244290    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n87jd\" (UniqueName: \"kubernetes.io/projected/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-kube-api-access-n87jd\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.244456 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.244323    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istiod-ca-cert\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.244456 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.244380    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-podinfo\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.244798 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.244582    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-workload-certs\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.244798 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.244699    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-workload-socket\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.244913 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.244792    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-data\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.244970 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.244923    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-credential-socket\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.245156 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.245134    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istiod-ca-cert\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.246502 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.246485    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-envoy\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.246875 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.246858    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-podinfo\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.252111 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.252089    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-token\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.252252 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.252231    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n87jd\" (UniqueName: \"kubernetes.io/projected/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-kube-api-access-n87jd\") pod \"e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") " pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.308365 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.308340    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:43.443324 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.443300    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"]
Jul 08 21:42:43.445035 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:42:43.445009    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d2c3c1_9c1c_4482_bed2_c2289d7e590b.slice/crio-86f78728201a412b2ab5fe5540973960019ef9be05a5de48549025aa49f19373 WatchSource:0}: Error finding container 86f78728201a412b2ab5fe5540973960019ef9be05a5de48549025aa49f19373: Status 404 returned error can't find the container with id 86f78728201a412b2ab5fe5540973960019ef9be05a5de48549025aa49f19373
Jul 08 21:42:43.447063 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.447032    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:43.447182 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.447106    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:43.447182 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.447155    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:43.962779 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.962743    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh" event={"ID":"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b","Type":"ContainerStarted","Data":"eec0931051ccfb13267dc1e54a9684221ca6925886a808f0dc8e802adda16b07"}
Jul 08 21:42:43.962965 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.962798    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh" event={"ID":"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b","Type":"ContainerStarted","Data":"86f78728201a412b2ab5fe5540973960019ef9be05a5de48549025aa49f19373"}
Jul 08 21:42:43.985101 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:43.985052    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh" podStartSLOduration=1.985038792 podStartE2EDuration="1.985038792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:42:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:42:43.983028546 +0000 UTC m=+2187.076832093" watchObservedRunningTime="2026-07-08 21:42:43.985038792 +0000 UTC m=+2187.078842338"
Jul 08 21:42:44.308732 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:44.308698    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:44.313621 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:44.313596    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:44.967468 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:44.967432    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:44.968398 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:44.968379    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:42:45.996348 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:45.996316    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"]
Jul 08 21:42:45.999021 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:45.998992    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"
Jul 08 21:42:46.007074 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:46.007052    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-fbb91c-serving-cert\""
Jul 08 21:42:46.010849 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:46.010825    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"]
Jul 08 21:42:46.068190 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:46.068165    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f2rk\" (UniqueName: \"kubernetes.io/projected/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-kube-api-access-6f2rk\") pod \"maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96\" (UID: \"c5501f78-4cf6-4d9c-995d-96862dd5fe3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"
Jul 08 21:42:46.068310 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:46.068221    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96\" (UID: \"c5501f78-4cf6-4d9c-995d-96862dd5fe3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"
Jul 08 21:42:46.068453 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:46.068433    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-maas-api-tls\") pod \"maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96\" (UID: \"c5501f78-4cf6-4d9c-995d-96862dd5fe3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"
Jul 08 21:42:46.169285 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:46.169248    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-maas-api-tls\") pod \"maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96\" (UID: \"c5501f78-4cf6-4d9c-995d-96862dd5fe3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"
Jul 08 21:42:46.169453 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:46.169333    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f2rk\" (UniqueName: \"kubernetes.io/projected/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-kube-api-access-6f2rk\") pod \"maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96\" (UID: \"c5501f78-4cf6-4d9c-995d-96862dd5fe3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"
Jul 08 21:42:46.169453 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:46.169368    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96\" (UID: \"c5501f78-4cf6-4d9c-995d-96862dd5fe3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"
Jul 08 21:42:46.169453 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:42:46.169411    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-serving-cert: secret "maas-api-e2e-shared-a-fbb91c-serving-cert" not found
Jul 08 21:42:46.169562 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:42:46.169501    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-maas-api-tls podName:c5501f78-4cf6-4d9c-995d-96862dd5fe3d nodeName:}" failed. No retries permitted until 2026-07-08 21:42:46.669480512 +0000 UTC m=+2189.763284051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-maas-api-tls") pod "maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96" (UID: "c5501f78-4cf6-4d9c-995d-96862dd5fe3d") : secret "maas-api-e2e-shared-a-fbb91c-serving-cert" not found
Jul 08 21:42:46.170028 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:46.170010    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96\" (UID: \"c5501f78-4cf6-4d9c-995d-96862dd5fe3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"
Jul 08 21:42:46.177441 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:46.177421    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f2rk\" (UniqueName: \"kubernetes.io/projected/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-kube-api-access-6f2rk\") pod \"maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96\" (UID: \"c5501f78-4cf6-4d9c-995d-96862dd5fe3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"
Jul 08 21:42:46.674925 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:46.674888    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-maas-api-tls\") pod \"maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96\" (UID: \"c5501f78-4cf6-4d9c-995d-96862dd5fe3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"
Jul 08 21:42:46.677327 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:46.677302    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-maas-api-tls\") pod \"maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96\" (UID: \"c5501f78-4cf6-4d9c-995d-96862dd5fe3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"
Jul 08 21:42:46.911534 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:46.911501    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"
Jul 08 21:42:47.050445 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.050421    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"]
Jul 08 21:42:47.052569 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:42:47.052543    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5501f78_4cf6_4d9c_995d_96862dd5fe3d.slice/crio-d4ccf40f525517aab55701b8c1f6f2738c3db1ce5c0234bd0ff1db4dad0b158b WatchSource:0}: Error finding container d4ccf40f525517aab55701b8c1f6f2738c3db1ce5c0234bd0ff1db4dad0b158b: Status 404 returned error can't find the container with id d4ccf40f525517aab55701b8c1f6f2738c3db1ce5c0234bd0ff1db4dad0b158b
Jul 08 21:42:47.443019 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.442995    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:47.583404 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.583378    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97f08999-959a-4550-9b98-675dad8fb62a-istiod-ca-cert\") pod \"97f08999-959a-4550-9b98-675dad8fb62a\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") "
Jul 08 21:42:47.583404 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.583408    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-istio-data\") pod \"97f08999-959a-4550-9b98-675dad8fb62a\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") "
Jul 08 21:42:47.583647 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.583463    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97f08999-959a-4550-9b98-675dad8fb62a-istio-podinfo\") pod \"97f08999-959a-4550-9b98-675dad8fb62a\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") "
Jul 08 21:42:47.583647 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.583495    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97f08999-959a-4550-9b98-675dad8fb62a-istio-token\") pod \"97f08999-959a-4550-9b98-675dad8fb62a\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") "
Jul 08 21:42:47.583647 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.583549    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxsl9\" (UniqueName: \"kubernetes.io/projected/97f08999-959a-4550-9b98-675dad8fb62a-kube-api-access-xxsl9\") pod \"97f08999-959a-4550-9b98-675dad8fb62a\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") "
Jul 08 21:42:47.583647 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.583569    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-workload-socket\") pod \"97f08999-959a-4550-9b98-675dad8fb62a\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") "
Jul 08 21:42:47.583647 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.583601    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-workload-certs\") pod \"97f08999-959a-4550-9b98-675dad8fb62a\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") "
Jul 08 21:42:47.583647 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.583637    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-credential-socket\") pod \"97f08999-959a-4550-9b98-675dad8fb62a\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") "
Jul 08 21:42:47.583953 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.583669    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-istio-envoy\") pod \"97f08999-959a-4550-9b98-675dad8fb62a\" (UID: \"97f08999-959a-4550-9b98-675dad8fb62a\") "
Jul 08 21:42:47.583953 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.583790    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97f08999-959a-4550-9b98-675dad8fb62a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "97f08999-959a-4550-9b98-675dad8fb62a" (UID: "97f08999-959a-4550-9b98-675dad8fb62a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:42:47.584066 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.584047    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97f08999-959a-4550-9b98-675dad8fb62a-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:47.584245 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.584183    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "97f08999-959a-4550-9b98-675dad8fb62a" (UID: "97f08999-959a-4550-9b98-675dad8fb62a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:47.584330 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.584258    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "97f08999-959a-4550-9b98-675dad8fb62a" (UID: "97f08999-959a-4550-9b98-675dad8fb62a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:47.584330 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.584270    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-istio-data" (OuterVolumeSpecName: "istio-data") pod "97f08999-959a-4550-9b98-675dad8fb62a" (UID: "97f08999-959a-4550-9b98-675dad8fb62a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:47.584445 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.584370    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "97f08999-959a-4550-9b98-675dad8fb62a" (UID: "97f08999-959a-4550-9b98-675dad8fb62a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:47.585698 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.585674    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/97f08999-959a-4550-9b98-675dad8fb62a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "97f08999-959a-4550-9b98-675dad8fb62a" (UID: "97f08999-959a-4550-9b98-675dad8fb62a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 21:42:47.585996 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.585980    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97f08999-959a-4550-9b98-675dad8fb62a-istio-token" (OuterVolumeSpecName: "istio-token") pod "97f08999-959a-4550-9b98-675dad8fb62a" (UID: "97f08999-959a-4550-9b98-675dad8fb62a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:42:47.586160 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.586137    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97f08999-959a-4550-9b98-675dad8fb62a-kube-api-access-xxsl9" (OuterVolumeSpecName: "kube-api-access-xxsl9") pod "97f08999-959a-4550-9b98-675dad8fb62a" (UID: "97f08999-959a-4550-9b98-675dad8fb62a"). InnerVolumeSpecName "kube-api-access-xxsl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:42:47.586160 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.586146    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "97f08999-959a-4550-9b98-675dad8fb62a" (UID: "97f08999-959a-4550-9b98-675dad8fb62a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:42:47.684954 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.684917    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97f08999-959a-4550-9b98-675dad8fb62a-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:47.684954 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.684948    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxsl9\" (UniqueName: \"kubernetes.io/projected/97f08999-959a-4550-9b98-675dad8fb62a-kube-api-access-xxsl9\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:47.685147 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.684963    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:47.685147 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.684976    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:47.685147 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.684988    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:47.685147 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.684999    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:47.685147 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.685009    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97f08999-959a-4550-9b98-675dad8fb62a-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:47.685147 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.685019    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97f08999-959a-4550-9b98-675dad8fb62a-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:42:47.983543 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.983460    2583 generic.go:356] "Generic (PLEG): container finished" podID="97f08999-959a-4550-9b98-675dad8fb62a" containerID="e5b5841d3e43f79f360c1a33e3032dcf2ea26bd6c4fcb2278b23ab47549e9f9a" exitCode=0
Jul 08 21:42:47.983543 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.983504    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"
Jul 08 21:42:47.983787 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.983539    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s" event={"ID":"97f08999-959a-4550-9b98-675dad8fb62a","Type":"ContainerDied","Data":"e5b5841d3e43f79f360c1a33e3032dcf2ea26bd6c4fcb2278b23ab47549e9f9a"}
Jul 08 21:42:47.983787 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.983607    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s" event={"ID":"97f08999-959a-4550-9b98-675dad8fb62a","Type":"ContainerDied","Data":"d65ea240736f62df7c68c083b3da7e96abe3204b83ebcd3d99e5960e29dec636"}
Jul 08 21:42:47.983787 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.983641    2583 scope.go:117] "RemoveContainer" containerID="e5b5841d3e43f79f360c1a33e3032dcf2ea26bd6c4fcb2278b23ab47549e9f9a"
Jul 08 21:42:47.985206 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.985181    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96" event={"ID":"c5501f78-4cf6-4d9c-995d-96862dd5fe3d","Type":"ContainerStarted","Data":"11b8210f9091ca4302bd425a562db871fb5e6b5e918afa58199c02928c208426"}
Jul 08 21:42:47.985317 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.985228    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96" event={"ID":"c5501f78-4cf6-4d9c-995d-96862dd5fe3d","Type":"ContainerStarted","Data":"d4ccf40f525517aab55701b8c1f6f2738c3db1ce5c0234bd0ff1db4dad0b158b"}
Jul 08 21:42:47.985368 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.985319    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"
Jul 08 21:42:47.994290 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:47.994273    2583 scope.go:117] "RemoveContainer" containerID="956cf5fc18f6b3eefefb3cb233b28f3085613aa5164cc02c927431b9fc2f3ee7"
Jul 08 21:42:48.002071 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:48.002057    2583 scope.go:117] "RemoveContainer" containerID="e5b5841d3e43f79f360c1a33e3032dcf2ea26bd6c4fcb2278b23ab47549e9f9a"
Jul 08 21:42:48.002304 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:42:48.002288    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5b5841d3e43f79f360c1a33e3032dcf2ea26bd6c4fcb2278b23ab47549e9f9a\": container with ID starting with e5b5841d3e43f79f360c1a33e3032dcf2ea26bd6c4fcb2278b23ab47549e9f9a not found: ID does not exist" containerID="e5b5841d3e43f79f360c1a33e3032dcf2ea26bd6c4fcb2278b23ab47549e9f9a"
Jul 08 21:42:48.002358 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:48.002311    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5b5841d3e43f79f360c1a33e3032dcf2ea26bd6c4fcb2278b23ab47549e9f9a"} err="failed to get container status \"e5b5841d3e43f79f360c1a33e3032dcf2ea26bd6c4fcb2278b23ab47549e9f9a\": rpc error: code = NotFound desc = could not find container \"e5b5841d3e43f79f360c1a33e3032dcf2ea26bd6c4fcb2278b23ab47549e9f9a\": container with ID starting with e5b5841d3e43f79f360c1a33e3032dcf2ea26bd6c4fcb2278b23ab47549e9f9a not found: ID does not exist"
Jul 08 21:42:48.002358 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:48.002327    2583 scope.go:117] "RemoveContainer" containerID="956cf5fc18f6b3eefefb3cb233b28f3085613aa5164cc02c927431b9fc2f3ee7"
Jul 08 21:42:48.002501 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:42:48.002487    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"956cf5fc18f6b3eefefb3cb233b28f3085613aa5164cc02c927431b9fc2f3ee7\": container with ID starting with 956cf5fc18f6b3eefefb3cb233b28f3085613aa5164cc02c927431b9fc2f3ee7 not found: ID does not exist" containerID="956cf5fc18f6b3eefefb3cb233b28f3085613aa5164cc02c927431b9fc2f3ee7"
Jul 08 21:42:48.002543 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:48.002505    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"956cf5fc18f6b3eefefb3cb233b28f3085613aa5164cc02c927431b9fc2f3ee7"} err="failed to get container status \"956cf5fc18f6b3eefefb3cb233b28f3085613aa5164cc02c927431b9fc2f3ee7\": rpc error: code = NotFound desc = could not find container \"956cf5fc18f6b3eefefb3cb233b28f3085613aa5164cc02c927431b9fc2f3ee7\": container with ID starting with 956cf5fc18f6b3eefefb3cb233b28f3085613aa5164cc02c927431b9fc2f3ee7 not found: ID does not exist"
Jul 08 21:42:48.005410 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:48.005373    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96" podStartSLOduration=2.7140708890000003 podStartE2EDuration="3.005360553s" totalImagesPullingTime="291.289664ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:42:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:42:48.004680967 +0000 UTC m=+2191.098484514" watchObservedRunningTime="2026-07-08 21:42:48.005360553 +0000 UTC m=+2191.099164100"
Jul 08 21:42:48.018516 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:48.018495    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"]
Jul 08 21:42:48.029120 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:48.029096    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-1f32fa-openshift-default-5c8dfcc55-gjl7s"]
Jul 08 21:42:49.430417 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:49.430384    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97f08999-959a-4550-9b98-675dad8fb62a" path="/var/lib/kubelet/pods/97f08999-959a-4550-9b98-675dad8fb62a/volumes"
Jul 08 21:42:51.104298 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.104262    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"]
Jul 08 21:42:51.104777 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.104760    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97f08999-959a-4550-9b98-675dad8fb62a" containerName="istio-proxy"
Jul 08 21:42:51.104831 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.104779    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="97f08999-959a-4550-9b98-675dad8fb62a" containerName="istio-proxy"
Jul 08 21:42:51.104868 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.104856    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="97f08999-959a-4550-9b98-675dad8fb62a" containerName="istio-proxy"
Jul 08 21:42:51.104868 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.104865    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="97f08999-959a-4550-9b98-675dad8fb62a" containerName="istio-proxy"
Jul 08 21:42:51.108386 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.108366    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.111125 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.111081    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-6edaf8-openshift-default-dockercfg-xq8b9\""
Jul 08 21:42:51.120010 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.119987    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"]
Jul 08 21:42:51.217125 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.217094    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp5gz\" (UniqueName: \"kubernetes.io/projected/890761f6-8389-4b43-9094-2e08468196c3-kube-api-access-zp5gz\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.217125 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.217125    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/890761f6-8389-4b43-9094-2e08468196c3-istiod-ca-cert\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.217354 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.217164    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-workload-socket\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.217354 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.217186    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-credential-socket\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.217354 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.217243    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-istio-data\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.217354 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.217332    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/890761f6-8389-4b43-9094-2e08468196c3-istio-podinfo\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.217527 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.217405    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-istio-envoy\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.217527 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.217441    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-workload-certs\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.217527 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.217470    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/890761f6-8389-4b43-9094-2e08468196c3-istio-token\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.318683 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.318641    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-istio-envoy\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.318886 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.318750    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-workload-certs\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.318886 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.318782    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/890761f6-8389-4b43-9094-2e08468196c3-istio-token\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.318886 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.318863    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp5gz\" (UniqueName: \"kubernetes.io/projected/890761f6-8389-4b43-9094-2e08468196c3-kube-api-access-zp5gz\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.319078 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.318925    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/890761f6-8389-4b43-9094-2e08468196c3-istiod-ca-cert\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.319078 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.318993    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-workload-socket\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.319078 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.319032    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-credential-socket\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.319078 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.319061    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-istio-data\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.319286 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.319090    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/890761f6-8389-4b43-9094-2e08468196c3-istio-podinfo\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.319286 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.319174    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-workload-certs\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.319389 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.319325    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-workload-socket\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.319528 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.319509    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-credential-socket\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.319628 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.319579    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-istio-data\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.319682 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.319655    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/890761f6-8389-4b43-9094-2e08468196c3-istiod-ca-cert\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.321225 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.321199    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-istio-envoy\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.321556 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.321534    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/890761f6-8389-4b43-9094-2e08468196c3-istio-podinfo\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.328574 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.328551    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/890761f6-8389-4b43-9094-2e08468196c3-istio-token\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.328712 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.328687    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp5gz\" (UniqueName: \"kubernetes.io/projected/890761f6-8389-4b43-9094-2e08468196c3-kube-api-access-zp5gz\") pod \"e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") " pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.420158 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.420064    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:51.550773 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.550748    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"]
Jul 08 21:42:51.552442 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:42:51.552413    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod890761f6_8389_4b43_9094_2e08468196c3.slice/crio-c3b826e7b6bbfd7e45acbad3f0ff4b0a1b0cc71d7612792b0685a97fab844479 WatchSource:0}: Error finding container c3b826e7b6bbfd7e45acbad3f0ff4b0a1b0cc71d7612792b0685a97fab844479: Status 404 returned error can't find the container with id c3b826e7b6bbfd7e45acbad3f0ff4b0a1b0cc71d7612792b0685a97fab844479
Jul 08 21:42:51.554632 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.554572    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:51.554718 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.554667    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:51.554718 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:51.554695    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:42:52.012580 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:52.012529    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm" event={"ID":"890761f6-8389-4b43-9094-2e08468196c3","Type":"ContainerStarted","Data":"55ffcb74729629ef4d0838a7638277f4c24e980d967ea4958283593e35f49887"}
Jul 08 21:42:52.012795 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:52.012649    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm" event={"ID":"890761f6-8389-4b43-9094-2e08468196c3","Type":"ContainerStarted","Data":"c3b826e7b6bbfd7e45acbad3f0ff4b0a1b0cc71d7612792b0685a97fab844479"}
Jul 08 21:42:52.032162 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:52.032112    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm" podStartSLOduration=1.032096174 podStartE2EDuration="1.032096174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:42:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:42:52.030054894 +0000 UTC m=+2195.123858470" watchObservedRunningTime="2026-07-08 21:42:52.032096174 +0000 UTC m=+2195.125899721"
Jul 08 21:42:52.420520 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:52.420445    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:52.425098 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:52.425079    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:53.017456 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:53.017422    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:53.018236 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:53.018213    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:42:53.997220 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:53.997189    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"
Jul 08 21:42:54.076606 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:54.074979    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"]
Jul 08 21:42:54.076606 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:54.075522    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97f08999-959a-4550-9b98-675dad8fb62a" containerName="istio-proxy"
Jul 08 21:42:54.076606 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:54.075542    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="97f08999-959a-4550-9b98-675dad8fb62a" containerName="istio-proxy"
Jul 08 21:42:54.092014 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:54.091976    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"]
Jul 08 21:42:54.092206 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:54.092074    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"
Jul 08 21:42:54.095909 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:54.095887    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-6edaf8-serving-cert\""
Jul 08 21:42:54.247003 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:54.246974    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/394868b9-03bc-4919-812f-99f2e67ae378-maas-api-tls\") pod \"maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr\" (UID: \"394868b9-03bc-4919-812f-99f2e67ae378\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"
Jul 08 21:42:54.247158 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:54.247077    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/394868b9-03bc-4919-812f-99f2e67ae378-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr\" (UID: \"394868b9-03bc-4919-812f-99f2e67ae378\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"
Jul 08 21:42:54.247158 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:54.247124    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdnqq\" (UniqueName: \"kubernetes.io/projected/394868b9-03bc-4919-812f-99f2e67ae378-kube-api-access-bdnqq\") pod \"maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr\" (UID: \"394868b9-03bc-4919-812f-99f2e67ae378\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"
Jul 08 21:42:54.348450 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:54.348412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/394868b9-03bc-4919-812f-99f2e67ae378-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr\" (UID: \"394868b9-03bc-4919-812f-99f2e67ae378\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"
Jul 08 21:42:54.348655 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:54.348460    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdnqq\" (UniqueName: \"kubernetes.io/projected/394868b9-03bc-4919-812f-99f2e67ae378-kube-api-access-bdnqq\") pod \"maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr\" (UID: \"394868b9-03bc-4919-812f-99f2e67ae378\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"
Jul 08 21:42:54.348655 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:54.348499    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/394868b9-03bc-4919-812f-99f2e67ae378-maas-api-tls\") pod \"maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr\" (UID: \"394868b9-03bc-4919-812f-99f2e67ae378\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"
Jul 08 21:42:54.348655 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:42:54.348616    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-serving-cert: secret "maas-api-e2e-shared-b-6edaf8-serving-cert" not found
Jul 08 21:42:54.348775 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:42:54.348676    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/394868b9-03bc-4919-812f-99f2e67ae378-maas-api-tls podName:394868b9-03bc-4919-812f-99f2e67ae378 nodeName:}" failed. No retries permitted until 2026-07-08 21:42:54.848661193 +0000 UTC m=+2197.942464718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/394868b9-03bc-4919-812f-99f2e67ae378-maas-api-tls") pod "maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr" (UID: "394868b9-03bc-4919-812f-99f2e67ae378") : secret "maas-api-e2e-shared-b-6edaf8-serving-cert" not found
Jul 08 21:42:54.349087 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:54.349067    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/394868b9-03bc-4919-812f-99f2e67ae378-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr\" (UID: \"394868b9-03bc-4919-812f-99f2e67ae378\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"
Jul 08 21:42:54.357131 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:54.357108    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdnqq\" (UniqueName: \"kubernetes.io/projected/394868b9-03bc-4919-812f-99f2e67ae378-kube-api-access-bdnqq\") pod \"maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr\" (UID: \"394868b9-03bc-4919-812f-99f2e67ae378\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"
Jul 08 21:42:54.855100 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:54.855067    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/394868b9-03bc-4919-812f-99f2e67ae378-maas-api-tls\") pod \"maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr\" (UID: \"394868b9-03bc-4919-812f-99f2e67ae378\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"
Jul 08 21:42:54.857486 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:54.857461    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/394868b9-03bc-4919-812f-99f2e67ae378-maas-api-tls\") pod \"maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr\" (UID: \"394868b9-03bc-4919-812f-99f2e67ae378\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"
Jul 08 21:42:55.008970 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:55.008931    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"
Jul 08 21:42:55.177621 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:55.177289    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"]
Jul 08 21:42:55.187806 ip-10-0-142-255 kubenswrapper[2583]: W0708 21:42:55.187776    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod394868b9_03bc_4919_812f_99f2e67ae378.slice/crio-f2fe7596a24c8a70414bd20f3eb06bbdd63751b91afccf3212d3fe1a0386d015 WatchSource:0}: Error finding container f2fe7596a24c8a70414bd20f3eb06bbdd63751b91afccf3212d3fe1a0386d015: Status 404 returned error can't find the container with id f2fe7596a24c8a70414bd20f3eb06bbdd63751b91afccf3212d3fe1a0386d015
Jul 08 21:42:56.034721 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:56.034686    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr" event={"ID":"394868b9-03bc-4919-812f-99f2e67ae378","Type":"ContainerStarted","Data":"05d4fafde200e74f337eca641fe0502c810e2c039ea1be9d85e1874cf985739d"}
Jul 08 21:42:56.035179 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:56.034745    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr" event={"ID":"394868b9-03bc-4919-812f-99f2e67ae378","Type":"ContainerStarted","Data":"f2fe7596a24c8a70414bd20f3eb06bbdd63751b91afccf3212d3fe1a0386d015"}
Jul 08 21:42:56.035179 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:56.034774    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"
Jul 08 21:42:56.052883 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:42:56.052835    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr" podStartSLOduration=1.635475808 podStartE2EDuration="2.052819863s" totalImagesPullingTime="417.344055ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:42:56.050679939 +0000 UTC m=+2199.144483499" watchObservedRunningTime="2026-07-08 21:42:56.052819863 +0000 UTC m=+2199.146623454"
Jul 08 21:43:00.717693 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:00.717645    2583 patch_prober.go:28] interesting pod/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": read tcp 10.134.0.2:43682->10.134.0.52:15021: read: connection reset by peer" start-of-body=
Jul 08 21:43:00.718154 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:00.717730    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh" podUID="c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": read tcp 10.134.0.2:43682->10.134.0.52:15021: read: connection reset by peer"
Jul 08 21:43:01.067269 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:01.067236    2583 generic.go:356] "Generic (PLEG): container finished" podID="c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" containerID="eec0931051ccfb13267dc1e54a9684221ca6925886a808f0dc8e802adda16b07" exitCode=0
Jul 08 21:43:01.067503 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:01.067319    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh" event={"ID":"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b","Type":"ContainerDied","Data":"eec0931051ccfb13267dc1e54a9684221ca6925886a808f0dc8e802adda16b07"}
Jul 08 21:43:01.068131 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:01.068116    2583 scope.go:117] "RemoveContainer" containerID="eec0931051ccfb13267dc1e54a9684221ca6925886a808f0dc8e802adda16b07"
Jul 08 21:43:01.069487 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:01.069448    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:43:01.069608 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:01.069545    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:43:01.069690 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:01.069614    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:43:02.045715 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:02.045682    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"
Jul 08 21:43:02.079212 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:02.079173    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh" event={"ID":"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b","Type":"ContainerStarted","Data":"f53bef6fb25ee962997ab56ee40f3d0da5360099f7b1b28d19c2d84d39e62a88"}
Jul 08 21:43:02.309507 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:02.309397    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:43:02.309732 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:02.309706    2583 patch_prober.go:28] interesting pod/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 08 21:43:02.309818 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:02.309761    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh" podUID="c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 08 21:43:03.309084 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:03.309042    2583 patch_prober.go:28] interesting pod/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 08 21:43:03.309569 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:03.309109    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh" podUID="c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 08 21:43:04.308936 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:04.308901    2583 patch_prober.go:28] interesting pod/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 08 21:43:04.309110 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:04.308961    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh" podUID="c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 08 21:43:05.308945 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:05.308905    2583 patch_prober.go:28] interesting pod/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 08 21:43:05.309351 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:05.308969    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh" podUID="c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 08 21:43:06.102039 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:06.101958    2583 generic.go:356] "Generic (PLEG): container finished" podID="890761f6-8389-4b43-9094-2e08468196c3" containerID="55ffcb74729629ef4d0838a7638277f4c24e980d967ea4958283593e35f49887" exitCode=0
Jul 08 21:43:06.102228 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:06.102033    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm" event={"ID":"890761f6-8389-4b43-9094-2e08468196c3","Type":"ContainerDied","Data":"55ffcb74729629ef4d0838a7638277f4c24e980d967ea4958283593e35f49887"}
Jul 08 21:43:06.102424 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:06.102411    2583 scope.go:117] "RemoveContainer" containerID="55ffcb74729629ef4d0838a7638277f4c24e980d967ea4958283593e35f49887"
Jul 08 21:43:06.103452 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:06.103424    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:43:06.103521 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:06.103494    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:43:06.103561 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:06.103524    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 21:43:06.311923 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:06.311894    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:43:06.312353 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:06.312244    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:43:06.313003 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:06.312979    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:43:07.108554 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:07.108519    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm" event={"ID":"890761f6-8389-4b43-9094-2e08468196c3","Type":"ContainerStarted","Data":"7fd09be51fc84b3604bc751097d6e81ab09b0749c49b65063ce1e27e70b63970"}
Jul 08 21:43:07.420323 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:07.420236    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:43:07.421396 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:07.421368    2583 patch_prober.go:28] interesting pod/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 08 21:43:07.421545 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:07.421421    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm" podUID="890761f6-8389-4b43-9094-2e08468196c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 08 21:43:08.017439 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:08.017405    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:43:08.420515 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:08.420430    2583 patch_prober.go:28] interesting pod/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 08 21:43:08.420515 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:08.420496    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm" podUID="890761f6-8389-4b43-9094-2e08468196c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 08 21:43:09.421297 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:09.421257    2583 patch_prober.go:28] interesting pod/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 08 21:43:09.421707 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:09.421330    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm" podUID="890761f6-8389-4b43-9094-2e08468196c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 08 21:43:10.420463 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:10.420424    2583 patch_prober.go:28] interesting pod/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 08 21:43:10.420667 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:10.420493    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm" podUID="890761f6-8389-4b43-9094-2e08468196c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 08 21:43:11.429856 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:11.429829    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:43:11.430727 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:43:11.430706    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:49:59.525783 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:49:59.525745    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"]
Jul 08 21:49:59.535193 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:49:59.535109    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96" podUID="c5501f78-4cf6-4d9c-995d-96862dd5fe3d" containerName="maas-api" containerID="cri-o://11b8210f9091ca4302bd425a562db871fb5e6b5e918afa58199c02928c208426" gracePeriod=30
Jul 08 21:49:59.775530 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:49:59.775502    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"
Jul 08 21:49:59.824626 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:49:59.824518    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f2rk\" (UniqueName: \"kubernetes.io/projected/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-kube-api-access-6f2rk\") pod \"c5501f78-4cf6-4d9c-995d-96862dd5fe3d\" (UID: \"c5501f78-4cf6-4d9c-995d-96862dd5fe3d\") "
Jul 08 21:49:59.824626 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:49:59.824572    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-openshift-service-ca\") pod \"c5501f78-4cf6-4d9c-995d-96862dd5fe3d\" (UID: \"c5501f78-4cf6-4d9c-995d-96862dd5fe3d\") "
Jul 08 21:49:59.824860 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:49:59.824656    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-maas-api-tls\") pod \"c5501f78-4cf6-4d9c-995d-96862dd5fe3d\" (UID: \"c5501f78-4cf6-4d9c-995d-96862dd5fe3d\") "
Jul 08 21:49:59.825504 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:49:59.825382    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c5501f78-4cf6-4d9c-995d-96862dd5fe3d" (UID: "c5501f78-4cf6-4d9c-995d-96862dd5fe3d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:49:59.827049 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:49:59.827024    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-kube-api-access-6f2rk" (OuterVolumeSpecName: "kube-api-access-6f2rk") pod "c5501f78-4cf6-4d9c-995d-96862dd5fe3d" (UID: "c5501f78-4cf6-4d9c-995d-96862dd5fe3d"). InnerVolumeSpecName "kube-api-access-6f2rk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:49:59.827153 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:49:59.827065    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c5501f78-4cf6-4d9c-995d-96862dd5fe3d" (UID: "c5501f78-4cf6-4d9c-995d-96862dd5fe3d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:49:59.926498 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:49:59.926469    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-openshift-service-ca\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:49:59.926498 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:49:59.926496    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-maas-api-tls\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:49:59.926702 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:49:59.926505    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f2rk\" (UniqueName: \"kubernetes.io/projected/c5501f78-4cf6-4d9c-995d-96862dd5fe3d-kube-api-access-6f2rk\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:00.096833 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:00.096742    2583 generic.go:356] "Generic (PLEG): container finished" podID="c5501f78-4cf6-4d9c-995d-96862dd5fe3d" containerID="11b8210f9091ca4302bd425a562db871fb5e6b5e918afa58199c02928c208426" exitCode=0
Jul 08 21:50:00.096833 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:00.096799    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"
Jul 08 21:50:00.097047 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:00.096835    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96" event={"ID":"c5501f78-4cf6-4d9c-995d-96862dd5fe3d","Type":"ContainerDied","Data":"11b8210f9091ca4302bd425a562db871fb5e6b5e918afa58199c02928c208426"}
Jul 08 21:50:00.097047 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:00.096936    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96" event={"ID":"c5501f78-4cf6-4d9c-995d-96862dd5fe3d","Type":"ContainerDied","Data":"d4ccf40f525517aab55701b8c1f6f2738c3db1ce5c0234bd0ff1db4dad0b158b"}
Jul 08 21:50:00.097047 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:00.096969    2583 scope.go:117] "RemoveContainer" containerID="11b8210f9091ca4302bd425a562db871fb5e6b5e918afa58199c02928c208426"
Jul 08 21:50:00.106285 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:00.106249    2583 scope.go:117] "RemoveContainer" containerID="11b8210f9091ca4302bd425a562db871fb5e6b5e918afa58199c02928c208426"
Jul 08 21:50:00.106522 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:50:00.106501    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11b8210f9091ca4302bd425a562db871fb5e6b5e918afa58199c02928c208426\": container with ID starting with 11b8210f9091ca4302bd425a562db871fb5e6b5e918afa58199c02928c208426 not found: ID does not exist" containerID="11b8210f9091ca4302bd425a562db871fb5e6b5e918afa58199c02928c208426"
Jul 08 21:50:00.106644 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:00.106527    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11b8210f9091ca4302bd425a562db871fb5e6b5e918afa58199c02928c208426"} err="failed to get container status \"11b8210f9091ca4302bd425a562db871fb5e6b5e918afa58199c02928c208426\": rpc error: code = NotFound desc = could not find container \"11b8210f9091ca4302bd425a562db871fb5e6b5e918afa58199c02928c208426\": container with ID starting with 11b8210f9091ca4302bd425a562db871fb5e6b5e918afa58199c02928c208426 not found: ID does not exist"
Jul 08 21:50:00.117676 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:00.117650    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"]
Jul 08 21:50:00.121434 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:00.121414    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-fbb91c-c5cdb7bfc-tcm96"]
Jul 08 21:50:01.429716 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:01.429686    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5501f78-4cf6-4d9c-995d-96862dd5fe3d" path="/var/lib/kubelet/pods/c5501f78-4cf6-4d9c-995d-96862dd5fe3d/volumes"
Jul 08 21:50:05.431841 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:05.431808    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"]
Jul 08 21:50:05.432272 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:05.432030    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh" podUID="c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" containerName="istio-proxy" containerID="cri-o://f53bef6fb25ee962997ab56ee40f3d0da5360099f7b1b28d19c2d84d39e62a88" gracePeriod=30
Jul 08 21:50:06.314804 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:06.314768    2583 patch_prober.go:28] interesting pod/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 21:50:06.314967 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:06.314853    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh" podUID="c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:50:06.500106 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:06.500072    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"]
Jul 08 21:50:06.500542 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:06.500323    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr" podUID="394868b9-03bc-4919-812f-99f2e67ae378" containerName="maas-api" containerID="cri-o://05d4fafde200e74f337eca641fe0502c810e2c039ea1be9d85e1874cf985739d" gracePeriod=30
Jul 08 21:50:06.746294 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:06.746272    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"
Jul 08 21:50:06.781929 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:06.781902    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/394868b9-03bc-4919-812f-99f2e67ae378-maas-api-tls\") pod \"394868b9-03bc-4919-812f-99f2e67ae378\" (UID: \"394868b9-03bc-4919-812f-99f2e67ae378\") "
Jul 08 21:50:06.782064 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:06.781968    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdnqq\" (UniqueName: \"kubernetes.io/projected/394868b9-03bc-4919-812f-99f2e67ae378-kube-api-access-bdnqq\") pod \"394868b9-03bc-4919-812f-99f2e67ae378\" (UID: \"394868b9-03bc-4919-812f-99f2e67ae378\") "
Jul 08 21:50:06.782064 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:06.782002    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/394868b9-03bc-4919-812f-99f2e67ae378-openshift-service-ca\") pod \"394868b9-03bc-4919-812f-99f2e67ae378\" (UID: \"394868b9-03bc-4919-812f-99f2e67ae378\") "
Jul 08 21:50:06.782465 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:06.782436    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/394868b9-03bc-4919-812f-99f2e67ae378-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "394868b9-03bc-4919-812f-99f2e67ae378" (UID: "394868b9-03bc-4919-812f-99f2e67ae378"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:50:06.784558 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:06.784529    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/394868b9-03bc-4919-812f-99f2e67ae378-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "394868b9-03bc-4919-812f-99f2e67ae378" (UID: "394868b9-03bc-4919-812f-99f2e67ae378"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:50:06.784695 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:06.784532    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/394868b9-03bc-4919-812f-99f2e67ae378-kube-api-access-bdnqq" (OuterVolumeSpecName: "kube-api-access-bdnqq") pod "394868b9-03bc-4919-812f-99f2e67ae378" (UID: "394868b9-03bc-4919-812f-99f2e67ae378"). InnerVolumeSpecName "kube-api-access-bdnqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:50:06.882908 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:06.882830    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/394868b9-03bc-4919-812f-99f2e67ae378-maas-api-tls\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:06.882908 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:06.882857    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdnqq\" (UniqueName: \"kubernetes.io/projected/394868b9-03bc-4919-812f-99f2e67ae378-kube-api-access-bdnqq\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:06.882908 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:06.882869    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/394868b9-03bc-4919-812f-99f2e67ae378-openshift-service-ca\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:07.130951 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:07.130918    2583 generic.go:356] "Generic (PLEG): container finished" podID="394868b9-03bc-4919-812f-99f2e67ae378" containerID="05d4fafde200e74f337eca641fe0502c810e2c039ea1be9d85e1874cf985739d" exitCode=0
Jul 08 21:50:07.131111 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:07.130963    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"
Jul 08 21:50:07.131111 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:07.131005    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr" event={"ID":"394868b9-03bc-4919-812f-99f2e67ae378","Type":"ContainerDied","Data":"05d4fafde200e74f337eca641fe0502c810e2c039ea1be9d85e1874cf985739d"}
Jul 08 21:50:07.131111 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:07.131066    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr" event={"ID":"394868b9-03bc-4919-812f-99f2e67ae378","Type":"ContainerDied","Data":"f2fe7596a24c8a70414bd20f3eb06bbdd63751b91afccf3212d3fe1a0386d015"}
Jul 08 21:50:07.131111 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:07.131095    2583 scope.go:117] "RemoveContainer" containerID="05d4fafde200e74f337eca641fe0502c810e2c039ea1be9d85e1874cf985739d"
Jul 08 21:50:07.140856 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:07.140837    2583 scope.go:117] "RemoveContainer" containerID="05d4fafde200e74f337eca641fe0502c810e2c039ea1be9d85e1874cf985739d"
Jul 08 21:50:07.141071 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:50:07.141054    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05d4fafde200e74f337eca641fe0502c810e2c039ea1be9d85e1874cf985739d\": container with ID starting with 05d4fafde200e74f337eca641fe0502c810e2c039ea1be9d85e1874cf985739d not found: ID does not exist" containerID="05d4fafde200e74f337eca641fe0502c810e2c039ea1be9d85e1874cf985739d"
Jul 08 21:50:07.141122 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:07.141079    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d4fafde200e74f337eca641fe0502c810e2c039ea1be9d85e1874cf985739d"} err="failed to get container status \"05d4fafde200e74f337eca641fe0502c810e2c039ea1be9d85e1874cf985739d\": rpc error: code = NotFound desc = could not find container \"05d4fafde200e74f337eca641fe0502c810e2c039ea1be9d85e1874cf985739d\": container with ID starting with 05d4fafde200e74f337eca641fe0502c810e2c039ea1be9d85e1874cf985739d not found: ID does not exist"
Jul 08 21:50:07.152460 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:07.152436    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"]
Jul 08 21:50:07.156396 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:07.156375    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6edaf8-7bb6ddc4cf-bsdhr"]
Jul 08 21:50:07.430007 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:07.429919    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="394868b9-03bc-4919-812f-99f2e67ae378" path="/var/lib/kubelet/pods/394868b9-03bc-4919-812f-99f2e67ae378/volumes"
Jul 08 21:50:10.692697 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.692644    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:50:10.715709 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.715679    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n87jd\" (UniqueName: \"kubernetes.io/projected/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-kube-api-access-n87jd\") pod \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") "
Jul 08 21:50:10.715849 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.715736    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-credential-socket\") pod \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") "
Jul 08 21:50:10.715849 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.715795    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-podinfo\") pod \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") "
Jul 08 21:50:10.715987 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.715851    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-workload-certs\") pod \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") "
Jul 08 21:50:10.715987 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.715917    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-data\") pod \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") "
Jul 08 21:50:10.715987 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.715972    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-workload-socket\") pod \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") "
Jul 08 21:50:10.716140 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.716004    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-envoy\") pod \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") "
Jul 08 21:50:10.716244 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.716220    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" (UID: "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:50:10.716420 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.716347    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" (UID: "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:50:10.716948 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.716333    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-token\") pod \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") "
Jul 08 21:50:10.716948 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.716879    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istiod-ca-cert\") pod \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\" (UID: \"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b\") "
Jul 08 21:50:10.718250 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.717352    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" (UID: "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:50:10.718250 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.717682    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" (UID: "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:50:10.718250 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.717892    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:10.718250 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.717914    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:10.718250 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.717927    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:10.718250 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.717939    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:10.718621 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.718303    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-data" (OuterVolumeSpecName: "istio-data") pod "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" (UID: "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:50:10.718689 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.718628    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-token" (OuterVolumeSpecName: "istio-token") pod "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" (UID: "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:50:10.718890 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.718862    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" (UID: "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 21:50:10.718890 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.718866    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-kube-api-access-n87jd" (OuterVolumeSpecName: "kube-api-access-n87jd") pod "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" (UID: "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b"). InnerVolumeSpecName "kube-api-access-n87jd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:50:10.719542 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.719524    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" (UID: "c9d2c3c1-9c1c-4482-bed2-c2289d7e590b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:50:10.818374 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.818341    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n87jd\" (UniqueName: \"kubernetes.io/projected/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-kube-api-access-n87jd\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:10.818374 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.818372    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:10.818374 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.818383    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:10.818623 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.818391    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:10.818623 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:10.818399    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:11.152926 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:11.152892    2583 generic.go:356] "Generic (PLEG): container finished" podID="c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" containerID="f53bef6fb25ee962997ab56ee40f3d0da5360099f7b1b28d19c2d84d39e62a88" exitCode=0
Jul 08 21:50:11.153100 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:11.152946    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"
Jul 08 21:50:11.153100 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:11.152979    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh" event={"ID":"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b","Type":"ContainerDied","Data":"f53bef6fb25ee962997ab56ee40f3d0da5360099f7b1b28d19c2d84d39e62a88"}
Jul 08 21:50:11.153100 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:11.153051    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh" event={"ID":"c9d2c3c1-9c1c-4482-bed2-c2289d7e590b","Type":"ContainerDied","Data":"86f78728201a412b2ab5fe5540973960019ef9be05a5de48549025aa49f19373"}
Jul 08 21:50:11.153100 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:11.153073    2583 scope.go:117] "RemoveContainer" containerID="f53bef6fb25ee962997ab56ee40f3d0da5360099f7b1b28d19c2d84d39e62a88"
Jul 08 21:50:11.161925 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:11.161909    2583 scope.go:117] "RemoveContainer" containerID="eec0931051ccfb13267dc1e54a9684221ca6925886a808f0dc8e802adda16b07"
Jul 08 21:50:11.172411 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:11.172008    2583 scope.go:117] "RemoveContainer" containerID="f53bef6fb25ee962997ab56ee40f3d0da5360099f7b1b28d19c2d84d39e62a88"
Jul 08 21:50:11.172411 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:50:11.172365    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f53bef6fb25ee962997ab56ee40f3d0da5360099f7b1b28d19c2d84d39e62a88\": container with ID starting with f53bef6fb25ee962997ab56ee40f3d0da5360099f7b1b28d19c2d84d39e62a88 not found: ID does not exist" containerID="f53bef6fb25ee962997ab56ee40f3d0da5360099f7b1b28d19c2d84d39e62a88"
Jul 08 21:50:11.172504 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:11.172407    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f53bef6fb25ee962997ab56ee40f3d0da5360099f7b1b28d19c2d84d39e62a88"} err="failed to get container status \"f53bef6fb25ee962997ab56ee40f3d0da5360099f7b1b28d19c2d84d39e62a88\": rpc error: code = NotFound desc = could not find container \"f53bef6fb25ee962997ab56ee40f3d0da5360099f7b1b28d19c2d84d39e62a88\": container with ID starting with f53bef6fb25ee962997ab56ee40f3d0da5360099f7b1b28d19c2d84d39e62a88 not found: ID does not exist"
Jul 08 21:50:11.172504 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:11.172430    2583 scope.go:117] "RemoveContainer" containerID="eec0931051ccfb13267dc1e54a9684221ca6925886a808f0dc8e802adda16b07"
Jul 08 21:50:11.172732 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:50:11.172714    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eec0931051ccfb13267dc1e54a9684221ca6925886a808f0dc8e802adda16b07\": container with ID starting with eec0931051ccfb13267dc1e54a9684221ca6925886a808f0dc8e802adda16b07 not found: ID does not exist" containerID="eec0931051ccfb13267dc1e54a9684221ca6925886a808f0dc8e802adda16b07"
Jul 08 21:50:11.172786 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:11.172738    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eec0931051ccfb13267dc1e54a9684221ca6925886a808f0dc8e802adda16b07"} err="failed to get container status \"eec0931051ccfb13267dc1e54a9684221ca6925886a808f0dc8e802adda16b07\": rpc error: code = NotFound desc = could not find container \"eec0931051ccfb13267dc1e54a9684221ca6925886a808f0dc8e802adda16b07\": container with ID starting with eec0931051ccfb13267dc1e54a9684221ca6925886a808f0dc8e802adda16b07 not found: ID does not exist"
Jul 08 21:50:11.174316 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:11.174298    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"]
Jul 08 21:50:11.177696 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:11.177674    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-fbb91c-openshift-default-f6d8d9855-6q7fh"]
Jul 08 21:50:11.430498 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:11.430413    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" path="/var/lib/kubelet/pods/c9d2c3c1-9c1c-4482-bed2-c2289d7e590b/volumes"
Jul 08 21:50:12.632779 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:12.632749    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"]
Jul 08 21:50:12.633241 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:12.632986    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm" podUID="890761f6-8389-4b43-9094-2e08468196c3" containerName="istio-proxy" containerID="cri-o://7fd09be51fc84b3604bc751097d6e81ab09b0749c49b65063ce1e27e70b63970" gracePeriod=30
Jul 08 21:50:17.882968 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.882944    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:50:17.976173 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.976094    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp5gz\" (UniqueName: \"kubernetes.io/projected/890761f6-8389-4b43-9094-2e08468196c3-kube-api-access-zp5gz\") pod \"890761f6-8389-4b43-9094-2e08468196c3\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") "
Jul 08 21:50:17.976173 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.976142    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-istio-envoy\") pod \"890761f6-8389-4b43-9094-2e08468196c3\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") "
Jul 08 21:50:17.976173 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.976168    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-credential-socket\") pod \"890761f6-8389-4b43-9094-2e08468196c3\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") "
Jul 08 21:50:17.976426 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.976187    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/890761f6-8389-4b43-9094-2e08468196c3-istio-podinfo\") pod \"890761f6-8389-4b43-9094-2e08468196c3\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") "
Jul 08 21:50:17.976426 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.976204    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-istio-data\") pod \"890761f6-8389-4b43-9094-2e08468196c3\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") "
Jul 08 21:50:17.976426 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.976221    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/890761f6-8389-4b43-9094-2e08468196c3-istiod-ca-cert\") pod \"890761f6-8389-4b43-9094-2e08468196c3\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") "
Jul 08 21:50:17.976426 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.976256    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-workload-certs\") pod \"890761f6-8389-4b43-9094-2e08468196c3\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") "
Jul 08 21:50:17.976426 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.976293    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-workload-socket\") pod \"890761f6-8389-4b43-9094-2e08468196c3\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") "
Jul 08 21:50:17.976426 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.976316    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/890761f6-8389-4b43-9094-2e08468196c3-istio-token\") pod \"890761f6-8389-4b43-9094-2e08468196c3\" (UID: \"890761f6-8389-4b43-9094-2e08468196c3\") "
Jul 08 21:50:17.976771 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.976523    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "890761f6-8389-4b43-9094-2e08468196c3" (UID: "890761f6-8389-4b43-9094-2e08468196c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:50:17.976771 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.976673    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "890761f6-8389-4b43-9094-2e08468196c3" (UID: "890761f6-8389-4b43-9094-2e08468196c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:50:17.976877 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.976765    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "890761f6-8389-4b43-9094-2e08468196c3" (UID: "890761f6-8389-4b43-9094-2e08468196c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:50:17.976877 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.976843    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/890761f6-8389-4b43-9094-2e08468196c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "890761f6-8389-4b43-9094-2e08468196c3" (UID: "890761f6-8389-4b43-9094-2e08468196c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:50:17.977123 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.977097    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "890761f6-8389-4b43-9094-2e08468196c3" (UID: "890761f6-8389-4b43-9094-2e08468196c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:50:17.978563 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.978536    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/890761f6-8389-4b43-9094-2e08468196c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "890761f6-8389-4b43-9094-2e08468196c3" (UID: "890761f6-8389-4b43-9094-2e08468196c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:50:17.978726 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.978580    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "890761f6-8389-4b43-9094-2e08468196c3" (UID: "890761f6-8389-4b43-9094-2e08468196c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:50:17.978726 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.978707    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/890761f6-8389-4b43-9094-2e08468196c3-kube-api-access-zp5gz" (OuterVolumeSpecName: "kube-api-access-zp5gz") pod "890761f6-8389-4b43-9094-2e08468196c3" (UID: "890761f6-8389-4b43-9094-2e08468196c3"). InnerVolumeSpecName "kube-api-access-zp5gz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:50:17.978802 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:17.978722    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/890761f6-8389-4b43-9094-2e08468196c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "890761f6-8389-4b43-9094-2e08468196c3" (UID: "890761f6-8389-4b43-9094-2e08468196c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 21:50:18.077940 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.077910    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp5gz\" (UniqueName: \"kubernetes.io/projected/890761f6-8389-4b43-9094-2e08468196c3-kube-api-access-zp5gz\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:18.077940 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.077934    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:18.077940 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.077943    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:18.078167 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.077952    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/890761f6-8389-4b43-9094-2e08468196c3-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:18.078167 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.077960    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:18.078167 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.077968    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/890761f6-8389-4b43-9094-2e08468196c3-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:18.078167 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.077975    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:18.078167 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.077984    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/890761f6-8389-4b43-9094-2e08468196c3-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:18.078167 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.077991    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/890761f6-8389-4b43-9094-2e08468196c3-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\""
Jul 08 21:50:18.186798 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.186767    2583 generic.go:356] "Generic (PLEG): container finished" podID="890761f6-8389-4b43-9094-2e08468196c3" containerID="7fd09be51fc84b3604bc751097d6e81ab09b0749c49b65063ce1e27e70b63970" exitCode=0
Jul 08 21:50:18.186973 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.186816    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"
Jul 08 21:50:18.186973 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.186859    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm" event={"ID":"890761f6-8389-4b43-9094-2e08468196c3","Type":"ContainerDied","Data":"7fd09be51fc84b3604bc751097d6e81ab09b0749c49b65063ce1e27e70b63970"}
Jul 08 21:50:18.186973 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.186911    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm" event={"ID":"890761f6-8389-4b43-9094-2e08468196c3","Type":"ContainerDied","Data":"c3b826e7b6bbfd7e45acbad3f0ff4b0a1b0cc71d7612792b0685a97fab844479"}
Jul 08 21:50:18.186973 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.186943    2583 scope.go:117] "RemoveContainer" containerID="7fd09be51fc84b3604bc751097d6e81ab09b0749c49b65063ce1e27e70b63970"
Jul 08 21:50:18.196046 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.196030    2583 scope.go:117] "RemoveContainer" containerID="55ffcb74729629ef4d0838a7638277f4c24e980d967ea4958283593e35f49887"
Jul 08 21:50:18.203462 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.203444    2583 scope.go:117] "RemoveContainer" containerID="7fd09be51fc84b3604bc751097d6e81ab09b0749c49b65063ce1e27e70b63970"
Jul 08 21:50:18.203705 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:50:18.203689    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fd09be51fc84b3604bc751097d6e81ab09b0749c49b65063ce1e27e70b63970\": container with ID starting with 7fd09be51fc84b3604bc751097d6e81ab09b0749c49b65063ce1e27e70b63970 not found: ID does not exist" containerID="7fd09be51fc84b3604bc751097d6e81ab09b0749c49b65063ce1e27e70b63970"
Jul 08 21:50:18.203755 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.203713    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fd09be51fc84b3604bc751097d6e81ab09b0749c49b65063ce1e27e70b63970"} err="failed to get container status \"7fd09be51fc84b3604bc751097d6e81ab09b0749c49b65063ce1e27e70b63970\": rpc error: code = NotFound desc = could not find container \"7fd09be51fc84b3604bc751097d6e81ab09b0749c49b65063ce1e27e70b63970\": container with ID starting with 7fd09be51fc84b3604bc751097d6e81ab09b0749c49b65063ce1e27e70b63970 not found: ID does not exist"
Jul 08 21:50:18.203755 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.203729    2583 scope.go:117] "RemoveContainer" containerID="55ffcb74729629ef4d0838a7638277f4c24e980d967ea4958283593e35f49887"
Jul 08 21:50:18.203942 ip-10-0-142-255 kubenswrapper[2583]: E0708 21:50:18.203927    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55ffcb74729629ef4d0838a7638277f4c24e980d967ea4958283593e35f49887\": container with ID starting with 55ffcb74729629ef4d0838a7638277f4c24e980d967ea4958283593e35f49887 not found: ID does not exist" containerID="55ffcb74729629ef4d0838a7638277f4c24e980d967ea4958283593e35f49887"
Jul 08 21:50:18.203977 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.203945    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ffcb74729629ef4d0838a7638277f4c24e980d967ea4958283593e35f49887"} err="failed to get container status \"55ffcb74729629ef4d0838a7638277f4c24e980d967ea4958283593e35f49887\": rpc error: code = NotFound desc = could not find container \"55ffcb74729629ef4d0838a7638277f4c24e980d967ea4958283593e35f49887\": container with ID starting with 55ffcb74729629ef4d0838a7638277f4c24e980d967ea4958283593e35f49887 not found: ID does not exist"
Jul 08 21:50:18.209880 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.209857    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"]
Jul 08 21:50:18.213469 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.213448    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-6edaf8-openshift-default-846ccb57dc-tnrnm"]
Jul 08 21:50:18.569318 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:18.569291    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8f47cbb78-gdxwg_1bd09752-66f6-4c7d-be94-70c7bcf7adf7/manager/0.log"
Jul 08 21:50:19.107993 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:19.107969    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94bc986b9-kxj8s_8c606878-9b04-425e-abc5-af3bb55a7ee3/copy-manifests/0.log"
Jul 08 21:50:19.114387 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:19.114364    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94bc986b9-kxj8s_8c606878-9b04-425e-abc5-af3bb55a7ee3/manager/0.log"
Jul 08 21:50:19.430544 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:19.430457    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="890761f6-8389-4b43-9094-2e08468196c3" path="/var/lib/kubelet/pods/890761f6-8389-4b43-9094-2e08468196c3/volumes"
Jul 08 21:50:20.078505 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:20.078479    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl_decff8aa-a1f8-4bb6-b55c-c3abfe413e95/util/0.log"
Jul 08 21:50:20.084917 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:20.084895    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl_decff8aa-a1f8-4bb6-b55c-c3abfe413e95/pull/0.log"
Jul 08 21:50:20.091485 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:20.091467    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl_decff8aa-a1f8-4bb6-b55c-c3abfe413e95/extract/0.log"
Jul 08 21:50:20.343940 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:20.343849    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz_cdef781e-23eb-43ca-80eb-71b93e23ea31/util/0.log"
Jul 08 21:50:20.350482 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:20.350453    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz_cdef781e-23eb-43ca-80eb-71b93e23ea31/pull/0.log"
Jul 08 21:50:20.356692 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:20.356673    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz_cdef781e-23eb-43ca-80eb-71b93e23ea31/extract/0.log"
Jul 08 21:50:20.483245 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:20.483211    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l_9b2d52ed-83f5-4e1f-89c1-5067036f0d5c/util/0.log"
Jul 08 21:50:20.489850 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:20.489823    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l_9b2d52ed-83f5-4e1f-89c1-5067036f0d5c/pull/0.log"
Jul 08 21:50:20.496282 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:20.496262    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l_9b2d52ed-83f5-4e1f-89c1-5067036f0d5c/extract/0.log"
Jul 08 21:50:22.053316 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:22.053286    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7l7ck_a12d5fd4-cb82-4be5-86af-20799b3b17ed/discovery/0.log"
Jul 08 21:50:22.556555 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:22.556528    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-p54vb_ca970978-6b0f-46c4-a17e-d65d81b74838/payload-pre-processing/0.log"
Jul 08 21:50:22.686369 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:22.686341    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-sx6dk_c75416fc-7533-43b7-865b-42931c4fd865/payload-processing/0.log"
Jul 08 21:50:23.557887 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:23.557858    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4k5dn_58bf86f2-6303-4811-9165-5604547223fe/main/0.log"
Jul 08 21:50:23.686453 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:23.686422    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dcrv9_b30eec96-da4f-48ea-9771-558a5994498c/main/0.log"
Jul 08 21:50:31.135618 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:31.135574    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-58wxg_a76885ac-b10f-40cd-aa28-4b274d95c017/global-pull-secret-syncer/0.log"
Jul 08 21:50:31.340938 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:31.340907    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-stmvp_594ec0f6-ccb6-4125-81f0-4ccf9115682b/konnectivity-agent/0.log"
Jul 08 21:50:31.410485 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:31.410407    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-255.ec2.internal_acd4d634ee249d4b487dddc3a283d199/haproxy/0.log"
Jul 08 21:50:35.611890 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:35.611863    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl_decff8aa-a1f8-4bb6-b55c-c3abfe413e95/extract/0.log"
Jul 08 21:50:35.641964 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:35.641943    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl_decff8aa-a1f8-4bb6-b55c-c3abfe413e95/util/0.log"
Jul 08 21:50:35.672718 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:35.672691    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xrqxl_decff8aa-a1f8-4bb6-b55c-c3abfe413e95/pull/0.log"
Jul 08 21:50:35.810916 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:35.810886    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz_cdef781e-23eb-43ca-80eb-71b93e23ea31/extract/0.log"
Jul 08 21:50:35.831897 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:35.831873    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz_cdef781e-23eb-43ca-80eb-71b93e23ea31/util/0.log"
Jul 08 21:50:35.859702 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:35.859681    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m4jfz_cdef781e-23eb-43ca-80eb-71b93e23ea31/pull/0.log"
Jul 08 21:50:35.886634 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:35.886557    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l_9b2d52ed-83f5-4e1f-89c1-5067036f0d5c/extract/0.log"
Jul 08 21:50:35.919604 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:35.919563    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l_9b2d52ed-83f5-4e1f-89c1-5067036f0d5c/util/0.log"
Jul 08 21:50:35.941625 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:35.941604    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mvj7l_9b2d52ed-83f5-4e1f-89c1-5067036f0d5c/pull/0.log"
Jul 08 21:50:38.866265 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:38.866236    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-2qjqc_f46bbf75-cd00-458f-be76-068012063e62/kube-state-metrics/0.log"
Jul 08 21:50:38.894642 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:38.894616    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-2qjqc_f46bbf75-cd00-458f-be76-068012063e62/kube-rbac-proxy-main/0.log"
Jul 08 21:50:38.914569 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:38.914545    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-2qjqc_f46bbf75-cd00-458f-be76-068012063e62/kube-rbac-proxy-self/0.log"
Jul 08 21:50:38.970569 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:38.970545    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-6p98z_952fa495-b638-402f-bf66-183252d18ed1/monitoring-plugin/0.log"
Jul 08 21:50:39.077661 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:39.077636    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9tk9w_8a0b7429-9fe3-42a7-b117-f846e7bab721/node-exporter/0.log"
Jul 08 21:50:39.097378 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:39.097355    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9tk9w_8a0b7429-9fe3-42a7-b117-f846e7bab721/kube-rbac-proxy/0.log"
Jul 08 21:50:39.118839 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:39.118781    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9tk9w_8a0b7429-9fe3-42a7-b117-f846e7bab721/init-textfile/0.log"
Jul 08 21:50:39.606814 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:39.606781    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbbdf85c5-6bhht_518c8a24-ba1d-4f24-ac17-ffeedbd7b729/thanos-query/0.log"
Jul 08 21:50:39.633191 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:39.633168    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbbdf85c5-6bhht_518c8a24-ba1d-4f24-ac17-ffeedbd7b729/kube-rbac-proxy-web/0.log"
Jul 08 21:50:39.655702 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:39.655680    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbbdf85c5-6bhht_518c8a24-ba1d-4f24-ac17-ffeedbd7b729/kube-rbac-proxy/0.log"
Jul 08 21:50:39.676150 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:39.676125    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbbdf85c5-6bhht_518c8a24-ba1d-4f24-ac17-ffeedbd7b729/prom-label-proxy/0.log"
Jul 08 21:50:39.699983 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:39.699958    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbbdf85c5-6bhht_518c8a24-ba1d-4f24-ac17-ffeedbd7b729/kube-rbac-proxy-rules/0.log"
Jul 08 21:50:39.731101 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:39.731071    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbbdf85c5-6bhht_518c8a24-ba1d-4f24-ac17-ffeedbd7b729/kube-rbac-proxy-metrics/0.log"
Jul 08 21:50:41.633721 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.633689    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"]
Jul 08 21:50:41.634096 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.633997    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" containerName="istio-proxy"
Jul 08 21:50:41.634096 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.634009    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" containerName="istio-proxy"
Jul 08 21:50:41.634096 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.634022    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5501f78-4cf6-4d9c-995d-96862dd5fe3d" containerName="maas-api"
Jul 08 21:50:41.634096 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.634027    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5501f78-4cf6-4d9c-995d-96862dd5fe3d" containerName="maas-api"
Jul 08 21:50:41.634096 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.634034    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" containerName="istio-proxy"
Jul 08 21:50:41.634096 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.634040    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" containerName="istio-proxy"
Jul 08 21:50:41.634096 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.634048    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="890761f6-8389-4b43-9094-2e08468196c3" containerName="istio-proxy"
Jul 08 21:50:41.634096 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.634052    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="890761f6-8389-4b43-9094-2e08468196c3" containerName="istio-proxy"
Jul 08 21:50:41.634096 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.634060    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="394868b9-03bc-4919-812f-99f2e67ae378" containerName="maas-api"
Jul 08 21:50:41.634096 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.634065    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="394868b9-03bc-4919-812f-99f2e67ae378" containerName="maas-api"
Jul 08 21:50:41.634096 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.634081    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="890761f6-8389-4b43-9094-2e08468196c3" containerName="istio-proxy"
Jul 08 21:50:41.634096 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.634086    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="890761f6-8389-4b43-9094-2e08468196c3" containerName="istio-proxy"
Jul 08 21:50:41.634496 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.634131    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5501f78-4cf6-4d9c-995d-96862dd5fe3d" containerName="maas-api"
Jul 08 21:50:41.634496 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.634137    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" containerName="istio-proxy"
Jul 08 21:50:41.634496 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.634143    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9d2c3c1-9c1c-4482-bed2-c2289d7e590b" containerName="istio-proxy"
Jul 08 21:50:41.634496 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.634149    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="890761f6-8389-4b43-9094-2e08468196c3" containerName="istio-proxy"
Jul 08 21:50:41.634496 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.634169    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="890761f6-8389-4b43-9094-2e08468196c3" containerName="istio-proxy"
Jul 08 21:50:41.634496 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.634177    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="394868b9-03bc-4919-812f-99f2e67ae378" containerName="maas-api"
Jul 08 21:50:41.636554 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.636533    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:41.639930 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.639910    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ntfkr\"/\"kube-root-ca.crt\""
Jul 08 21:50:41.640617 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.640599    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ntfkr\"/\"openshift-service-ca.crt\""
Jul 08 21:50:41.640704 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.640646    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ntfkr\"/\"default-dockercfg-hzz45\""
Jul 08 21:50:41.652193 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.652170    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"]
Jul 08 21:50:41.775457 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.775422    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d3b036a-b32c-4e69-8a29-2ee82b9a26cc-podres\") pod \"perf-node-gather-daemonset-2dbfz\" (UID: \"0d3b036a-b32c-4e69-8a29-2ee82b9a26cc\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:41.775687 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.775467    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d3b036a-b32c-4e69-8a29-2ee82b9a26cc-lib-modules\") pod \"perf-node-gather-daemonset-2dbfz\" (UID: \"0d3b036a-b32c-4e69-8a29-2ee82b9a26cc\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:41.775687 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.775490    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqbzr\" (UniqueName: \"kubernetes.io/projected/0d3b036a-b32c-4e69-8a29-2ee82b9a26cc-kube-api-access-wqbzr\") pod \"perf-node-gather-daemonset-2dbfz\" (UID: \"0d3b036a-b32c-4e69-8a29-2ee82b9a26cc\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:41.775687 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.775569    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d3b036a-b32c-4e69-8a29-2ee82b9a26cc-sys\") pod \"perf-node-gather-daemonset-2dbfz\" (UID: \"0d3b036a-b32c-4e69-8a29-2ee82b9a26cc\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:41.775687 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.775630    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d3b036a-b32c-4e69-8a29-2ee82b9a26cc-proc\") pod \"perf-node-gather-daemonset-2dbfz\" (UID: \"0d3b036a-b32c-4e69-8a29-2ee82b9a26cc\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:41.876254 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.876217    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d3b036a-b32c-4e69-8a29-2ee82b9a26cc-proc\") pod \"perf-node-gather-daemonset-2dbfz\" (UID: \"0d3b036a-b32c-4e69-8a29-2ee82b9a26cc\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:41.876421 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.876296    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d3b036a-b32c-4e69-8a29-2ee82b9a26cc-podres\") pod \"perf-node-gather-daemonset-2dbfz\" (UID: \"0d3b036a-b32c-4e69-8a29-2ee82b9a26cc\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:41.876421 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.876336    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d3b036a-b32c-4e69-8a29-2ee82b9a26cc-lib-modules\") pod \"perf-node-gather-daemonset-2dbfz\" (UID: \"0d3b036a-b32c-4e69-8a29-2ee82b9a26cc\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:41.876421 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.876338    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d3b036a-b32c-4e69-8a29-2ee82b9a26cc-proc\") pod \"perf-node-gather-daemonset-2dbfz\" (UID: \"0d3b036a-b32c-4e69-8a29-2ee82b9a26cc\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:41.876421 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.876364    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqbzr\" (UniqueName: \"kubernetes.io/projected/0d3b036a-b32c-4e69-8a29-2ee82b9a26cc-kube-api-access-wqbzr\") pod \"perf-node-gather-daemonset-2dbfz\" (UID: \"0d3b036a-b32c-4e69-8a29-2ee82b9a26cc\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:41.876610 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.876423    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d3b036a-b32c-4e69-8a29-2ee82b9a26cc-sys\") pod \"perf-node-gather-daemonset-2dbfz\" (UID: \"0d3b036a-b32c-4e69-8a29-2ee82b9a26cc\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:41.876610 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.876447    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d3b036a-b32c-4e69-8a29-2ee82b9a26cc-podres\") pod \"perf-node-gather-daemonset-2dbfz\" (UID: \"0d3b036a-b32c-4e69-8a29-2ee82b9a26cc\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:41.876610 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.876466    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d3b036a-b32c-4e69-8a29-2ee82b9a26cc-lib-modules\") pod \"perf-node-gather-daemonset-2dbfz\" (UID: \"0d3b036a-b32c-4e69-8a29-2ee82b9a26cc\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:41.876610 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.876493    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d3b036a-b32c-4e69-8a29-2ee82b9a26cc-sys\") pod \"perf-node-gather-daemonset-2dbfz\" (UID: \"0d3b036a-b32c-4e69-8a29-2ee82b9a26cc\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:41.883901 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.883843    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqbzr\" (UniqueName: \"kubernetes.io/projected/0d3b036a-b32c-4e69-8a29-2ee82b9a26cc-kube-api-access-wqbzr\") pod \"perf-node-gather-daemonset-2dbfz\" (UID: \"0d3b036a-b32c-4e69-8a29-2ee82b9a26cc\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:41.945361 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:41.945334    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:42.070054 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:42.069964    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"]
Jul 08 21:50:42.298363 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:42.298323    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz" event={"ID":"0d3b036a-b32c-4e69-8a29-2ee82b9a26cc","Type":"ContainerStarted","Data":"67accc35d69f11ee8e2fc1505104268b3584fdb7bc3571ef8e1b09dea160bd54"}
Jul 08 21:50:42.298546 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:42.298385    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz" event={"ID":"0d3b036a-b32c-4e69-8a29-2ee82b9a26cc","Type":"ContainerStarted","Data":"8a0f19a764d52af4d0c76d0ab329e3b496c00d5277daa001759a2271722ab5df"}
Jul 08 21:50:42.298546 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:42.298413    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:42.314878 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:42.314831    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz" podStartSLOduration=1.314816649 podStartE2EDuration="1.314816649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:50:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:50:42.312530994 +0000 UTC m=+2665.406334570" watchObservedRunningTime="2026-07-08 21:50:42.314816649 +0000 UTC m=+2665.408620256"
Jul 08 21:50:43.989120 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:43.989093    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rw49m_352a5cba-6f07-4f24-bd51-c1f8c52c6848/dns/0.log"
Jul 08 21:50:44.011308 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:44.011285    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rw49m_352a5cba-6f07-4f24-bd51-c1f8c52c6848/kube-rbac-proxy/0.log"
Jul 08 21:50:44.065479 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:44.065454    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8fkbn_35d39013-c4de-41ad-9f73-d009a2207661/dns-node-resolver/0.log"
Jul 08 21:50:44.670501 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:44.670472    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jmxt4_7d7a538d-6907-487e-b67f-c68e86d0e043/node-ca/0.log"
Jul 08 21:50:45.748790 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:45.748757    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7l7ck_a12d5fd4-cb82-4be5-86af-20799b3b17ed/discovery/0.log"
Jul 08 21:50:45.920317 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:45.920287    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-p54vb_ca970978-6b0f-46c4-a17e-d65d81b74838/payload-pre-processing/0.log"
Jul 08 21:50:45.966054 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:45.966026    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-sx6dk_c75416fc-7533-43b7-865b-42931c4fd865/payload-processing/0.log"
Jul 08 21:50:46.686663 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:46.686634    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b4q7m_723ef4ae-7bd1-4f3e-9824-68a3117131cd/serve-healthcheck-canary/0.log"
Jul 08 21:50:47.283387 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:47.283363    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hk2ln_c4084193-ce3e-4a6a-bb51-682b92e66523/kube-rbac-proxy/0.log"
Jul 08 21:50:47.303220 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:47.303195    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hk2ln_c4084193-ce3e-4a6a-bb51-682b92e66523/exporter/0.log"
Jul 08 21:50:47.324528 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:47.324496    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hk2ln_c4084193-ce3e-4a6a-bb51-682b92e66523/extractor/0.log"
Jul 08 21:50:48.312577 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:48.312550    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-2dbfz"
Jul 08 21:50:49.890828 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:49.890798    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8f47cbb78-gdxwg_1bd09752-66f6-4c7d-be94-70c7bcf7adf7/manager/0.log"
Jul 08 21:50:50.174410 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:50.174326    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94bc986b9-kxj8s_8c606878-9b04-425e-abc5-af3bb55a7ee3/manager/0.log"
Jul 08 21:50:50.198078 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:50.198050    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94bc986b9-kxj8s_8c606878-9b04-425e-abc5-af3bb55a7ee3/copy-manifests/0.log"
Jul 08 21:50:51.596649 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:51.596617    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66869b5f86-kz8ll_82c1ee56-9cfc-485a-b1bc-01a1104ae3f7/manager/0.log"
Jul 08 21:50:52.003657 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:52.003626    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7l7ck_a12d5fd4-cb82-4be5-86af-20799b3b17ed/discovery/0.log"
Jul 08 21:50:52.130210 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:52.130179    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-p54vb_ca970978-6b0f-46c4-a17e-d65d81b74838/payload-pre-processing/0.log"
Jul 08 21:50:52.165535 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:52.165506    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-sx6dk_c75416fc-7533-43b7-865b-42931c4fd865/payload-processing/0.log"
Jul 08 21:50:53.458056 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:53.458021    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7l7ck_a12d5fd4-cb82-4be5-86af-20799b3b17ed/discovery/0.log"
Jul 08 21:50:53.607918 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:53.607891    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-p54vb_ca970978-6b0f-46c4-a17e-d65d81b74838/payload-pre-processing/0.log"
Jul 08 21:50:53.643935 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:53.643907    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-sx6dk_c75416fc-7533-43b7-865b-42931c4fd865/payload-processing/0.log"
Jul 08 21:50:57.974036 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:57.973961    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2bfh8_0c1e243a-fc11-4e01-b2ec-cd50e5f2e610/kube-multus/0.log"
Jul 08 21:50:58.326471 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:58.326443    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lz4xt_59f1bd39-6d31-460e-99be-5bb083479ba8/kube-multus-additional-cni-plugins/0.log"
Jul 08 21:50:58.345146 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:58.345123    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lz4xt_59f1bd39-6d31-460e-99be-5bb083479ba8/egress-router-binary-copy/0.log"
Jul 08 21:50:58.364913 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:58.364892    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lz4xt_59f1bd39-6d31-460e-99be-5bb083479ba8/cni-plugins/0.log"
Jul 08 21:50:58.385365 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:58.385343    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lz4xt_59f1bd39-6d31-460e-99be-5bb083479ba8/bond-cni-plugin/0.log"
Jul 08 21:50:58.405380 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:58.405358    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lz4xt_59f1bd39-6d31-460e-99be-5bb083479ba8/routeoverride-cni/0.log"
Jul 08 21:50:58.425993 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:58.425970    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lz4xt_59f1bd39-6d31-460e-99be-5bb083479ba8/whereabouts-cni-bincopy/0.log"
Jul 08 21:50:58.453260 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:58.453236    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lz4xt_59f1bd39-6d31-460e-99be-5bb083479ba8/whereabouts-cni/0.log"
Jul 08 21:50:58.516497 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:58.516472    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qjpwc_b2421404-0026-4094-bf86-2f36fc0b21ea/network-metrics-daemon/0.log"
Jul 08 21:50:58.535349 ip-10-0-142-255 kubenswrapper[2583]: I0708 21:50:58.535329    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qjpwc_b2421404-0026-4094-bf86-2f36fc0b21ea/kube-rbac-proxy/0.log"