Jul 08 22:47:03.669648 ip-10-0-143-70 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 22:47:04.096325 ip-10-0-143-70 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 22:47:04.096325 ip-10-0-143-70 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 22:47:04.096325 ip-10-0-143-70 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 22:47:04.096325 ip-10-0-143-70 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 22:47:04.096325 ip-10-0-143-70 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 22:47:04.096325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.065337    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 22:47:04.096325 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068900    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:47:04.096325 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068912    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:47:04.096325 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068915    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:47:04.096325 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068918    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:47:04.096325 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068921    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:47:04.096325 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068924    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:47:04.096325 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068926    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:47:04.096325 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068930    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068932    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068935    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068938    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068940    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068943    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068945    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068951    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068954    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068957    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068960    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068962    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068965    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068967    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068970    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068972    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068977    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068981    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068984    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:47:04.098338 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068987    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068990    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068992    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068995    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.068998    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069000    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069003    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069006    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069009    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069011    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069014    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069016    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069020    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069024    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069027    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069029    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069032    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069035    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069037    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:47:04.098945 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069040    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069043    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069045    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069048    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069050    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069052    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069055    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069059    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069063    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069066    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069068    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069071    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069074    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069076    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069079    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069081    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069084    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069087    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069089    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:47:04.099520 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069092    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069096    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069098    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069101    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069103    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069106    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069108    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069111    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069114    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069116    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069119    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069121    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069124    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069127    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069130    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069132    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069135    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069137    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069139    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069142    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:47:04.223780 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069145    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:47:04.136545 ip-10-0-143-70 systemd[1]: Started Kubernetes Kubelet.
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069148    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069151    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069153    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069156    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069159    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069162    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069164    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069166    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069169    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069172    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069174    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069176    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069179    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069181    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069883    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069890    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069893    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069896    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069899    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:47:04.224467 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069902    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069905    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069907    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069910    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069912    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069915    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069918    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069920    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069923    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069925    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069928    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069931    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069934    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069938    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069942    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069945    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069948    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069950    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069953    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:47:04.225180 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069956    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069963    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069967    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069970    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069973    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069976    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069979    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069982    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069984    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069988    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069991    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069994    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069996    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.069999    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070002    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070005    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070007    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070010    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070012    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:47:04.225775 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070015    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070017    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070020    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070022    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070024    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070027    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070029    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070032    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070035    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070037    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070040    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070042    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070045    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070048    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070051    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070054    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070056    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070059    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070061    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070064    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:47:04.226356 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070066    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070069    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070071    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070074    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070076    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070079    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070081    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070083    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070086    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070089    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070091    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070093    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070096    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070098    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070100    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070103    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070105    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070108    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070111    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070115    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:47:04.226974 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070117    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070120    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070122    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070125    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070127    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070130    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070134    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070137    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070139    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070143    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070146    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070149    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070152    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070155    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070157    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070160    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070555    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070560    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070563    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070566    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:47:04.227612 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070569    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070572    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070574    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070577    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070579    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070582    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070585    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070587    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070590    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070592    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070595    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070599    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070602    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070604    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070607    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070609    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070612    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070614    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070619    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070621    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:47:04.228161 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070624    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070626    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070638    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070641    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070644    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070647    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070650    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070652    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070655    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070657    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070662    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070665    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070668    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070672    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070675    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070678    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070680    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070683    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070685    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:47:04.228848 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070688    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070692    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070695    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070698    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070702    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070705    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070707    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070710    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070713    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070715    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070718    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070722    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070724    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070727    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070729    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070732    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070734    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070737    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070739    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:47:04.229383 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070742    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070744    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070746    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070749    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070752    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070755    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070757    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070759    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070762    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070765    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070767    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070770    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070772    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070775    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070777    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070779    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070782    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070786    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070788    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070791    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:47:04.229987 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070794    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070797    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070799    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070802    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070805    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070808    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070810    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070813    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070815    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070818    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070820    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070823    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070826    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070828    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070830    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070833    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.070835    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070900    2574 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070908    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070914    2574 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070918    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 22:47:04.230871 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070923    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070927    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070931    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070935    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070938    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070941    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070945    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070948    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070953    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070956    2574 flags.go:64] FLAG: --cgroup-root=""
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070958    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070961    2574 flags.go:64] FLAG: --client-ca-file=""
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070964    2574 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070967    2574 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070972    2574 flags.go:64] FLAG: --cluster-domain=""
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070977    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070980    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070983    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070987    2574 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070990    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070993    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.070996    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071000    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071002    2574 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 22:47:04.231736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071005    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071008    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071011    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071014    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071017    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071020    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071023    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071026    2574 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071029    2574 flags.go:64] FLAG: --enable-server="true"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071033    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071037    2574 flags.go:64] FLAG: --event-burst="100"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071040    2574 flags.go:64] FLAG: --event-qps="50"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071043    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071046    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071049    2574 flags.go:64] FLAG: --eviction-hard=""
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071052    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071056    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071059    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071062    2574 flags.go:64] FLAG: --eviction-soft=""
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071064    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071067    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071070    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071072    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071077    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071079    2574 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 22:47:04.232379 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071082    2574 flags.go:64] FLAG: --feature-gates=""
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071086    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071089    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071092    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071095    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071098    2574 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071100    2574 flags.go:64] FLAG: --help="false"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071103    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-143-70.ec2.internal"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071106    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071109    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071112    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071115    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071118    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071121    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071124    2574 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071126    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071129    2574 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071132    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071135    2574 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071138    2574 flags.go:64] FLAG: --kube-reserved=""
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071140    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071143    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071146    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071150    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 22:47:04.233155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071153    2574 flags.go:64] FLAG: --lock-file=""
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071156    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071158    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071161    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071167    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071169    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071174    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071176    2574 flags.go:64] FLAG: --logging-format="text"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071179    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071182    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071185    2574 flags.go:64] FLAG: --manifest-url=""
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071188    2574 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071192    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071195    2574 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071199    2574 flags.go:64] FLAG: --max-pods="110"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071202    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071205    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071207    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071210    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071213    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071216    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071219    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071227    2574 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071229    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071232    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 22:47:04.233800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071235    2574 flags.go:64] FLAG: --pod-cidr=""
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071238    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071244    2574 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071247    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071250    2574 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071253    2574 flags.go:64] FLAG: --port="10250"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071256    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071259    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07ca37420418412fc"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071263    2574 flags.go:64] FLAG: --qos-reserved=""
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071265    2574 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071269    2574 flags.go:64] FLAG: --register-node="true"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071271    2574 flags.go:64] FLAG: --register-with-taints=""
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071275    2574 flags.go:64] FLAG: --registry-burst="10"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071279    2574 flags.go:64] FLAG: --registry-qps="5"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071282    2574 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071284    2574 flags.go:64] FLAG: --reserved-memory=""
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071288    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071291    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071294    2574 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071297    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071299    2574 flags.go:64] FLAG: --runonce="false"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071302    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071305    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071308    2574 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071311    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 22:47:04.234559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071314    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071317    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071320    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071323    2574 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071325    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071328    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071331    2574 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071333    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071336    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071339    2574 flags.go:64] FLAG: --system-cgroups=""
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071342    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071347    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071349    2574 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071352    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071358    2574 flags.go:64] FLAG: --tls-min-version=""
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071360    2574 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071363    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071366    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071368    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071371    2574 flags.go:64] FLAG: --v="2"
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071377    2574 flags.go:64] FLAG: --version="false"
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071381    2574 flags.go:64] FLAG: --vmodule=""
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071384    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.071387    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072218    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:47:04.237695 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072223    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072226    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072229    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072232    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072234    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072237    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072239    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072242    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072244    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072247    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072250    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072252    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072255    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072257    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072260    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072263    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072266    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072270    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072273    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:47:04.238741 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072276    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072279    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072283    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072286    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072288    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072291    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072294    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072296    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072302    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072304    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072307    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072309    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072312    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072314    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072317    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072319    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072322    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072325    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072327    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072330    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:47:04.392260 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072332    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072334    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072337    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072339    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072342    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072344    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072347    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072349    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072352    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072354    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072357    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072360    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072364    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072367    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072371    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072374    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072377    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072379    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072381    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:47:04.418750 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072384    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072387    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072408    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072412    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072416    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072420    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072422    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072426    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072429    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072432    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072434    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072437    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072439    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072442    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072444    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072447    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072449    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072452    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072454    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072457    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:47:04.419369 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072459    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072461    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072464    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072466    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072469    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072472    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072475    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072479    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072481    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072484    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072486    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072488    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072491    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072496    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072498    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072501    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072504    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072506    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072509    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:47:04.420223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.072511    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:47:04.420828 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.073451    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 22:47:04.420828 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.079941    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 22:47:04.420828 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.079959    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 22:47:04.420828 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.080689    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 22:47:04.420828 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.080701    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 22:47:04.420828 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080764    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:47:04.420828 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080770    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:47:04.420828 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080773    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:47:04.420828 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080776    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:47:04.420828 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080779    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:47:04.420828 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080782    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:47:04.420828 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080785    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:47:04.420828 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080790    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:47:04.420828 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080793    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080795    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080798    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080802    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080806    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080809    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080812    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080815    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080818    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080821    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080823    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080826    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080829    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080831    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080834    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080837    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080839    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080842    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080844    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080847    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:47:04.421686 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080850    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080857    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080861    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080865    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080868    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080871    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080874    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080876    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080879    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080881    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080884    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080888    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080891    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080894    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080896    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080899    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080901    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080904    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080907    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:47:04.422556 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080909    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080912    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080914    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080916    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080919    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080921    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080924    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080926    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080929    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080932    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080934    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080937    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080939    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080942    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080944    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080947    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080950    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080953    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080956    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080958    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:47:04.423413 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080961    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080963    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080965    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080968    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080972    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080974    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080977    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080979    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080982    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080985    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080987    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080990    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080993    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080995    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.080998    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081002    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081005    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081008    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081011    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:47:04.424298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081013    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:47:04.424955 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081016    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:47:04.424955 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081018    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:47:04.424955 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081021    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:47:04.424955 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081024    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:47:04.424955 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081026    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:47:04.424955 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081030    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:47:04.424955 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081033    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:47:04.424955 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081036    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:47:04.424955 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081039    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:47:04.424955 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081041    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:47:04.424955 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081043    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:47:04.424955 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081046    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:47:04.424955 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.081052    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 22:47:04.424955 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081170    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:47:04.424955 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081175    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081178    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081181    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081187    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081189    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081194    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081198    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081201    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081204    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081207    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081209    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081212    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081215    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081217    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081220    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081223    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081225    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081228    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081230    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081233    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:47:04.425619 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081236    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081239    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081242    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081247    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081249    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081252    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081254    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081258    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081260    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081263    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081266    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081268    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081271    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081274    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081276    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081280    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081283    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081285    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081288    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:47:04.426924 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081292    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081295    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081298    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081301    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081303    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081306    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081309    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081311    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081314    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081316    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081319    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081322    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081325    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081327    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081330    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081332    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081336    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081338    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081341    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081343    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:47:04.427790 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081346    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081349    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081351    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081354    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081356    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081358    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081361    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081363    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081367    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081369    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081372    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081375    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081377    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081380    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081382    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081385    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081387    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081409    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081412    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081415    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:47:04.428416 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081417    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081420    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081422    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081425    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081428    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081430    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081434    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081436    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081440    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081444    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081447    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081450    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081453    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081456    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081459    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081461    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081464    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081466    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:47:04.429006 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:04.081469    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:47:04.429620 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.081474    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 22:47:04.429620 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.081601    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 22:47:04.429620 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.083694    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 22:47:04.429620 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.084979    2574 server.go:1019] "Starting client certificate rotation"
Jul 08 22:47:04.429620 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.085078    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 22:47:04.429620 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.085108    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 22:47:04.429620 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.089125    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 22:47:04.429620 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.090314    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 22:47:04.429620 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.099721    2574 log.go:25] "Validated CRI v1 runtime API"
Jul 08 22:47:04.429620 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.101624    2574 log.go:25] "Validated CRI v1 image API"
Jul 08 22:47:04.429620 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.103478    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 22:47:04.429620 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.105725    2574 fs.go:135] Filesystem UUIDs: map[38f5872c-315e-4b11-9f1d-e0e46f7108af:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7a60a2aa-7e29-4589-ac22-b9530afcb253:/dev/nvme0n1p3]
Jul 08 22:47:04.430023 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.105739    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 22:47:04.430228 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.111384    2574 manager.go:216] Machine: {Timestamp:2026-07-08 22:47:04.110374778 +0000 UTC m=+0.320250986 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3202531 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec208ccaa18cf69558c79a287e3b900c SystemUUID:ec208cca-a18c-f695-58c7-9a287e3b900c BootID:12ce4f17-e4d3-40b0-b292-eb29f0091e58 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:12:db:f6:27:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:12:db:f6:27:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:14:9e:3c:c0:22 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 22:47:04.430228 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.111505    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 22:47:04.430228 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.111589    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 22:47:04.430228 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.112648    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 22:47:04.430228 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.112674    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-70.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 22:47:04.430228 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.113339    2574 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 22:47:04.430228 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.113347    2574 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 22:47:04.430228 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.113355    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.114616    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.115833    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.119647    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.119767    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.119796    2574 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.119807    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.119821    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.119830    2574 kubelet.go:398] "Adding apiserver pod source"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.119838    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.120332    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.120361    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.120490    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.128982    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.130760    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.130789    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.131733    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.131746    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.131753    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.131759    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.131768    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.131774    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.131782    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.131788    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.131794    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.131800    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.131809    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.131814    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.132460    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.132468    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:04.133853    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:04.133856    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.134061    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-70.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.135711    2574 server.go:1268] "Started kubelet"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.135781    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.135810    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.135877    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.137619    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.138255    2574 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 22:47:04.430519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.142766    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.142775    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:04.142828    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-70.ec2.internal\" not found"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.143288    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.143292    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.143309    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.143406    2574 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.143418    2574 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.146083    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zstxx"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.146290    2574 factory.go:55] Registering systemd factory
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.146305    2574 factory.go:223] Registration of the systemd container factory successfully
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.146592    2574 factory.go:153] Registering CRI-O factory
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.146608    2574 factory.go:223] Registration of the crio container factory successfully
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.146697    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:04.146701    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.146728    2574 factory.go:103] Registering Raw factory
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.146750    2574 manager.go:1196] Started watching for new ooms in manager
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.146938    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zstxx"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.147343    2574 manager.go:349] Starting recovery of all containers
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.156746    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.159166    2574 manager.go:354] Recovery completed
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:04.159248    2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-70.ec2.internal\" not found" node="ip-10-0-143-70.ec2.internal"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.164577    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.166482    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.166614    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.166624    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.167164    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.167168    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.167172    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.167189    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.167822    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.167845    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.167855    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.169361    2574 policy_none.go:49] "None policy: Start"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.169376    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.169388    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.171351    2574 policy_none.go:47] "Start"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.230244    2574 manager.go:337] "Starting Device Plugin manager"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:04.230275    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.230283    2574 server.go:87] "Starting device plugin registration server"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.230567    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.230582    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.230682    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 22:47:04.431748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.230767    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.230776    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:04.231337    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:04.231377    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-70.ec2.internal\" not found"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.309491    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.310582    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.310617    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.310645    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:04.310677    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.313498    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.331479    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.332513    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.332539    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.332552    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.332575    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-70.ec2.internal"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.343575    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-70.ec2.internal"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:04.343594    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-70.ec2.internal\": node \"ip-10-0-143-70.ec2.internal\" not found"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:04.358983    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-70.ec2.internal\" not found"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.411172    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-70.ec2.internal"]
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.411251    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.412806    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.412842    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.412854    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.416189    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.416405    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.416429    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.416996    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.417014    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.417023    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.417218    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.417229    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.417236    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.419257    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-70.ec2.internal"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.419278    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.420007    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:47:04.435076 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.420029    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:47:04.436091 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.420040    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:47:05.766193 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:04.442950    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-70.ec2.internal\" not found" node="ip-10-0-143-70.ec2.internal"
Jul 08 22:47:05.766193 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.444948    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eac1d2a0f3fcbb36c7b1769adc738465-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal\" (UID: \"eac1d2a0f3fcbb36c7b1769adc738465\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal"
Jul 08 22:47:05.766193 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.444980    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eac1d2a0f3fcbb36c7b1769adc738465-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal\" (UID: \"eac1d2a0f3fcbb36c7b1769adc738465\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal"
Jul 08 22:47:05.766193 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:04.445010    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff9df22879b0b8b1cf1cf0c7d2186ee4-config\") pod \"kube-apiserver-proxy-ip-10-0-143-70.ec2.internal\" (UID: \"ff9df22879b0b8b1cf1cf0c7d2186ee4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-70.ec2.internal"
Jul 08 22:47:05.766193 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:05.632811    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-70.ec2.internal\" not found" node="ip-10-0-143-70.ec2.internal"
Jul 08 22:47:05.766193 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:05.645372    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-70.ec2.internal\" not found"
Jul 08 22:47:05.766193 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:05.731139    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eac1d2a0f3fcbb36c7b1769adc738465-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal\" (UID: \"eac1d2a0f3fcbb36c7b1769adc738465\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal"
Jul 08 22:47:05.766193 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:05.731169    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eac1d2a0f3fcbb36c7b1769adc738465-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal\" (UID: \"eac1d2a0f3fcbb36c7b1769adc738465\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal"
Jul 08 22:47:05.766193 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:05.731185    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff9df22879b0b8b1cf1cf0c7d2186ee4-config\") pod \"kube-apiserver-proxy-ip-10-0-143-70.ec2.internal\" (UID: \"ff9df22879b0b8b1cf1cf0c7d2186ee4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-70.ec2.internal"
Jul 08 22:47:05.766193 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:05.731227    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff9df22879b0b8b1cf1cf0c7d2186ee4-config\") pod \"kube-apiserver-proxy-ip-10-0-143-70.ec2.internal\" (UID: \"ff9df22879b0b8b1cf1cf0c7d2186ee4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-70.ec2.internal"
Jul 08 22:47:05.766193 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:05.731260    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eac1d2a0f3fcbb36c7b1769adc738465-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal\" (UID: \"eac1d2a0f3fcbb36c7b1769adc738465\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal"
Jul 08 22:47:05.766193 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:05.731285    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eac1d2a0f3fcbb36c7b1769adc738465-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal\" (UID: \"eac1d2a0f3fcbb36c7b1769adc738465\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal"
Jul 08 22:47:05.766193 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:05.746087    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-70.ec2.internal\" not found"
Jul 08 22:47:05.929506 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:05.846864    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-70.ec2.internal\" not found"
Jul 08 22:47:05.932907 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:05.932775    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal"
Jul 08 22:47:06.114748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:05.935778    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-70.ec2.internal"
Jul 08 22:47:06.114748 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:05.947966    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-70.ec2.internal\" not found"
Jul 08 22:47:06.114748 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:06.048466    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-70.ec2.internal\" not found"
Jul 08 22:47:06.279563 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:06.148933    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-70.ec2.internal\" not found"
Jul 08 22:47:06.279563 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:06.249760    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-70.ec2.internal\" not found"
Jul 08 22:47:06.279563 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.269927    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 22:47:06.279563 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.270069    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 22:47:06.279563 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.270097    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.292134    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.306378    2574 apiserver.go:52] "Watching apiserver"
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.315852    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.316175    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4sd78","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg","openshift-cluster-node-tuning-operator/tuned-jhd48","openshift-multus/multus-58lmh","openshift-multus/multus-additional-cni-plugins-bcjd8","openshift-multus/network-metrics-daemon-8kgb8","openshift-network-diagnostics/network-check-target-52n4x","openshift-network-operator/iptables-alerter-m2mx4","kube-system/konnectivity-agent-zmwdz","openshift-dns/node-resolver-ztqww","openshift-image-registry/node-ca-xnvtv","openshift-ovn-kubernetes/ovnkube-node-kb8bv"]
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.318390    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:06.318459    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.320342    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.322784    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.323004    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bqfgf\""
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.323201    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.323367    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.323384    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.326344    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.326363    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q4rfx\""
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.326533    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.328153    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.328229    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal"
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.331774    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.334054    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.334571    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.334631    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.334734    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4l6bv\""
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.334740    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/977bd50f-ac01-4a5d-8157-89ca6e78fb21-multus-daemon-config\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.423997 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.334772    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d56c9bb-23d5-45f4-ac28-b73d088da22d-dbus\") pod \"global-pull-secret-syncer-4sd78\" (UID: \"9d56c9bb-23d5-45f4-ac28-b73d088da22d\") " pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:06.426506 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.334796    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-sys-fs\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.426506 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.334817    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-multus-socket-dir-parent\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.426506 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.334830    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 22:47:06.426506 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.334885    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-var-lib-kubelet\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.426506 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.334910    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-hostroot\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.426506 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.334892    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 22:47:06.426506 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.334930    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-etc-kubernetes\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.426506 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.334951    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-sysctl-conf\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.426506 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335005    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.426506 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335039    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-kubernetes\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.426506 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335065    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-tuned\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.426506 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335086    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-system-cni-dir\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.426506 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335107    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-run-k8s-cni-cncf-io\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.426506 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335133    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-var-lib-cni-multus\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.426506 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335155    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-multus-conf-dir\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.427114 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335170    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-etc-selinux\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.427114 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335183    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-var-lib-kubelet\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.427114 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335198    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng55b\" (UniqueName: \"kubernetes.io/projected/1edc1995-d4b8-4e99-a879-b326246fbee3-kube-api-access-ng55b\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.427114 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335218    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-run-multus-certs\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.427114 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335232    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4x2f\" (UniqueName: \"kubernetes.io/projected/977bd50f-ac01-4a5d-8157-89ca6e78fb21-kube-api-access-k4x2f\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.427114 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335247    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret\") pod \"global-pull-secret-syncer-4sd78\" (UID: \"9d56c9bb-23d5-45f4-ac28-b73d088da22d\") " pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:06.427114 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335262    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grkhd\" (UniqueName: \"kubernetes.io/projected/9a0e746f-c560-43f6-ae90-244af4b9775f-kube-api-access-grkhd\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.427114 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335276    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-sysconfig\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.427114 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335298    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-systemd\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.427114 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335313    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1edc1995-d4b8-4e99-a879-b326246fbee3-tmp\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.427114 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335328    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/977bd50f-ac01-4a5d-8157-89ca6e78fb21-cni-binary-copy\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.427114 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335344    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d56c9bb-23d5-45f4-ac28-b73d088da22d-kubelet-config\") pod \"global-pull-secret-syncer-4sd78\" (UID: \"9d56c9bb-23d5-45f4-ac28-b73d088da22d\") " pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:06.427114 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335358    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-socket-dir\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.427655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335381    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-modprobe-d\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.427655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335404    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-sysctl-d\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.427655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335430    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-var-lib-cni-bin\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.427655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335403    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 22:42:05 +0000 UTC" deadline="2028-04-17 16:14:00.906258086 +0000 UTC"
Jul 08 22:47:06.427655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335452    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15569h26m54.570809204s"
Jul 08 22:47:06.427655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335453    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-registration-dir\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.427655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335474    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-sys\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.427655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335488    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-host\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.427655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335501    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-multus-cni-dir\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.427655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335514    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-cnibin\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.427655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335561    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-os-release\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.427655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335593    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-run-netns\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.427655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335620    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-device-dir\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.427655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335642    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-run\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.427655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.335665    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-lib-modules\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.336455    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.336663    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.336772    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-69dvr\""
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.336938    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:06.337057    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.338920    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.339633    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:06.339726    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.340304    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.340351    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-70.ec2.internal"
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.342265    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m2mx4"
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.344569    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.344836    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.344993    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.345112    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gf7ql\""
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.345257    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zmwdz"
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.347411    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.347617    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ztqww"
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.347652    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qltsr\""
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.347739    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.350139    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xnvtv"
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.351278    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.351326    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.351365    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nffww\""
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.352482    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.352614    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h29sg\""
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.352631    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 22:47:06.428207 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.352648    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 22:47:06.429206 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.352880    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal"]
Jul 08 22:47:06.429206 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.352976    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.429206 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.355406    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 22:47:06.429206 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.355425    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 22:47:06.429206 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.355824    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rk6r5\""
Jul 08 22:47:06.429206 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.355900    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 22:47:06.429206 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.355906    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 22:47:06.429206 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.355936    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 22:47:06.429206 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.355977    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 22:47:06.429206 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.356876    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 22:47:06.429206 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.357516    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-70.ec2.internal"]
Jul 08 22:47:06.429206 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.362401    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fvlj5"
Jul 08 22:47:06.429206 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.370452    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fvlj5"
Jul 08 22:47:06.430259 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.430140    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 22:47:06.545006 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.435857    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-sysctl-conf\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.545006 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.435898    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-var-lib-openvswitch\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.545006 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.435932    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-node-log\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.545006 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.435954    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-cni-netd\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.545006 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.435984    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-kubernetes\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.545006 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436029    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-sysctl-conf\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.545006 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436031    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-system-cni-dir\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.545006 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436067    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-kubernetes\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.545006 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436101    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-var-lib-cni-multus\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.545006 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436121    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-system-cni-dir\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.545006 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436137    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-multus-conf-dir\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.545006 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436169    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-var-lib-cni-multus\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.545006 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436207    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-systemd-units\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.545006 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436230    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-run-openvswitch\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.546136 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436255    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/017f7171-4e43-4468-b4d0-9336ef8bfcee-cnibin\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.546136 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436266    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-multus-conf-dir\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.546136 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436286    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-etc-selinux\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.546136 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436318    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-run-multus-certs\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.546136 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436353    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/021e1384-753b-4d72-a772-b89e2bfcd232-serviceca\") pod \"node-ca-xnvtv\" (UID: \"021e1384-753b-4d72-a772-b89e2bfcd232\") " pod="openshift-image-registry/node-ca-xnvtv"
Jul 08 22:47:06.546136 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436359    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-etc-selinux\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.546136 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436378    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret\") pod \"global-pull-secret-syncer-4sd78\" (UID: \"9d56c9bb-23d5-45f4-ac28-b73d088da22d\") " pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:06.546136 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436396    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-run-multus-certs\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.546136 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436424    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-systemd\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.546136 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436445    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1edc1995-d4b8-4e99-a879-b326246fbee3-tmp\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.546136 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436491    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/571e851d-c74f-49ae-93fe-86afecc79768-ovnkube-script-lib\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.546136 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436516    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/017f7171-4e43-4468-b4d0-9336ef8bfcee-system-cni-dir\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.546136 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436549    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/201fdbe1-ca16-49f6-b414-cc975c6605a9-host-slash\") pod \"iptables-alerter-m2mx4\" (UID: \"201fdbe1-ca16-49f6-b414-cc975c6605a9\") " pod="openshift-network-operator/iptables-alerter-m2mx4"
Jul 08 22:47:06.546136 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436575    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-socket-dir\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.552217 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436600    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-modprobe-d\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.552217 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436623    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-sysctl-d\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.552217 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436646    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-kubelet\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.552217 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436736    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-run-ovn\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.552217 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436762    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9jgh\" (UniqueName: \"kubernetes.io/projected/7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998-kube-api-access-x9jgh\") pod \"node-resolver-ztqww\" (UID: \"7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998\") " pod="openshift-dns/node-resolver-ztqww"
Jul 08 22:47:06.552217 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436792    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-systemd\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.552217 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436774    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 22:47:06.552217 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436819    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-sys\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.552217 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436854    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-multus-cni-dir\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.552217 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436878    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-os-release\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.552217 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:06.436883    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:06.552217 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436944    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-run-netns\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.552217 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.436978    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/571e851d-c74f-49ae-93fe-86afecc79768-env-overrides\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.552217 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437001    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/017f7171-4e43-4468-b4d0-9336ef8bfcee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.552217 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437014    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-socket-dir\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.553208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437025    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrkh9\" (UniqueName: \"kubernetes.io/projected/201fdbe1-ca16-49f6-b414-cc975c6605a9-kube-api-access-mrkh9\") pod \"iptables-alerter-m2mx4\" (UID: \"201fdbe1-ca16-49f6-b414-cc975c6605a9\") " pod="openshift-network-operator/iptables-alerter-m2mx4"
Jul 08 22:47:06.553208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437056    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998-hosts-file\") pod \"node-resolver-ztqww\" (UID: \"7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998\") " pod="openshift-dns/node-resolver-ztqww"
Jul 08 22:47:06.553208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437078    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-device-dir\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.553208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437130    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-sysctl-d\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.553208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437144    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-run\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.553208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437166    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/977bd50f-ac01-4a5d-8157-89ca6e78fb21-multus-daemon-config\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.553208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437193    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-modprobe-d\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.553208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437189    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/571e851d-c74f-49ae-93fe-86afecc79768-ovnkube-config\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.553208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437222    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-multus-socket-dir-parent\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.553208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437232    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-sys\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.553208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437244    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-var-lib-kubelet\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.553208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437267    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.553208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437289    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/017f7171-4e43-4468-b4d0-9336ef8bfcee-cni-binary-copy\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.553208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437312    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzs74\" (UniqueName: \"kubernetes.io/projected/021e1384-753b-4d72-a772-b89e2bfcd232-kube-api-access-mzs74\") pod \"node-ca-xnvtv\" (UID: \"021e1384-753b-4d72-a772-b89e2bfcd232\") " pod="openshift-image-registry/node-ca-xnvtv"
Jul 08 22:47:06.554031 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437317    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-multus-cni-dir\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.554031 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437366    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-device-dir\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.554031 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437405    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-run\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.554031 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:06.437419    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret podName:9d56c9bb-23d5-45f4-ac28-b73d088da22d nodeName:}" failed. No retries permitted until 2026-07-08 22:47:06.937381737 +0000 UTC m=+1.961963729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret") pod "global-pull-secret-syncer-4sd78" (UID: "9d56c9bb-23d5-45f4-ac28-b73d088da22d") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:06.554031 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437903    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/977bd50f-ac01-4a5d-8157-89ca6e78fb21-multus-daemon-config\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.554031 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.437988    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-multus-socket-dir-parent\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.554031 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438023    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-var-lib-kubelet\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.554031 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438102    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-os-release\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.554031 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438132    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-run-netns\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.554031 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438166    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9a616ad8-cd7d-41ed-b42e-3cd2e8cc4db8-konnectivity-ca\") pod \"konnectivity-agent-zmwdz\" (UID: \"9a616ad8-cd7d-41ed-b42e-3cd2e8cc4db8\") " pod="kube-system/konnectivity-agent-zmwdz"
Jul 08 22:47:06.554031 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438200    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-etc-openvswitch\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.554031 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438229    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/017f7171-4e43-4468-b4d0-9336ef8bfcee-os-release\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.554031 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438253    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc79w\" (UniqueName: \"kubernetes.io/projected/017f7171-4e43-4468-b4d0-9336ef8bfcee-kube-api-access-gc79w\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.554031 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438283    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.555325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438308    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-tuned\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.555325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438386    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-run-k8s-cni-cncf-io\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.555325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438404    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4x2f\" (UniqueName: \"kubernetes.io/projected/977bd50f-ac01-4a5d-8157-89ca6e78fb21-kube-api-access-k4x2f\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.555325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438440    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998-tmp-dir\") pod \"node-resolver-ztqww\" (UID: \"7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998\") " pod="openshift-dns/node-resolver-ztqww"
Jul 08 22:47:06.555325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438457    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-var-lib-kubelet\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.555325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438482    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng55b\" (UniqueName: \"kubernetes.io/projected/1edc1995-d4b8-4e99-a879-b326246fbee3-kube-api-access-ng55b\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.555325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438497    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-run-systemd\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.555325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438555    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-run-ovn-kubernetes\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.555325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438571    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/017f7171-4e43-4468-b4d0-9336ef8bfcee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.555325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438589    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9a616ad8-cd7d-41ed-b42e-3cd2e8cc4db8-agent-certs\") pod \"konnectivity-agent-zmwdz\" (UID: \"9a616ad8-cd7d-41ed-b42e-3cd2e8cc4db8\") " pod="kube-system/konnectivity-agent-zmwdz"
Jul 08 22:47:06.555325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438610    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grkhd\" (UniqueName: \"kubernetes.io/projected/9a0e746f-c560-43f6-ae90-244af4b9775f-kube-api-access-grkhd\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.555325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438634    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-sysconfig\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.555325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438649    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/977bd50f-ac01-4a5d-8157-89ca6e78fb21-cni-binary-copy\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.555325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438667    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dktpz\" (UniqueName: \"kubernetes.io/projected/571e851d-c74f-49ae-93fe-86afecc79768-kube-api-access-dktpz\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.555950 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438705    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d56c9bb-23d5-45f4-ac28-b73d088da22d-kubelet-config\") pod \"global-pull-secret-syncer-4sd78\" (UID: \"9d56c9bb-23d5-45f4-ac28-b73d088da22d\") " pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:06.555950 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438710    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-var-lib-kubelet\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.555950 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438765    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-var-lib-cni-bin\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.555950 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438771    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-sysconfig\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.555950 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438782    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-run-netns\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.555950 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438797    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-cni-bin\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.555950 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438804    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.555950 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438817    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/571e851d-c74f-49ae-93fe-86afecc79768-ovn-node-metrics-cert\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.555950 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438833    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d56c9bb-23d5-45f4-ac28-b73d088da22d-kubelet-config\") pod \"global-pull-secret-syncer-4sd78\" (UID: \"9d56c9bb-23d5-45f4-ac28-b73d088da22d\") " pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:06.555950 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438840    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/021e1384-753b-4d72-a772-b89e2bfcd232-host\") pod \"node-ca-xnvtv\" (UID: \"021e1384-753b-4d72-a772-b89e2bfcd232\") " pod="openshift-image-registry/node-ca-xnvtv"
Jul 08 22:47:06.555950 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dfbz\" (UniqueName: \"kubernetes.io/projected/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-kube-api-access-6dfbz\") pod \"network-metrics-daemon-8kgb8\" (UID: \"b3eb825e-1dd9-461e-86b2-9fad2fade7e4\") " pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:06.555950 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438885    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-registration-dir\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.555950 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438900    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-host\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.555950 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-cnibin\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.556573 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438938    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/017f7171-4e43-4468-b4d0-9336ef8bfcee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.556573 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438955    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-lib-modules\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.556573 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438969    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-slash\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.556573 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.438996    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-log-socket\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.556573 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439068    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-run-k8s-cni-cncf-io\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.556573 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439065    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnj54\" (UniqueName: \"kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54\") pod \"network-check-target-52n4x\" (UID: \"51fbf654-be84-41a6-b24c-1bd691c7c7fd\") " pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:06.556573 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439121    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-registration-dir\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.556573 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439117    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d56c9bb-23d5-45f4-ac28-b73d088da22d-dbus\") pod \"global-pull-secret-syncer-4sd78\" (UID: \"9d56c9bb-23d5-45f4-ac28-b73d088da22d\") " pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:06.556573 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439157    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-sys-fs\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.556573 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439176    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d56c9bb-23d5-45f4-ac28-b73d088da22d-dbus\") pod \"global-pull-secret-syncer-4sd78\" (UID: \"9d56c9bb-23d5-45f4-ac28-b73d088da22d\") " pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:06.556573 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439188    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-hostroot\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.556573 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439216    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-etc-kubernetes\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.556573 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439244    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/201fdbe1-ca16-49f6-b414-cc975c6605a9-iptables-alerter-script\") pod \"iptables-alerter-m2mx4\" (UID: \"201fdbe1-ca16-49f6-b414-cc975c6605a9\") " pod="openshift-network-operator/iptables-alerter-m2mx4"
Jul 08 22:47:06.556573 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439302    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs\") pod \"network-metrics-daemon-8kgb8\" (UID: \"b3eb825e-1dd9-461e-86b2-9fad2fade7e4\") " pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:06.557172 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439375    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-host-var-lib-cni-bin\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.557172 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439414    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-host\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.557172 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439460    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1edc1995-d4b8-4e99-a879-b326246fbee3-lib-modules\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.557172 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439453    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a0e746f-c560-43f6-ae90-244af4b9775f-sys-fs\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.557172 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439511    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-cnibin\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.557172 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439566    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-etc-kubernetes\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.557172 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439513    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/977bd50f-ac01-4a5d-8157-89ca6e78fb21-hostroot\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.557172 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.439582    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/977bd50f-ac01-4a5d-8157-89ca6e78fb21-cni-binary-copy\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.557172 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.440236    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1edc1995-d4b8-4e99-a879-b326246fbee3-tmp\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.557172 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.440573    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1edc1995-d4b8-4e99-a879-b326246fbee3-etc-tuned\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.557172 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.447090    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng55b\" (UniqueName: \"kubernetes.io/projected/1edc1995-d4b8-4e99-a879-b326246fbee3-kube-api-access-ng55b\") pod \"tuned-jhd48\" (UID: \"1edc1995-d4b8-4e99-a879-b326246fbee3\") " pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.557172 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.447844    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grkhd\" (UniqueName: \"kubernetes.io/projected/9a0e746f-c560-43f6-ae90-244af4b9775f-kube-api-access-grkhd\") pod \"aws-ebs-csi-driver-node-b6spg\" (UID: \"9a0e746f-c560-43f6-ae90-244af4b9775f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.557172 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.448602    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4x2f\" (UniqueName: \"kubernetes.io/projected/977bd50f-ac01-4a5d-8157-89ca6e78fb21-kube-api-access-k4x2f\") pod \"multus-58lmh\" (UID: \"977bd50f-ac01-4a5d-8157-89ca6e78fb21\") " pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.557172 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540347    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-var-lib-openvswitch\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.557172 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540373    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-node-log\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.557664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540391    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-cni-netd\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.557664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540407    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-systemd-units\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.557664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540424    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-run-openvswitch\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.557664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540449    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/017f7171-4e43-4468-b4d0-9336ef8bfcee-cnibin\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.557664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540454    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-var-lib-openvswitch\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.557664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540470    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-cni-netd\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.557664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540479    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-systemd-units\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.557664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540473    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/021e1384-753b-4d72-a772-b89e2bfcd232-serviceca\") pod \"node-ca-xnvtv\" (UID: \"021e1384-753b-4d72-a772-b89e2bfcd232\") " pod="openshift-image-registry/node-ca-xnvtv"
Jul 08 22:47:06.557664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540460    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-node-log\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.557664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540507    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/017f7171-4e43-4468-b4d0-9336ef8bfcee-cnibin\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.557664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540507    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-run-openvswitch\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.557664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540542    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/571e851d-c74f-49ae-93fe-86afecc79768-ovnkube-script-lib\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.557664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540590    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/017f7171-4e43-4468-b4d0-9336ef8bfcee-system-cni-dir\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.557664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540630    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/201fdbe1-ca16-49f6-b414-cc975c6605a9-host-slash\") pod \"iptables-alerter-m2mx4\" (UID: \"201fdbe1-ca16-49f6-b414-cc975c6605a9\") " pod="openshift-network-operator/iptables-alerter-m2mx4"
Jul 08 22:47:06.557664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540656    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-kubelet\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.558157 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540664    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/017f7171-4e43-4468-b4d0-9336ef8bfcee-system-cni-dir\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.558157 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540675    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-run-ovn\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.558157 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540714    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-kubelet\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.558157 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540734    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-run-ovn\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.558157 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540732    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/201fdbe1-ca16-49f6-b414-cc975c6605a9-host-slash\") pod \"iptables-alerter-m2mx4\" (UID: \"201fdbe1-ca16-49f6-b414-cc975c6605a9\") " pod="openshift-network-operator/iptables-alerter-m2mx4"
Jul 08 22:47:06.558157 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540751    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9jgh\" (UniqueName: \"kubernetes.io/projected/7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998-kube-api-access-x9jgh\") pod \"node-resolver-ztqww\" (UID: \"7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998\") " pod="openshift-dns/node-resolver-ztqww"
Jul 08 22:47:06.558157 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540783    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/571e851d-c74f-49ae-93fe-86afecc79768-env-overrides\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.558157 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540801    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/017f7171-4e43-4468-b4d0-9336ef8bfcee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.558157 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540830    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrkh9\" (UniqueName: \"kubernetes.io/projected/201fdbe1-ca16-49f6-b414-cc975c6605a9-kube-api-access-mrkh9\") pod \"iptables-alerter-m2mx4\" (UID: \"201fdbe1-ca16-49f6-b414-cc975c6605a9\") " pod="openshift-network-operator/iptables-alerter-m2mx4"
Jul 08 22:47:06.558157 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540854    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998-hosts-file\") pod \"node-resolver-ztqww\" (UID: \"7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998\") " pod="openshift-dns/node-resolver-ztqww"
Jul 08 22:47:06.558157 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540883    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/571e851d-c74f-49ae-93fe-86afecc79768-ovnkube-config\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.558157 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.540912    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.558157 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.541654    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/017f7171-4e43-4468-b4d0-9336ef8bfcee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.558157 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.541704    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/571e851d-c74f-49ae-93fe-86afecc79768-ovnkube-script-lib\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.558603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.541732    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/571e851d-c74f-49ae-93fe-86afecc79768-ovnkube-config\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.558603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.541820    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/021e1384-753b-4d72-a772-b89e2bfcd232-serviceca\") pod \"node-ca-xnvtv\" (UID: \"021e1384-753b-4d72-a772-b89e2bfcd232\") " pod="openshift-image-registry/node-ca-xnvtv"
Jul 08 22:47:06.558603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.541869    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.558603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.541913    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/017f7171-4e43-4468-b4d0-9336ef8bfcee-cni-binary-copy\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.558603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.541940    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998-hosts-file\") pod \"node-resolver-ztqww\" (UID: \"7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998\") " pod="openshift-dns/node-resolver-ztqww"
Jul 08 22:47:06.558603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.541952    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzs74\" (UniqueName: \"kubernetes.io/projected/021e1384-753b-4d72-a772-b89e2bfcd232-kube-api-access-mzs74\") pod \"node-ca-xnvtv\" (UID: \"021e1384-753b-4d72-a772-b89e2bfcd232\") " pod="openshift-image-registry/node-ca-xnvtv"
Jul 08 22:47:06.558603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.541978    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9a616ad8-cd7d-41ed-b42e-3cd2e8cc4db8-konnectivity-ca\") pod \"konnectivity-agent-zmwdz\" (UID: \"9a616ad8-cd7d-41ed-b42e-3cd2e8cc4db8\") " pod="kube-system/konnectivity-agent-zmwdz"
Jul 08 22:47:06.558603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542000    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-etc-openvswitch\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.558603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542025    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/017f7171-4e43-4468-b4d0-9336ef8bfcee-os-release\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.558603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542059    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc79w\" (UniqueName: \"kubernetes.io/projected/017f7171-4e43-4468-b4d0-9336ef8bfcee-kube-api-access-gc79w\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.558603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542110    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998-tmp-dir\") pod \"node-resolver-ztqww\" (UID: \"7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998\") " pod="openshift-dns/node-resolver-ztqww"
Jul 08 22:47:06.558603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542146    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-run-systemd\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.558603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542177    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-run-ovn-kubernetes\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.558603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542213    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/017f7171-4e43-4468-b4d0-9336ef8bfcee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.559073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542251    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9a616ad8-cd7d-41ed-b42e-3cd2e8cc4db8-agent-certs\") pod \"konnectivity-agent-zmwdz\" (UID: \"9a616ad8-cd7d-41ed-b42e-3cd2e8cc4db8\") " pod="kube-system/konnectivity-agent-zmwdz"
Jul 08 22:47:06.559073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542282    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dktpz\" (UniqueName: \"kubernetes.io/projected/571e851d-c74f-49ae-93fe-86afecc79768-kube-api-access-dktpz\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.559073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542313    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-run-netns\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.559073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542341    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-cni-bin\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.559073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542370    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/571e851d-c74f-49ae-93fe-86afecc79768-ovn-node-metrics-cert\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.559073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542431    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-run-systemd\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.559073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542446    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/017f7171-4e43-4468-b4d0-9336ef8bfcee-cni-binary-copy\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.559073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542451    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/017f7171-4e43-4468-b4d0-9336ef8bfcee-os-release\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.559073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542516    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-run-ovn-kubernetes\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.559073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542454    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-etc-openvswitch\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.559073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542574    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/021e1384-753b-4d72-a772-b89e2bfcd232-host\") pod \"node-ca-xnvtv\" (UID: \"021e1384-753b-4d72-a772-b89e2bfcd232\") " pod="openshift-image-registry/node-ca-xnvtv"
Jul 08 22:47:06.559073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542610    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/017f7171-4e43-4468-b4d0-9336ef8bfcee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.559073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542766    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dfbz\" (UniqueName: \"kubernetes.io/projected/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-kube-api-access-6dfbz\") pod \"network-metrics-daemon-8kgb8\" (UID: \"b3eb825e-1dd9-461e-86b2-9fad2fade7e4\") " pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:06.559073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542811    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/017f7171-4e43-4468-b4d0-9336ef8bfcee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.559581 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542850    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-slash\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.559581 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542807    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/571e851d-c74f-49ae-93fe-86afecc79768-env-overrides\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.559581 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.542957    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998-tmp-dir\") pod \"node-resolver-ztqww\" (UID: \"7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998\") " pod="openshift-dns/node-resolver-ztqww"
Jul 08 22:47:06.559581 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.543020    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/021e1384-753b-4d72-a772-b89e2bfcd232-host\") pod \"node-ca-xnvtv\" (UID: \"021e1384-753b-4d72-a772-b89e2bfcd232\") " pod="openshift-image-registry/node-ca-xnvtv"
Jul 08 22:47:06.559581 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.543022    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-log-socket\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.559581 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.543112    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnj54\" (UniqueName: \"kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54\") pod \"network-check-target-52n4x\" (UID: \"51fbf654-be84-41a6-b24c-1bd691c7c7fd\") " pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:06.559581 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.543175    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-run-netns\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.559581 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.543208    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-cni-bin\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.559581 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.543320    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/201fdbe1-ca16-49f6-b414-cc975c6605a9-iptables-alerter-script\") pod \"iptables-alerter-m2mx4\" (UID: \"201fdbe1-ca16-49f6-b414-cc975c6605a9\") " pod="openshift-network-operator/iptables-alerter-m2mx4"
Jul 08 22:47:06.559581 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.543351    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs\") pod \"network-metrics-daemon-8kgb8\" (UID: \"b3eb825e-1dd9-461e-86b2-9fad2fade7e4\") " pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:06.559581 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.543384    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/017f7171-4e43-4468-b4d0-9336ef8bfcee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.559581 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.543390    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-log-socket\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.559581 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:06.543732    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:06.559581 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:06.543894    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs podName:b3eb825e-1dd9-461e-86b2-9fad2fade7e4 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:07.043875632 +0000 UTC m=+2.068457618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs") pod "network-metrics-daemon-8kgb8" (UID: "b3eb825e-1dd9-461e-86b2-9fad2fade7e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:06.560223 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.543931    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9a616ad8-cd7d-41ed-b42e-3cd2e8cc4db8-konnectivity-ca\") pod \"konnectivity-agent-zmwdz\" (UID: \"9a616ad8-cd7d-41ed-b42e-3cd2e8cc4db8\") " pod="kube-system/konnectivity-agent-zmwdz"
Jul 08 22:47:06.560223 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.543986    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/201fdbe1-ca16-49f6-b414-cc975c6605a9-iptables-alerter-script\") pod \"iptables-alerter-m2mx4\" (UID: \"201fdbe1-ca16-49f6-b414-cc975c6605a9\") " pod="openshift-network-operator/iptables-alerter-m2mx4"
Jul 08 22:47:06.560223 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.544004    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/571e851d-c74f-49ae-93fe-86afecc79768-host-slash\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.560223 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.545734    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/571e851d-c74f-49ae-93fe-86afecc79768-ovn-node-metrics-cert\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.560223 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.547350    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9a616ad8-cd7d-41ed-b42e-3cd2e8cc4db8-agent-certs\") pod \"konnectivity-agent-zmwdz\" (UID: \"9a616ad8-cd7d-41ed-b42e-3cd2e8cc4db8\") " pod="kube-system/konnectivity-agent-zmwdz"
Jul 08 22:47:06.560223 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.549835    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrkh9\" (UniqueName: \"kubernetes.io/projected/201fdbe1-ca16-49f6-b414-cc975c6605a9-kube-api-access-mrkh9\") pod \"iptables-alerter-m2mx4\" (UID: \"201fdbe1-ca16-49f6-b414-cc975c6605a9\") " pod="openshift-network-operator/iptables-alerter-m2mx4"
Jul 08 22:47:06.560223 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.549843    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9jgh\" (UniqueName: \"kubernetes.io/projected/7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998-kube-api-access-x9jgh\") pod \"node-resolver-ztqww\" (UID: \"7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998\") " pod="openshift-dns/node-resolver-ztqww"
Jul 08 22:47:06.560223 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.550085    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzs74\" (UniqueName: \"kubernetes.io/projected/021e1384-753b-4d72-a772-b89e2bfcd232-kube-api-access-mzs74\") pod \"node-ca-xnvtv\" (UID: \"021e1384-753b-4d72-a772-b89e2bfcd232\") " pod="openshift-image-registry/node-ca-xnvtv"
Jul 08 22:47:06.560223 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:06.550854    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:47:06.560223 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:06.550872    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:47:06.560223 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:06.550882    2574 projected.go:196] Error preparing data for projected volume kube-api-access-cnj54 for pod openshift-network-diagnostics/network-check-target-52n4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:06.560223 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.550948    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc79w\" (UniqueName: \"kubernetes.io/projected/017f7171-4e43-4468-b4d0-9336ef8bfcee-kube-api-access-gc79w\") pod \"multus-additional-cni-plugins-bcjd8\" (UID: \"017f7171-4e43-4468-b4d0-9336ef8bfcee\") " pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.560223 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:06.550958    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54 podName:51fbf654-be84-41a6-b24c-1bd691c7c7fd nodeName:}" failed. No retries permitted until 2026-07-08 22:47:07.050940986 +0000 UTC m=+2.075522967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cnj54" (UniqueName: "kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54") pod "network-check-target-52n4x" (UID: "51fbf654-be84-41a6-b24c-1bd691c7c7fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:06.560223 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.552659    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dktpz\" (UniqueName: \"kubernetes.io/projected/571e851d-c74f-49ae-93fe-86afecc79768-kube-api-access-dktpz\") pod \"ovnkube-node-kb8bv\" (UID: \"571e851d-c74f-49ae-93fe-86afecc79768\") " pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.560782 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.552875    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dfbz\" (UniqueName: \"kubernetes.io/projected/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-kube-api-access-6dfbz\") pod \"network-metrics-daemon-8kgb8\" (UID: \"b3eb825e-1dd9-461e-86b2-9fad2fade7e4\") " pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:06.560782 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:06.557144    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeac1d2a0f3fcbb36c7b1769adc738465.slice/crio-2563f5a442c8a2ea0bb82e61934aeef4ff4ef35c1b1feab799d5b0ed00e57198 WatchSource:0}: Error finding container 2563f5a442c8a2ea0bb82e61934aeef4ff4ef35c1b1feab799d5b0ed00e57198: Status 404 returned error can't find the container with id 2563f5a442c8a2ea0bb82e61934aeef4ff4ef35c1b1feab799d5b0ed00e57198
Jul 08 22:47:06.686838 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.562737    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 22:47:06.686838 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:06.567968    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff9df22879b0b8b1cf1cf0c7d2186ee4.slice/crio-ba78293841a61dcfaf089a9b2b6f3d49f558e141c411c23d8d356ba833c69fc6 WatchSource:0}: Error finding container ba78293841a61dcfaf089a9b2b6f3d49f558e141c411c23d8d356ba833c69fc6: Status 404 returned error can't find the container with id ba78293841a61dcfaf089a9b2b6f3d49f558e141c411c23d8d356ba833c69fc6
Jul 08 22:47:06.686838 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.670127    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg"
Jul 08 22:47:06.686838 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:06.679200    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0e746f_c560_43f6_ae90_244af4b9775f.slice/crio-0cb6ef7bf0ce3295df03280390ee0e48afdb50cc0d3148bbeb007c99e269e628 WatchSource:0}: Error finding container 0cb6ef7bf0ce3295df03280390ee0e48afdb50cc0d3148bbeb007c99e269e628: Status 404 returned error can't find the container with id 0cb6ef7bf0ce3295df03280390ee0e48afdb50cc0d3148bbeb007c99e269e628
Jul 08 22:47:06.686838 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.682226    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jhd48"
Jul 08 22:47:06.697462 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:06.690794    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1edc1995_d4b8_4e99_a879_b326246fbee3.slice/crio-8514f5ec5c7bd8a4dd6b7a2cc2f4d060dff694abd814d1107bb494b629349ff7 WatchSource:0}: Error finding container 8514f5ec5c7bd8a4dd6b7a2cc2f4d060dff694abd814d1107bb494b629349ff7: Status 404 returned error can't find the container with id 8514f5ec5c7bd8a4dd6b7a2cc2f4d060dff694abd814d1107bb494b629349ff7
Jul 08 22:47:06.789732 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.710068    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-58lmh"
Jul 08 22:47:06.789732 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.731655    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bcjd8"
Jul 08 22:47:06.789732 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:06.740630    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod017f7171_4e43_4468_b4d0_9336ef8bfcee.slice/crio-68b8ef7c2bf77021985fb1c8d9fe28dfbee6f7ab1e8df80519bf8cf0412231eb WatchSource:0}: Error finding container 68b8ef7c2bf77021985fb1c8d9fe28dfbee6f7ab1e8df80519bf8cf0412231eb: Status 404 returned error can't find the container with id 68b8ef7c2bf77021985fb1c8d9fe28dfbee6f7ab1e8df80519bf8cf0412231eb
Jul 08 22:47:06.789732 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.746278    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m2mx4"
Jul 08 22:47:06.789732 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:06.753579    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201fdbe1_ca16_49f6_b414_cc975c6605a9.slice/crio-367ee9bfa6ab887c48f8334d63af79a41a0d7cac7efd31d1173b68a156f1ec43 WatchSource:0}: Error finding container 367ee9bfa6ab887c48f8334d63af79a41a0d7cac7efd31d1173b68a156f1ec43: Status 404 returned error can't find the container with id 367ee9bfa6ab887c48f8334d63af79a41a0d7cac7efd31d1173b68a156f1ec43
Jul 08 22:47:06.789732 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.771355    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zmwdz"
Jul 08 22:47:06.789732 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:06.778957    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a616ad8_cd7d_41ed_b42e_3cd2e8cc4db8.slice/crio-db1055842fb80abce2513e190eb38e9fc6d2fccb6dec701cf01f8c97671e6671 WatchSource:0}: Error finding container db1055842fb80abce2513e190eb38e9fc6d2fccb6dec701cf01f8c97671e6671: Status 404 returned error can't find the container with id db1055842fb80abce2513e190eb38e9fc6d2fccb6dec701cf01f8c97671e6671
Jul 08 22:47:06.789732 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.785779    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ztqww"
Jul 08 22:47:06.948703 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.794680    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xnvtv"
Jul 08 22:47:06.948703 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:06.794919    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d0fc7c7_1e2a_4ab0_9664_3fc4c897e998.slice/crio-964da96302d5fbb10a9a19066791072e2c319c6ad36509c2ba44ddc9cd3f8b64 WatchSource:0}: Error finding container 964da96302d5fbb10a9a19066791072e2c319c6ad36509c2ba44ddc9cd3f8b64: Status 404 returned error can't find the container with id 964da96302d5fbb10a9a19066791072e2c319c6ad36509c2ba44ddc9cd3f8b64
Jul 08 22:47:06.948703 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.799518    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:06.948703 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:06.802714    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021e1384_753b_4d72_a772_b89e2bfcd232.slice/crio-91f9096492c1499b557f5c441c02b78df540d23e1480cfb326945f3006495441 WatchSource:0}: Error finding container 91f9096492c1499b557f5c441c02b78df540d23e1480cfb326945f3006495441: Status 404 returned error can't find the container with id 91f9096492c1499b557f5c441c02b78df540d23e1480cfb326945f3006495441
Jul 08 22:47:06.948703 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:06.807851    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod571e851d_c74f_49ae_93fe_86afecc79768.slice/crio-50fa1b585b6d51b1a604a4fb359348399afe389007687623d2aae2edf6f410a4 WatchSource:0}: Error finding container 50fa1b585b6d51b1a604a4fb359348399afe389007687623d2aae2edf6f410a4: Status 404 returned error can't find the container with id 50fa1b585b6d51b1a604a4fb359348399afe389007687623d2aae2edf6f410a4
Jul 08 22:47:06.948703 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.923764    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:47:06.948703 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:06.948116    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret\") pod \"global-pull-secret-syncer-4sd78\" (UID: \"9d56c9bb-23d5-45f4-ac28-b73d088da22d\") " pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:06.948703 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:06.948279    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:06.948703 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:06.948351    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret podName:9d56c9bb-23d5-45f4-ac28-b73d088da22d nodeName:}" failed. No retries permitted until 2026-07-08 22:47:07.948332953 +0000 UTC m=+2.972914951 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret") pod "global-pull-secret-syncer-4sd78" (UID: "9d56c9bb-23d5-45f4-ac28-b73d088da22d") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:07.102077 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.049174    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs\") pod \"network-metrics-daemon-8kgb8\" (UID: \"b3eb825e-1dd9-461e-86b2-9fad2fade7e4\") " pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:07.102077 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:07.049328    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:07.102077 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:07.049390    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs podName:b3eb825e-1dd9-461e-86b2-9fad2fade7e4 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:08.049376416 +0000 UTC m=+3.073958401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs") pod "network-metrics-daemon-8kgb8" (UID: "b3eb825e-1dd9-461e-86b2-9fad2fade7e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:07.161228 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.150146    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnj54\" (UniqueName: \"kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54\") pod \"network-check-target-52n4x\" (UID: \"51fbf654-be84-41a6-b24c-1bd691c7c7fd\") " pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:07.161228 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:07.150295    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:47:07.161228 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:07.150314    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:47:07.161228 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:07.150322    2574 projected.go:196] Error preparing data for projected volume kube-api-access-cnj54 for pod openshift-network-diagnostics/network-check-target-52n4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:07.161228 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:07.150370    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54 podName:51fbf654-be84-41a6-b24c-1bd691c7c7fd nodeName:}" failed. No retries permitted until 2026-07-08 22:47:08.150357516 +0000 UTC m=+3.174939502 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnj54" (UniqueName: "kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54") pod "network-check-target-52n4x" (UID: "51fbf654-be84-41a6-b24c-1bd691c7c7fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:07.200194 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.200044    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:47:07.373782 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.373724    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 22:42:06 +0000 UTC" deadline="2028-03-11 00:49:20.28069281 +0000 UTC"
Jul 08 22:47:07.373782 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.373777    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14666h2m12.906918197s"
Jul 08 22:47:07.504955 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.504887    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:47:07.513516 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.513399    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xnvtv" event={"ID":"021e1384-753b-4d72-a772-b89e2bfcd232","Type":"ContainerStarted","Data":"91f9096492c1499b557f5c441c02b78df540d23e1480cfb326945f3006495441"}
Jul 08 22:47:07.518365 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.518284    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zmwdz" event={"ID":"9a616ad8-cd7d-41ed-b42e-3cd2e8cc4db8","Type":"ContainerStarted","Data":"db1055842fb80abce2513e190eb38e9fc6d2fccb6dec701cf01f8c97671e6671"}
Jul 08 22:47:07.524877 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.524843    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m2mx4" event={"ID":"201fdbe1-ca16-49f6-b414-cc975c6605a9","Type":"ContainerStarted","Data":"367ee9bfa6ab887c48f8334d63af79a41a0d7cac7efd31d1173b68a156f1ec43"}
Jul 08 22:47:07.536093 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.536060    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bcjd8" event={"ID":"017f7171-4e43-4468-b4d0-9336ef8bfcee","Type":"ContainerStarted","Data":"68b8ef7c2bf77021985fb1c8d9fe28dfbee6f7ab1e8df80519bf8cf0412231eb"}
Jul 08 22:47:07.546960 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.546922    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-58lmh" event={"ID":"977bd50f-ac01-4a5d-8157-89ca6e78fb21","Type":"ContainerStarted","Data":"89905a1222cefa735893a5236dcca22125a6cc9379babdc329b14e54720288ed"}
Jul 08 22:47:07.579667 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.579625    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jhd48" event={"ID":"1edc1995-d4b8-4e99-a879-b326246fbee3","Type":"ContainerStarted","Data":"8514f5ec5c7bd8a4dd6b7a2cc2f4d060dff694abd814d1107bb494b629349ff7"}
Jul 08 22:47:07.608444 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.608407    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg" event={"ID":"9a0e746f-c560-43f6-ae90-244af4b9775f","Type":"ContainerStarted","Data":"0cb6ef7bf0ce3295df03280390ee0e48afdb50cc0d3148bbeb007c99e269e628"}
Jul 08 22:47:07.618568 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.618530    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-70.ec2.internal" event={"ID":"ff9df22879b0b8b1cf1cf0c7d2186ee4","Type":"ContainerStarted","Data":"ba78293841a61dcfaf089a9b2b6f3d49f558e141c411c23d8d356ba833c69fc6"}
Jul 08 22:47:07.623888 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.623849    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv" event={"ID":"571e851d-c74f-49ae-93fe-86afecc79768","Type":"ContainerStarted","Data":"50fa1b585b6d51b1a604a4fb359348399afe389007687623d2aae2edf6f410a4"}
Jul 08 22:47:07.640064 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.640024    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ztqww" event={"ID":"7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998","Type":"ContainerStarted","Data":"964da96302d5fbb10a9a19066791072e2c319c6ad36509c2ba44ddc9cd3f8b64"}
Jul 08 22:47:07.654554 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.654512    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal" event={"ID":"eac1d2a0f3fcbb36c7b1769adc738465","Type":"ContainerStarted","Data":"2563f5a442c8a2ea0bb82e61934aeef4ff4ef35c1b1feab799d5b0ed00e57198"}
Jul 08 22:47:07.955646 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:07.955567    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret\") pod \"global-pull-secret-syncer-4sd78\" (UID: \"9d56c9bb-23d5-45f4-ac28-b73d088da22d\") " pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:07.955838 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:07.955796    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:07.955914 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:07.955862    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret podName:9d56c9bb-23d5-45f4-ac28-b73d088da22d nodeName:}" failed. No retries permitted until 2026-07-08 22:47:09.955844742 +0000 UTC m=+4.980426742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret") pod "global-pull-secret-syncer-4sd78" (UID: "9d56c9bb-23d5-45f4-ac28-b73d088da22d") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:08.057775 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:08.056300    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs\") pod \"network-metrics-daemon-8kgb8\" (UID: \"b3eb825e-1dd9-461e-86b2-9fad2fade7e4\") " pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:08.057775 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:08.056493    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:08.057775 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:08.056555    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs podName:b3eb825e-1dd9-461e-86b2-9fad2fade7e4 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:10.056536155 +0000 UTC m=+5.081118151 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs") pod "network-metrics-daemon-8kgb8" (UID: "b3eb825e-1dd9-461e-86b2-9fad2fade7e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:08.157157 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:08.157124    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnj54\" (UniqueName: \"kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54\") pod \"network-check-target-52n4x\" (UID: \"51fbf654-be84-41a6-b24c-1bd691c7c7fd\") " pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:08.157339 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:08.157326    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:47:08.157395 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:08.157349    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:47:08.157395 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:08.157361    2574 projected.go:196] Error preparing data for projected volume kube-api-access-cnj54 for pod openshift-network-diagnostics/network-check-target-52n4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:08.157492 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:08.157423    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54 podName:51fbf654-be84-41a6-b24c-1bd691c7c7fd nodeName:}" failed. No retries permitted until 2026-07-08 22:47:10.157397138 +0000 UTC m=+5.181979121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnj54" (UniqueName: "kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54") pod "network-check-target-52n4x" (UID: "51fbf654-be84-41a6-b24c-1bd691c7c7fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:08.374642 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:08.374468    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 22:42:06 +0000 UTC" deadline="2028-03-14 17:31:13.442228957 +0000 UTC"
Jul 08 22:47:08.374642 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:08.374502    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14754h44m5.067731593s"
Jul 08 22:47:08.496931 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:08.496901    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:08.497110 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:08.497051    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:08.497494 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:08.497470    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:08.497579 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:08.497560    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:08.497643 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:08.497625    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:08.497743 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:08.497726    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:09.972015 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:09.971421    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret\") pod \"global-pull-secret-syncer-4sd78\" (UID: \"9d56c9bb-23d5-45f4-ac28-b73d088da22d\") " pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:09.972015 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:09.971567    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:09.972015 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:09.971628    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret podName:9d56c9bb-23d5-45f4-ac28-b73d088da22d nodeName:}" failed. No retries permitted until 2026-07-08 22:47:13.971609384 +0000 UTC m=+8.996191381 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret") pod "global-pull-secret-syncer-4sd78" (UID: "9d56c9bb-23d5-45f4-ac28-b73d088da22d") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:10.072384 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:10.071783    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs\") pod \"network-metrics-daemon-8kgb8\" (UID: \"b3eb825e-1dd9-461e-86b2-9fad2fade7e4\") " pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:10.072384 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:10.071961    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:10.072384 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:10.072019    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs podName:b3eb825e-1dd9-461e-86b2-9fad2fade7e4 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:14.072001254 +0000 UTC m=+9.096583247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs") pod "network-metrics-daemon-8kgb8" (UID: "b3eb825e-1dd9-461e-86b2-9fad2fade7e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:10.172925 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:10.172309    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnj54\" (UniqueName: \"kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54\") pod \"network-check-target-52n4x\" (UID: \"51fbf654-be84-41a6-b24c-1bd691c7c7fd\") " pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:10.172925 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:10.172508    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:47:10.172925 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:10.172525    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:47:10.172925 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:10.172537    2574 projected.go:196] Error preparing data for projected volume kube-api-access-cnj54 for pod openshift-network-diagnostics/network-check-target-52n4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:10.172925 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:10.172591    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54 podName:51fbf654-be84-41a6-b24c-1bd691c7c7fd nodeName:}" failed. No retries permitted until 2026-07-08 22:47:14.172572167 +0000 UTC m=+9.197154170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnj54" (UniqueName: "kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54") pod "network-check-target-52n4x" (UID: "51fbf654-be84-41a6-b24c-1bd691c7c7fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:10.497218 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:10.497146    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:10.497218 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:10.497171    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:10.497218 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:10.497171    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:10.497471 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:10.497272    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:10.497471 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:10.497391    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:10.497574 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:10.497467    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:12.497261 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:12.497221    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:12.497743 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:12.497232    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:12.497743 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:12.497383    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:12.497743 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:12.497441    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:12.497743 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:12.497230    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:12.497743 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:12.497534    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:14.001766 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:14.001396    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret\") pod \"global-pull-secret-syncer-4sd78\" (UID: \"9d56c9bb-23d5-45f4-ac28-b73d088da22d\") " pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:14.001766 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:14.001663    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:14.001766 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:14.001758    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret podName:9d56c9bb-23d5-45f4-ac28-b73d088da22d nodeName:}" failed. No retries permitted until 2026-07-08 22:47:22.001736289 +0000 UTC m=+17.026318280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret") pod "global-pull-secret-syncer-4sd78" (UID: "9d56c9bb-23d5-45f4-ac28-b73d088da22d") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:14.103014 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:14.102975    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs\") pod \"network-metrics-daemon-8kgb8\" (UID: \"b3eb825e-1dd9-461e-86b2-9fad2fade7e4\") " pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:14.103181 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:14.103114    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:14.103181 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:14.103176    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs podName:b3eb825e-1dd9-461e-86b2-9fad2fade7e4 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:22.103160249 +0000 UTC m=+17.127742231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs") pod "network-metrics-daemon-8kgb8" (UID: "b3eb825e-1dd9-461e-86b2-9fad2fade7e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:14.203375 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:14.203337    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnj54\" (UniqueName: \"kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54\") pod \"network-check-target-52n4x\" (UID: \"51fbf654-be84-41a6-b24c-1bd691c7c7fd\") " pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:14.203568 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:14.203509    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:47:14.203568 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:14.203528    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:47:14.203568 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:14.203540    2574 projected.go:196] Error preparing data for projected volume kube-api-access-cnj54 for pod openshift-network-diagnostics/network-check-target-52n4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:14.203733 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:14.203611    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54 podName:51fbf654-be84-41a6-b24c-1bd691c7c7fd nodeName:}" failed. No retries permitted until 2026-07-08 22:47:22.203594045 +0000 UTC m=+17.228176060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnj54" (UniqueName: "kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54") pod "network-check-target-52n4x" (UID: "51fbf654-be84-41a6-b24c-1bd691c7c7fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:14.497475 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:14.496988    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:14.497475 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:14.497122    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:14.497475 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:14.497203    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:14.497475 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:14.497284    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:14.497475 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:14.497337    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:14.497475 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:14.497400    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:16.496467 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:16.496174    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:16.496467 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:16.496301    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:16.496999 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:16.496629    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:16.496999 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:16.496762    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:16.496999 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:16.496810    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:16.496999 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:16.496871    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:18.496526 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:18.496494    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:18.496947 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:18.496498    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:18.496947 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:18.496634    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:18.496947 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:18.496649    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:18.496947 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:18.496741    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:18.496947 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:18.496815    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:20.496794 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:20.496758    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:20.497225 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:20.496758    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:20.497225 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:20.496892    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:20.497225 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:20.496761    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:20.497225 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:20.496966    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:20.497225 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:20.497024    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:22.067073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:22.067026    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret\") pod \"global-pull-secret-syncer-4sd78\" (UID: \"9d56c9bb-23d5-45f4-ac28-b73d088da22d\") " pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:22.067532 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:22.067210    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:22.067532 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:22.067284    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret podName:9d56c9bb-23d5-45f4-ac28-b73d088da22d nodeName:}" failed. No retries permitted until 2026-07-08 22:47:38.067262822 +0000 UTC m=+33.091844822 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret") pod "global-pull-secret-syncer-4sd78" (UID: "9d56c9bb-23d5-45f4-ac28-b73d088da22d") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:22.167878 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:22.167825    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs\") pod \"network-metrics-daemon-8kgb8\" (UID: \"b3eb825e-1dd9-461e-86b2-9fad2fade7e4\") " pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:22.168060 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:22.167995    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:22.168103 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:22.168068    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs podName:b3eb825e-1dd9-461e-86b2-9fad2fade7e4 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:38.168047561 +0000 UTC m=+33.192629556 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs") pod "network-metrics-daemon-8kgb8" (UID: "b3eb825e-1dd9-461e-86b2-9fad2fade7e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:22.268740 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:22.268703    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnj54\" (UniqueName: \"kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54\") pod \"network-check-target-52n4x\" (UID: \"51fbf654-be84-41a6-b24c-1bd691c7c7fd\") " pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:22.268915 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:22.268881    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:47:22.268915 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:22.268904    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:47:22.269025 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:22.268918    2574 projected.go:196] Error preparing data for projected volume kube-api-access-cnj54 for pod openshift-network-diagnostics/network-check-target-52n4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:22.269025 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:22.268985    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54 podName:51fbf654-be84-41a6-b24c-1bd691c7c7fd nodeName:}" failed. No retries permitted until 2026-07-08 22:47:38.268964557 +0000 UTC m=+33.293546555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnj54" (UniqueName: "kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54") pod "network-check-target-52n4x" (UID: "51fbf654-be84-41a6-b24c-1bd691c7c7fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:22.496961 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:22.496874    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:22.497121 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:22.496876    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:22.497121 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:22.497012    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:22.497121 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:22.496876    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:22.497121 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:22.497083    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:22.497296 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:22.497122    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:24.496456 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:24.496384    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:24.496929 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:24.496398    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:24.496929 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:24.496527    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:24.496929 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:24.496585    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:24.496929 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:24.496696    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:24.496929 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:24.496802    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:26.497132 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:26.497036    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:26.497132 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:26.497066    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:26.497132 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:26.497085    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:26.497784 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:26.497159    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:26.497784 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:26.497279    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:26.497784 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:26.497346    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:26.722147 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:26.722112    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-58lmh" event={"ID":"977bd50f-ac01-4a5d-8157-89ca6e78fb21","Type":"ContainerStarted","Data":"f2ace0dc3f6694b9fabad6d7dedd1e174241f1dc5f375cb79cc2c8c2a70ea664"}
Jul 08 22:47:26.723648 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:26.723620    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jhd48" event={"ID":"1edc1995-d4b8-4e99-a879-b326246fbee3","Type":"ContainerStarted","Data":"e41eb3482883472f2fc0484ab465da59dee0ffb8ad39ab4669d8ad0e61358308"}
Jul 08 22:47:26.725128 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:26.725083    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-70.ec2.internal" event={"ID":"ff9df22879b0b8b1cf1cf0c7d2186ee4","Type":"ContainerStarted","Data":"3e8af04026dc9839c6317415d1929f7889f5594e973026101f73e8b6ca200a6b"}
Jul 08 22:47:26.727827 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:26.727811    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 22:47:26.728165 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:26.728148    2574 generic.go:356] "Generic (PLEG): container finished" podID="571e851d-c74f-49ae-93fe-86afecc79768" containerID="0d5076c83ab26020f26bb5786443b4b3f5e7bd8e8eec3146e6c0d30f522e0dd2" exitCode=1
Jul 08 22:47:26.728224 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:26.728176    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv" event={"ID":"571e851d-c74f-49ae-93fe-86afecc79768","Type":"ContainerStarted","Data":"64b99508b8cc9f9c01ce87603143e730a7458b245877fc58f855612433f001bf"}
Jul 08 22:47:26.728262 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:26.728226    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv" event={"ID":"571e851d-c74f-49ae-93fe-86afecc79768","Type":"ContainerStarted","Data":"853091ddeeeae1ef2f934aebc52466059974a278a23d121c83a330bc2818d28b"}
Jul 08 22:47:26.728262 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:26.728255    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv" event={"ID":"571e851d-c74f-49ae-93fe-86afecc79768","Type":"ContainerStarted","Data":"a0dc22c374a25974bd3c2e3bd858657ab7133773f9c553f7b4d1516e2b671e50"}
Jul 08 22:47:26.728322 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:26.728283    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv" event={"ID":"571e851d-c74f-49ae-93fe-86afecc79768","Type":"ContainerStarted","Data":"dd1fda8310b00d5f5e083369308b5157bf8f8e3c5567bdacfb319fc35e846feb"}
Jul 08 22:47:26.728322 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:26.728309    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv" event={"ID":"571e851d-c74f-49ae-93fe-86afecc79768","Type":"ContainerDied","Data":"0d5076c83ab26020f26bb5786443b4b3f5e7bd8e8eec3146e6c0d30f522e0dd2"}
Jul 08 22:47:26.728381 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:26.728336    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv" event={"ID":"571e851d-c74f-49ae-93fe-86afecc79768","Type":"ContainerStarted","Data":"04f9d63db4d9541173d3a66a7ef4838f4d20a464be58c2508f54837e55ed9472"}
Jul 08 22:47:26.761635 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:26.761539    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jhd48" podStartSLOduration=2.656559431 podStartE2EDuration="21.76152467s" totalImagesPullingTime="19.104965239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:26.761422457 +0000 UTC m=+21.786004459" watchObservedRunningTime="2026-07-08 22:47:26.76152467 +0000 UTC m=+21.786106669"
Jul 08 22:47:26.761786 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:26.761631    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-58lmh" podStartSLOduration=2.428893798 podStartE2EDuration="21.76162762s" totalImagesPullingTime="19.332733822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:26.745604408 +0000 UTC m=+21.770186423" watchObservedRunningTime="2026-07-08 22:47:26.76162762 +0000 UTC m=+21.786209622"
Jul 08 22:47:27.732664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:27.732405    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zmwdz" event={"ID":"9a616ad8-cd7d-41ed-b42e-3cd2e8cc4db8","Type":"ContainerStarted","Data":"cd9c4b68b3877965e26729690619b5f61dc5dde588ef9dfa0da9a5c1cd00bb5f"}
Jul 08 22:47:27.734254 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:27.734226    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m2mx4" event={"ID":"201fdbe1-ca16-49f6-b414-cc975c6605a9","Type":"ContainerStarted","Data":"9b693a48e978c49f357e51316260bd0e6a44edc53efdc8844f533f055b9381fe"}
Jul 08 22:47:27.736056 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:27.736029    2574 generic.go:356] "Generic (PLEG): container finished" podID="017f7171-4e43-4468-b4d0-9336ef8bfcee" containerID="6023a836e1b2faabf6e305e8c52904933b8b8b9e733b824536d426a7684da048" exitCode=0
Jul 08 22:47:27.736175 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:27.736118    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bcjd8" event={"ID":"017f7171-4e43-4468-b4d0-9336ef8bfcee","Type":"ContainerDied","Data":"6023a836e1b2faabf6e305e8c52904933b8b8b9e733b824536d426a7684da048"}
Jul 08 22:47:27.737803 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:27.737776    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg" event={"ID":"9a0e746f-c560-43f6-ae90-244af4b9775f","Type":"ContainerStarted","Data":"03cab2ee32df106ae008b2d61ab8c96c720059ac76ed99465d71f25f95453070"}
Jul 08 22:47:27.739270 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:27.739241    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ztqww" event={"ID":"7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998","Type":"ContainerStarted","Data":"2daa48466c1d8840f7ce4c8c61ce94e7464ec7f77fb836699caf62fb37e0f76a"}
Jul 08 22:47:27.741664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:27.741319    2574 generic.go:356] "Generic (PLEG): container finished" podID="eac1d2a0f3fcbb36c7b1769adc738465" containerID="acaf555f07d47eb5a40282ae7623e4b26c6e124aff87a49523571d1717a091e2" exitCode=0
Jul 08 22:47:27.741664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:27.741510    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal" event={"ID":"eac1d2a0f3fcbb36c7b1769adc738465","Type":"ContainerDied","Data":"acaf555f07d47eb5a40282ae7623e4b26c6e124aff87a49523571d1717a091e2"}
Jul 08 22:47:27.744983 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:27.744765    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xnvtv" event={"ID":"021e1384-753b-4d72-a772-b89e2bfcd232","Type":"ContainerStarted","Data":"e0cadf88709abc8d3d1066843831e3bf3538cfef94038f0c23c0e53868ceb7f2"}
Jul 08 22:47:27.746756 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:27.746710    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zmwdz" podStartSLOduration=3.747432386 podStartE2EDuration="22.746679189s" totalImagesPullingTime="18.999246803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:27.746233841 +0000 UTC m=+22.770815950" watchObservedRunningTime="2026-07-08 22:47:27.746679189 +0000 UTC m=+22.771261193"
Jul 08 22:47:27.746998 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:27.746978    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-70.ec2.internal" podStartSLOduration=21.746971532 podStartE2EDuration="21.746971532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:26.776217509 +0000 UTC m=+21.800799511" watchObservedRunningTime="2026-07-08 22:47:27.746971532 +0000 UTC m=+22.771553535"
Jul 08 22:47:27.779894 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:27.779847    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ztqww" podStartSLOduration=3.77996561 podStartE2EDuration="22.779828892s" totalImagesPullingTime="18.999863282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:27.779729435 +0000 UTC m=+22.804311500" watchObservedRunningTime="2026-07-08 22:47:27.779828892 +0000 UTC m=+22.804410895"
Jul 08 22:47:27.793705 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:27.793649    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xnvtv" podStartSLOduration=11.946325739 podStartE2EDuration="22.793633848s" totalImagesPullingTime="10.847308109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:27.793198482 +0000 UTC m=+22.817780508" watchObservedRunningTime="2026-07-08 22:47:27.793633848 +0000 UTC m=+22.818215851"
Jul 08 22:47:27.815211 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:27.815158    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m2mx4" podStartSLOduration=3.774040248 podStartE2EDuration="22.815139481s" totalImagesPullingTime="19.041099233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:27.814820229 +0000 UTC m=+22.839402233" watchObservedRunningTime="2026-07-08 22:47:27.815139481 +0000 UTC m=+22.839721484"
Jul 08 22:47:28.142865 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:28.142841    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 22:47:28.430149 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:28.430040    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T22:47:28.142857984Z","UUID":"34085b91-e274-44c4-afa6-6a02d0ac8133","Handler":null,"Name":"","Endpoint":""}
Jul 08 22:47:28.431504 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:28.431483    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 22:47:28.431631 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:28.431523    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 22:47:28.496380 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:28.496345    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:28.496380 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:28.496386    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:28.496636 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:28.496468    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:28.496636 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:28.496474    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:28.496636 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:28.496539    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:28.496785 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:28.496655    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:28.749742 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:28.749639    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg" event={"ID":"9a0e746f-c560-43f6-ae90-244af4b9775f","Type":"ContainerStarted","Data":"b855295009ccd179c19bc2bcaea4c0135e537c2897d49f0a94134f733e7a72d4"}
Jul 08 22:47:28.753711 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:28.753674    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 22:47:28.754198 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:28.754170    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv" event={"ID":"571e851d-c74f-49ae-93fe-86afecc79768","Type":"ContainerStarted","Data":"bc458884e16c840af8f8cceb3ebd6369c7ef09bab87f44ab82fb084cf2198862"}
Jul 08 22:47:28.757462 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:28.757395    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal" event={"ID":"eac1d2a0f3fcbb36c7b1769adc738465","Type":"ContainerStarted","Data":"d103a11c00c78f03b18d97980e5fcf761104e1db0f423c390a0ee1817e90594a"}
Jul 08 22:47:28.772989 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:28.772812    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-70.ec2.internal" podStartSLOduration=22.772790512 podStartE2EDuration="22.772790512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:28.772347361 +0000 UTC m=+23.796929365" watchObservedRunningTime="2026-07-08 22:47:28.772790512 +0000 UTC m=+23.797372515"
Jul 08 22:47:29.761751 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:29.761711    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg" event={"ID":"9a0e746f-c560-43f6-ae90-244af4b9775f","Type":"ContainerStarted","Data":"83e6bfdae55933d969fe0eedea4e6b84c8abf232f3c83b37aee1cf5b86837907"}
Jul 08 22:47:29.779146 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:29.779101    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6spg" podStartSLOduration=3.470250792 podStartE2EDuration="24.779085374s" totalImagesPullingTime="21.308834582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:29.779057106 +0000 UTC m=+24.803639121" watchObservedRunningTime="2026-07-08 22:47:29.779085374 +0000 UTC m=+24.803667377"
Jul 08 22:47:30.494681 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:30.494646    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zmwdz"
Jul 08 22:47:30.495266 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:30.495212    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zmwdz"
Jul 08 22:47:30.496275 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:30.496253    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:30.496390 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:30.496348    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:30.496390 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:30.496363    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:30.496390 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:30.496379    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:30.496569 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:30.496478    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:30.496618 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:30.496571    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:30.764776 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:30.764682    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zmwdz"
Jul 08 22:47:30.765209 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:30.764955    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zmwdz"
Jul 08 22:47:31.770880 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:31.770648    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 22:47:31.771665 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:31.771250    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv" event={"ID":"571e851d-c74f-49ae-93fe-86afecc79768","Type":"ContainerStarted","Data":"d8a5970a3828902c00a57f96e84884e3e732f3367464c6790284103c5d4dc183"}
Jul 08 22:47:31.771665 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:31.771428    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:31.771665 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:31.771645    2574 scope.go:117] "RemoveContainer" containerID="0d5076c83ab26020f26bb5786443b4b3f5e7bd8e8eec3146e6c0d30f522e0dd2"
Jul 08 22:47:32.496374 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:32.496317    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:32.496550 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:32.496429    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:32.496550 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:32.496446    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:32.496550 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:32.496465    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:32.496728 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:32.496549    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:32.496728 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:32.496629    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:32.778818 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:32.778741    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 22:47:32.779306 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:32.779188    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv" event={"ID":"571e851d-c74f-49ae-93fe-86afecc79768","Type":"ContainerStarted","Data":"7a57f7aafc0f107d08209054cb2271c046ccbd78c9f83edd92d82e14708de513"}
Jul 08 22:47:32.779614 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:32.779592    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:32.779745 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:32.779662    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:32.796637 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:32.796597    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:32.796840 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:32.796824    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:47:32.807801 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:32.807752    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv" podStartSLOduration=8.772429313 podStartE2EDuration="27.807732974s" totalImagesPullingTime="19.035303661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:32.80708055 +0000 UTC m=+27.831662554" watchObservedRunningTime="2026-07-08 22:47:32.807732974 +0000 UTC m=+27.832314978"
Jul 08 22:47:32.810787 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:32.810761    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8kgb8"]
Jul 08 22:47:32.810894 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:32.810865    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:32.810992 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:32.810966    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:32.814023 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:32.813995    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-52n4x"]
Jul 08 22:47:32.814124 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:32.814081    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:32.814178 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:32.814163    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:32.825137 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:32.825104    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4sd78"]
Jul 08 22:47:32.825263 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:32.825214    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:32.825329 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:32.825309    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:34.496814 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:34.496651    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:34.497163 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:34.496711    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:34.497163 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:34.496918    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:34.497163 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:34.496711    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:34.497163 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:34.496963    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:34.497163 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:34.497041    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:34.785719 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:34.785671    2574 generic.go:356] "Generic (PLEG): container finished" podID="017f7171-4e43-4468-b4d0-9336ef8bfcee" containerID="35c2200755929e5a2cd46ac200407f59caa48f32056f7631230a2c61c795b9c1" exitCode=0
Jul 08 22:47:34.785909 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:34.785720    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bcjd8" event={"ID":"017f7171-4e43-4468-b4d0-9336ef8bfcee","Type":"ContainerDied","Data":"35c2200755929e5a2cd46ac200407f59caa48f32056f7631230a2c61c795b9c1"}
Jul 08 22:47:35.789871 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:35.789785    2574 generic.go:356] "Generic (PLEG): container finished" podID="017f7171-4e43-4468-b4d0-9336ef8bfcee" containerID="d47701f756982399ca08aeaafc0d0d3aab4f7643c8a46bf7b8bb707755855fda" exitCode=0
Jul 08 22:47:35.789871 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:35.789832    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bcjd8" event={"ID":"017f7171-4e43-4468-b4d0-9336ef8bfcee","Type":"ContainerDied","Data":"d47701f756982399ca08aeaafc0d0d3aab4f7643c8a46bf7b8bb707755855fda"}
Jul 08 22:47:36.496641 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:36.496598    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:36.496641 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:36.496625    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:36.496870 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:36.496644    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:36.496870 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:36.496751    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:36.496870 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:36.496825    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:36.497021 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:36.496891    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:36.794750 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:36.794651    2574 generic.go:356] "Generic (PLEG): container finished" podID="017f7171-4e43-4468-b4d0-9336ef8bfcee" containerID="2710d07a8568bcf72f7322786d401b7c325da76bddc8fda3f2cde4fe7ba411fe" exitCode=0
Jul 08 22:47:36.794750 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:36.794720    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bcjd8" event={"ID":"017f7171-4e43-4468-b4d0-9336ef8bfcee","Type":"ContainerDied","Data":"2710d07a8568bcf72f7322786d401b7c325da76bddc8fda3f2cde4fe7ba411fe"}
Jul 08 22:47:38.090160 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.090128    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret\") pod \"global-pull-secret-syncer-4sd78\" (UID: \"9d56c9bb-23d5-45f4-ac28-b73d088da22d\") " pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:38.090721 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:38.090464    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:38.090721 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:38.090565    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret podName:9d56c9bb-23d5-45f4-ac28-b73d088da22d nodeName:}" failed. No retries permitted until 2026-07-08 22:48:10.090544272 +0000 UTC m=+65.115126274 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret") pod "global-pull-secret-syncer-4sd78" (UID: "9d56c9bb-23d5-45f4-ac28-b73d088da22d") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:38.190941 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.190902    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs\") pod \"network-metrics-daemon-8kgb8\" (UID: \"b3eb825e-1dd9-461e-86b2-9fad2fade7e4\") " pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:38.191118 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:38.191059    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:38.191160 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:38.191131    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs podName:b3eb825e-1dd9-461e-86b2-9fad2fade7e4 nodeName:}" failed. No retries permitted until 2026-07-08 22:48:10.191110762 +0000 UTC m=+65.215692756 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs") pod "network-metrics-daemon-8kgb8" (UID: "b3eb825e-1dd9-461e-86b2-9fad2fade7e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:38.291660 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.291614    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnj54\" (UniqueName: \"kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54\") pod \"network-check-target-52n4x\" (UID: \"51fbf654-be84-41a6-b24c-1bd691c7c7fd\") " pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:38.291838 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:38.291806    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:47:38.291838 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:38.291828    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:47:38.291838 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:38.291839    2574 projected.go:196] Error preparing data for projected volume kube-api-access-cnj54 for pod openshift-network-diagnostics/network-check-target-52n4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:38.291950 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:38.291898    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54 podName:51fbf654-be84-41a6-b24c-1bd691c7c7fd nodeName:}" failed. No retries permitted until 2026-07-08 22:48:10.291885149 +0000 UTC m=+65.316467131 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnj54" (UniqueName: "kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54") pod "network-check-target-52n4x" (UID: "51fbf654-be84-41a6-b24c-1bd691c7c7fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:38.496394 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.496360    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:38.496554 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.496378    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:38.496554 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.496468    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:38.496554 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:38.496469    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52n4x" podUID="51fbf654-be84-41a6-b24c-1bd691c7c7fd"
Jul 08 22:47:38.496554 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:38.496533    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4sd78" podUID="9d56c9bb-23d5-45f4-ac28-b73d088da22d"
Jul 08 22:47:38.496787 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:38.496618    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:47:38.758073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.758004    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-70.ec2.internal" event="NodeReady"
Jul 08 22:47:38.758196 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.758138    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 22:47:38.801283 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.801247    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gbz29"]
Jul 08 22:47:38.803664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.803638    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-psmb8"]
Jul 08 22:47:38.803814 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.803784    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbz29"
Jul 08 22:47:38.806431 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.806406    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 22:47:38.806559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.806437    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 22:47:38.806559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.806406    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fbpb9\""
Jul 08 22:47:38.806559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.806486    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-psmb8"
Jul 08 22:47:38.809005 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.808984    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 22:47:38.809114 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.808992    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 22:47:38.809114 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.809097    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 22:47:38.809248 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.809232    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c5p5l\""
Jul 08 22:47:38.812722 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.812699    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-psmb8"]
Jul 08 22:47:38.815091 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.815056    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gbz29"]
Jul 08 22:47:38.895968 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.895941    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5dxm\" (UniqueName: \"kubernetes.io/projected/3285face-efa6-4a24-a733-7907738aba93-kube-api-access-k5dxm\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:47:38.896141 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.895980    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:47:38.896141 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.896001    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ec41f12-14d9-462d-b59f-43794e1d4423-cert\") pod \"ingress-canary-psmb8\" (UID: \"9ec41f12-14d9-462d-b59f-43794e1d4423\") " pod="openshift-ingress-canary/ingress-canary-psmb8"
Jul 08 22:47:38.896141 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.896055    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdj9l\" (UniqueName: \"kubernetes.io/projected/9ec41f12-14d9-462d-b59f-43794e1d4423-kube-api-access-wdj9l\") pod \"ingress-canary-psmb8\" (UID: \"9ec41f12-14d9-462d-b59f-43794e1d4423\") " pod="openshift-ingress-canary/ingress-canary-psmb8"
Jul 08 22:47:38.896141 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.896094    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3285face-efa6-4a24-a733-7907738aba93-tmp-dir\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:47:38.896141 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.896125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3285face-efa6-4a24-a733-7907738aba93-config-volume\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:47:38.996771 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.996739    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5dxm\" (UniqueName: \"kubernetes.io/projected/3285face-efa6-4a24-a733-7907738aba93-kube-api-access-k5dxm\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:47:38.996943 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.996779    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:47:38.996943 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.996802    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ec41f12-14d9-462d-b59f-43794e1d4423-cert\") pod \"ingress-canary-psmb8\" (UID: \"9ec41f12-14d9-462d-b59f-43794e1d4423\") " pod="openshift-ingress-canary/ingress-canary-psmb8"
Jul 08 22:47:38.996943 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.996828    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdj9l\" (UniqueName: \"kubernetes.io/projected/9ec41f12-14d9-462d-b59f-43794e1d4423-kube-api-access-wdj9l\") pod \"ingress-canary-psmb8\" (UID: \"9ec41f12-14d9-462d-b59f-43794e1d4423\") " pod="openshift-ingress-canary/ingress-canary-psmb8"
Jul 08 22:47:38.996943 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.996860    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3285face-efa6-4a24-a733-7907738aba93-tmp-dir\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:47:38.996943 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.996889    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3285face-efa6-4a24-a733-7907738aba93-config-volume\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:47:38.996943 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:38.996910    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:47:38.997264 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:38.997010    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls podName:3285face-efa6-4a24-a733-7907738aba93 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:39.496960526 +0000 UTC m=+34.521542520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls") pod "dns-default-gbz29" (UID: "3285face-efa6-4a24-a733-7907738aba93") : secret "dns-default-metrics-tls" not found
Jul 08 22:47:38.997327 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.997303    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3285face-efa6-4a24-a733-7907738aba93-tmp-dir\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:47:38.997461 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:38.997440    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3285face-efa6-4a24-a733-7907738aba93-config-volume\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:47:39.001299 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:39.001162    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ec41f12-14d9-462d-b59f-43794e1d4423-cert\") pod \"ingress-canary-psmb8\" (UID: \"9ec41f12-14d9-462d-b59f-43794e1d4423\") " pod="openshift-ingress-canary/ingress-canary-psmb8"
Jul 08 22:47:39.005617 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:39.005534    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5dxm\" (UniqueName: \"kubernetes.io/projected/3285face-efa6-4a24-a733-7907738aba93-kube-api-access-k5dxm\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:47:39.005830 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:39.005809    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdj9l\" (UniqueName: \"kubernetes.io/projected/9ec41f12-14d9-462d-b59f-43794e1d4423-kube-api-access-wdj9l\") pod \"ingress-canary-psmb8\" (UID: \"9ec41f12-14d9-462d-b59f-43794e1d4423\") " pod="openshift-ingress-canary/ingress-canary-psmb8"
Jul 08 22:47:39.124078 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:39.124044    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-psmb8"
Jul 08 22:47:39.260917 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:39.260884    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-psmb8"]
Jul 08 22:47:39.264405 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:47:39.264372    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec41f12_14d9_462d_b59f_43794e1d4423.slice/crio-ccc7d56f00189bdb0d4d8bd2affdf302dd064d6349c2437d2f680b28b57690f8 WatchSource:0}: Error finding container ccc7d56f00189bdb0d4d8bd2affdf302dd064d6349c2437d2f680b28b57690f8: Status 404 returned error can't find the container with id ccc7d56f00189bdb0d4d8bd2affdf302dd064d6349c2437d2f680b28b57690f8
Jul 08 22:47:39.501493 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:39.501401    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:47:39.501632 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:39.501511    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:47:39.501632 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:39.501572    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls podName:3285face-efa6-4a24-a733-7907738aba93 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:40.50155206 +0000 UTC m=+35.526134059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls") pod "dns-default-gbz29" (UID: "3285face-efa6-4a24-a733-7907738aba93") : secret "dns-default-metrics-tls" not found
Jul 08 22:47:39.803238 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:39.803163    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-psmb8" event={"ID":"9ec41f12-14d9-462d-b59f-43794e1d4423","Type":"ContainerStarted","Data":"ccc7d56f00189bdb0d4d8bd2affdf302dd064d6349c2437d2f680b28b57690f8"}
Jul 08 22:47:40.496562 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:40.496527    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:47:40.496562 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:40.496551    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:47:40.497129 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:40.496532    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:47:40.501058 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:40.501035    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 22:47:40.501188 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:40.501170    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7tfqh\""
Jul 08 22:47:40.501279 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:40.501192    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 22:47:40.501615 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:40.501594    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-48cc2\""
Jul 08 22:47:40.501987 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:40.501967    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 22:47:40.502679 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:40.502386    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 22:47:40.508010 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:40.507989    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:47:40.508188 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:40.508161    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:47:40.508286 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:40.508246    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls podName:3285face-efa6-4a24-a733-7907738aba93 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:42.508225494 +0000 UTC m=+37.532807481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls") pod "dns-default-gbz29" (UID: "3285face-efa6-4a24-a733-7907738aba93") : secret "dns-default-metrics-tls" not found
Jul 08 22:47:42.524918 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:42.524876    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:47:42.525294 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:42.525040    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:47:42.525294 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:42.525115    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls podName:3285face-efa6-4a24-a733-7907738aba93 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:46.52509837 +0000 UTC m=+41.549680355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls") pod "dns-default-gbz29" (UID: "3285face-efa6-4a24-a733-7907738aba93") : secret "dns-default-metrics-tls" not found
Jul 08 22:47:43.815510 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:43.815343    2574 generic.go:356] "Generic (PLEG): container finished" podID="017f7171-4e43-4468-b4d0-9336ef8bfcee" containerID="3191260a54ffa156c8e58a8c7f97b02f1b76505b4754b18885bd500d2c01b89e" exitCode=0
Jul 08 22:47:43.816031 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:43.815394    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bcjd8" event={"ID":"017f7171-4e43-4468-b4d0-9336ef8bfcee","Type":"ContainerDied","Data":"3191260a54ffa156c8e58a8c7f97b02f1b76505b4754b18885bd500d2c01b89e"}
Jul 08 22:47:43.816944 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:43.816919    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-psmb8" event={"ID":"9ec41f12-14d9-462d-b59f-43794e1d4423","Type":"ContainerStarted","Data":"b41fcb4c4643207107c51a46771ffe4941b7055bbb03ab4106d6fec4490115ae"}
Jul 08 22:47:43.853919 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:43.853878    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-psmb8" podStartSLOduration=1.978870547 podStartE2EDuration="5.853858436s" totalImagesPullingTime="3.874987889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:43.853433571 +0000 UTC m=+38.878015581" watchObservedRunningTime="2026-07-08 22:47:43.853858436 +0000 UTC m=+38.878440439"
Jul 08 22:47:44.821702 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:44.821660    2574 generic.go:356] "Generic (PLEG): container finished" podID="017f7171-4e43-4468-b4d0-9336ef8bfcee" containerID="4643fa96a581d56bedaf5cf29e5c4d2160749d21a592654af1a4a44c995b05d4" exitCode=0
Jul 08 22:47:44.822041 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:44.821718    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bcjd8" event={"ID":"017f7171-4e43-4468-b4d0-9336ef8bfcee","Type":"ContainerDied","Data":"4643fa96a581d56bedaf5cf29e5c4d2160749d21a592654af1a4a44c995b05d4"}
Jul 08 22:47:45.827299 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:45.827259    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bcjd8" event={"ID":"017f7171-4e43-4468-b4d0-9336ef8bfcee","Type":"ContainerStarted","Data":"c99f2cb79ec355cac35e427d8fbc8fdd2e20a30d0092dc7c63e7f67b2f05d5d6"}
Jul 08 22:47:45.850371 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:45.850320    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bcjd8" podStartSLOduration=7.46291907 podStartE2EDuration="40.850303131s" totalImagesPullingTime="33.387384061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:45.848153125 +0000 UTC m=+40.872735128" watchObservedRunningTime="2026-07-08 22:47:45.850303131 +0000 UTC m=+40.874885133"
Jul 08 22:47:46.553977 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:46.553940    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:47:46.554169 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:46.554120    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:47:46.554324 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:46.554203    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls podName:3285face-efa6-4a24-a733-7907738aba93 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:54.554180486 +0000 UTC m=+49.578762477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls") pod "dns-default-gbz29" (UID: "3285face-efa6-4a24-a733-7907738aba93") : secret "dns-default-metrics-tls" not found
Jul 08 22:47:54.610518 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:47:54.610473    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:47:54.610957 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:54.610653    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:47:54.610957 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:47:54.610734    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls podName:3285face-efa6-4a24-a733-7907738aba93 nodeName:}" failed. No retries permitted until 2026-07-08 22:48:10.610717453 +0000 UTC m=+65.635299434 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls") pod "dns-default-gbz29" (UID: "3285face-efa6-4a24-a733-7907738aba93") : secret "dns-default-metrics-tls" not found
Jul 08 22:48:04.805941 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:04.805913    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kb8bv"
Jul 08 22:48:10.113160 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:10.113103    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret\") pod \"global-pull-secret-syncer-4sd78\" (UID: \"9d56c9bb-23d5-45f4-ac28-b73d088da22d\") " pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:48:10.116249 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:10.116229    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 22:48:10.126766 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:10.126748    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d56c9bb-23d5-45f4-ac28-b73d088da22d-original-pull-secret\") pod \"global-pull-secret-syncer-4sd78\" (UID: \"9d56c9bb-23d5-45f4-ac28-b73d088da22d\") " pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:48:10.213593 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:10.213560    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs\") pod \"network-metrics-daemon-8kgb8\" (UID: \"b3eb825e-1dd9-461e-86b2-9fad2fade7e4\") " pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:48:10.216266 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:10.216250    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 22:48:10.224479 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:48:10.224462    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 22:48:10.224535 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:48:10.224525    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs podName:b3eb825e-1dd9-461e-86b2-9fad2fade7e4 nodeName:}" failed. No retries permitted until 2026-07-08 22:49:14.224503695 +0000 UTC m=+129.249085690 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs") pod "network-metrics-daemon-8kgb8" (UID: "b3eb825e-1dd9-461e-86b2-9fad2fade7e4") : secret "metrics-daemon-secret" not found
Jul 08 22:48:10.225719 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:10.225706    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4sd78"
Jul 08 22:48:10.314568 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:10.314538    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnj54\" (UniqueName: \"kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54\") pod \"network-check-target-52n4x\" (UID: \"51fbf654-be84-41a6-b24c-1bd691c7c7fd\") " pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:48:10.317286 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:10.317267    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 22:48:10.327668 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:10.327641    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 22:48:10.338273 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:10.338221    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnj54\" (UniqueName: \"kubernetes.io/projected/51fbf654-be84-41a6-b24c-1bd691c7c7fd-kube-api-access-cnj54\") pod \"network-check-target-52n4x\" (UID: \"51fbf654-be84-41a6-b24c-1bd691c7c7fd\") " pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:48:10.338933 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:10.338916    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4sd78"]
Jul 08 22:48:10.342350 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:48:10.342318    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d56c9bb_23d5_45f4_ac28_b73d088da22d.slice/crio-ae7027d4a583356b97944cd25187d37fa54289c54d469a1a66394e96afb5fdac WatchSource:0}: Error finding container ae7027d4a583356b97944cd25187d37fa54289c54d469a1a66394e96afb5fdac: Status 404 returned error can't find the container with id ae7027d4a583356b97944cd25187d37fa54289c54d469a1a66394e96afb5fdac
Jul 08 22:48:10.513776 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:10.513742    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7tfqh\""
Jul 08 22:48:10.522083 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:10.522049    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:48:10.618255 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:10.618220    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:48:10.618465 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:48:10.618325    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:48:10.618465 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:48:10.618375    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls podName:3285face-efa6-4a24-a733-7907738aba93 nodeName:}" failed. No retries permitted until 2026-07-08 22:48:42.618361928 +0000 UTC m=+97.642943913 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls") pod "dns-default-gbz29" (UID: "3285face-efa6-4a24-a733-7907738aba93") : secret "dns-default-metrics-tls" not found
Jul 08 22:48:10.651418 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:10.651359    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-52n4x"]
Jul 08 22:48:10.654931 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:48:10.654904    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51fbf654_be84_41a6_b24c_1bd691c7c7fd.slice/crio-80b057ab05a0e030dd3382feeb9cced469f47f50b11f22b33f65174f4f0a4190 WatchSource:0}: Error finding container 80b057ab05a0e030dd3382feeb9cced469f47f50b11f22b33f65174f4f0a4190: Status 404 returned error can't find the container with id 80b057ab05a0e030dd3382feeb9cced469f47f50b11f22b33f65174f4f0a4190
Jul 08 22:48:10.886252 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:10.886214    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-52n4x" event={"ID":"51fbf654-be84-41a6-b24c-1bd691c7c7fd","Type":"ContainerStarted","Data":"80b057ab05a0e030dd3382feeb9cced469f47f50b11f22b33f65174f4f0a4190"}
Jul 08 22:48:10.887353 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:10.887317    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4sd78" event={"ID":"9d56c9bb-23d5-45f4-ac28-b73d088da22d","Type":"ContainerStarted","Data":"ae7027d4a583356b97944cd25187d37fa54289c54d469a1a66394e96afb5fdac"}
Jul 08 22:48:15.905086 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:15.905050    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-52n4x" event={"ID":"51fbf654-be84-41a6-b24c-1bd691c7c7fd","Type":"ContainerStarted","Data":"440d961cc990e7865d773200b2676c96b17e52de5ab2b54a5b2eab7f6a4e41f0"}
Jul 08 22:48:15.905553 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:15.905194    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:48:15.906518 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:15.906493    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4sd78" event={"ID":"9d56c9bb-23d5-45f4-ac28-b73d088da22d","Type":"ContainerStarted","Data":"2502a1982691a10f7208161f85e39dda1d2f4aff30d5a08b126f014cc6221859"}
Jul 08 22:48:15.920675 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:15.920633    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-52n4x" podStartSLOduration=66.198080394 podStartE2EDuration="1m10.920619189s" totalImagesPullingTime="4.722538795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:48:15.920193579 +0000 UTC m=+70.944775582" watchObservedRunningTime="2026-07-08 22:48:15.920619189 +0000 UTC m=+70.945201192"
Jul 08 22:48:15.933752 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:15.933678    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4sd78" podStartSLOduration=65.893775963 podStartE2EDuration="1m10.933659016s" totalImagesPullingTime="5.039883053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:48:15.933647972 +0000 UTC m=+70.958229975" watchObservedRunningTime="2026-07-08 22:48:15.933659016 +0000 UTC m=+70.958241019"
Jul 08 22:48:37.328533 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.328403    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"]
Jul 08 22:48:37.330967 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.330945    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"
Jul 08 22:48:37.331709 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.331676    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"]
Jul 08 22:48:37.333240 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.333225    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.333498 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.333481    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 08 22:48:37.333584 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.333510    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 22:48:37.334766 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.334750    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 22:48:37.334855 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.334785    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 22:48:37.335754 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.335736    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 08 22:48:37.335844 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.335769    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 08 22:48:37.335844 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.335779    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 08 22:48:37.335964 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.335862    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 08 22:48:37.341773 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.341754    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"]
Jul 08 22:48:37.350186 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.350166    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"]
Jul 08 22:48:37.395004 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.394967    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/82d32c44-929e-4096-806d-06f274bd9804-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.395004 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.395007    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/82d32c44-929e-4096-806d-06f274bd9804-hub\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.395199 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.395031    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s667\" (UniqueName: \"kubernetes.io/projected/82d32c44-929e-4096-806d-06f274bd9804-kube-api-access-5s667\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.395199 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.395084    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/82d32c44-929e-4096-806d-06f274bd9804-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.395199 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.395115    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb85z\" (UniqueName: \"kubernetes.io/projected/e9dbb719-2195-4b74-8399-a989289f48dd-kube-api-access-cb85z\") pod \"klusterlet-addon-workmgr-69d6655c7c-zcnl6\" (UID: \"e9dbb719-2195-4b74-8399-a989289f48dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"
Jul 08 22:48:37.395199 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.395165    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/82d32c44-929e-4096-806d-06f274bd9804-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.395199 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.395192    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9dbb719-2195-4b74-8399-a989289f48dd-tmp\") pod \"klusterlet-addon-workmgr-69d6655c7c-zcnl6\" (UID: \"e9dbb719-2195-4b74-8399-a989289f48dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"
Jul 08 22:48:37.395347 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.395230    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e9dbb719-2195-4b74-8399-a989289f48dd-klusterlet-config\") pod \"klusterlet-addon-workmgr-69d6655c7c-zcnl6\" (UID: \"e9dbb719-2195-4b74-8399-a989289f48dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"
Jul 08 22:48:37.395347 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.395255    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/82d32c44-929e-4096-806d-06f274bd9804-ca\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.495542 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.495506    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/82d32c44-929e-4096-806d-06f274bd9804-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.495785 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.495554    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9dbb719-2195-4b74-8399-a989289f48dd-tmp\") pod \"klusterlet-addon-workmgr-69d6655c7c-zcnl6\" (UID: \"e9dbb719-2195-4b74-8399-a989289f48dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"
Jul 08 22:48:37.495785 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.495592    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e9dbb719-2195-4b74-8399-a989289f48dd-klusterlet-config\") pod \"klusterlet-addon-workmgr-69d6655c7c-zcnl6\" (UID: \"e9dbb719-2195-4b74-8399-a989289f48dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"
Jul 08 22:48:37.495785 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.495618    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/82d32c44-929e-4096-806d-06f274bd9804-ca\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.495785 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.495646    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/82d32c44-929e-4096-806d-06f274bd9804-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.495785 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.495710    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/82d32c44-929e-4096-806d-06f274bd9804-hub\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.495785 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.495745    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s667\" (UniqueName: \"kubernetes.io/projected/82d32c44-929e-4096-806d-06f274bd9804-kube-api-access-5s667\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.495785 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.495772    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/82d32c44-929e-4096-806d-06f274bd9804-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.496117 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.495800    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb85z\" (UniqueName: \"kubernetes.io/projected/e9dbb719-2195-4b74-8399-a989289f48dd-kube-api-access-cb85z\") pod \"klusterlet-addon-workmgr-69d6655c7c-zcnl6\" (UID: \"e9dbb719-2195-4b74-8399-a989289f48dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"
Jul 08 22:48:37.496366 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.496342    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/82d32c44-929e-4096-806d-06f274bd9804-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.496614 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.496558    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9dbb719-2195-4b74-8399-a989289f48dd-tmp\") pod \"klusterlet-addon-workmgr-69d6655c7c-zcnl6\" (UID: \"e9dbb719-2195-4b74-8399-a989289f48dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"
Jul 08 22:48:37.498544 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.498524    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e9dbb719-2195-4b74-8399-a989289f48dd-klusterlet-config\") pod \"klusterlet-addon-workmgr-69d6655c7c-zcnl6\" (UID: \"e9dbb719-2195-4b74-8399-a989289f48dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"
Jul 08 22:48:37.498653 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.498558    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/82d32c44-929e-4096-806d-06f274bd9804-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.498653 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.498631    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/82d32c44-929e-4096-806d-06f274bd9804-ca\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.498771 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.498745    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/82d32c44-929e-4096-806d-06f274bd9804-hub\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.499191 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.499175    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/82d32c44-929e-4096-806d-06f274bd9804-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.503243 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.503220    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s667\" (UniqueName: \"kubernetes.io/projected/82d32c44-929e-4096-806d-06f274bd9804-kube-api-access-5s667\") pod \"cluster-proxy-proxy-agent-64bff54ddc-v59rg\" (UID: \"82d32c44-929e-4096-806d-06f274bd9804\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.503327 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.503267    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb85z\" (UniqueName: \"kubernetes.io/projected/e9dbb719-2195-4b74-8399-a989289f48dd-kube-api-access-cb85z\") pod \"klusterlet-addon-workmgr-69d6655c7c-zcnl6\" (UID: \"e9dbb719-2195-4b74-8399-a989289f48dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"
Jul 08 22:48:37.641387 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.641353    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"
Jul 08 22:48:37.656363 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.656338    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:48:37.765186 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.765152    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"]
Jul 08 22:48:37.767544 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:48:37.767522    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9dbb719_2195_4b74_8399_a989289f48dd.slice/crio-ab9d3492795ffb60aeede1dc5ec407081b75eba72746c76cd922b37d66afcf6e WatchSource:0}: Error finding container ab9d3492795ffb60aeede1dc5ec407081b75eba72746c76cd922b37d66afcf6e: Status 404 returned error can't find the container with id ab9d3492795ffb60aeede1dc5ec407081b75eba72746c76cd922b37d66afcf6e
Jul 08 22:48:37.782495 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.782470    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"]
Jul 08 22:48:37.785205 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:48:37.785182    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82d32c44_929e_4096_806d_06f274bd9804.slice/crio-4e9813472a1e4052eb18342987769c3dc7e47926d0a25698233baef137e32f29 WatchSource:0}: Error finding container 4e9813472a1e4052eb18342987769c3dc7e47926d0a25698233baef137e32f29: Status 404 returned error can't find the container with id 4e9813472a1e4052eb18342987769c3dc7e47926d0a25698233baef137e32f29
Jul 08 22:48:37.958902 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.958816    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg" event={"ID":"82d32c44-929e-4096-806d-06f274bd9804","Type":"ContainerStarted","Data":"4e9813472a1e4052eb18342987769c3dc7e47926d0a25698233baef137e32f29"}
Jul 08 22:48:37.959894 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:37.959859    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6" event={"ID":"e9dbb719-2195-4b74-8399-a989289f48dd","Type":"ContainerStarted","Data":"ab9d3492795ffb60aeede1dc5ec407081b75eba72746c76cd922b37d66afcf6e"}
Jul 08 22:48:42.635479 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:42.635450    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:48:42.635869 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:48:42.635552    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:48:42.635869 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:48:42.635614    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls podName:3285face-efa6-4a24-a733-7907738aba93 nodeName:}" failed. No retries permitted until 2026-07-08 22:49:46.635599591 +0000 UTC m=+161.660181573 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls") pod "dns-default-gbz29" (UID: "3285face-efa6-4a24-a733-7907738aba93") : secret "dns-default-metrics-tls" not found
Jul 08 22:48:42.977350 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:42.977246    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg" event={"ID":"82d32c44-929e-4096-806d-06f274bd9804","Type":"ContainerStarted","Data":"07de0c743206e672be3d050504fbcedad0c3bdf34f0e2ff1e7df24653cb0a9bb"}
Jul 08 22:48:42.977350 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:42.977290    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg" event={"ID":"82d32c44-929e-4096-806d-06f274bd9804","Type":"ContainerStarted","Data":"37731bfd71c984ffb8a356994b83a2107e7d691581b00fd73b4cc7dcfc85d0c9"}
Jul 08 22:48:42.977350 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:42.977305    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg" event={"ID":"82d32c44-929e-4096-806d-06f274bd9804","Type":"ContainerStarted","Data":"8dbbadcfe8758bc8a87220a24ab0d70a33f7f96f4e8c2b46738c65c8e84fc259"}
Jul 08 22:48:42.978669 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:42.978646    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6" event={"ID":"e9dbb719-2195-4b74-8399-a989289f48dd","Type":"ContainerStarted","Data":"fc53e174cddd5d76e60a5c8261093adbdcd4b2b80ebeeb6685b41b0577731c0e"}
Jul 08 22:48:42.978892 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:42.978877    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"
Jul 08 22:48:42.980386 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:42.980368    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"
Jul 08 22:48:42.996828 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:42.996782    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg" podStartSLOduration=1.184885447 podStartE2EDuration="5.996768441s" totalImagesPullingTime="4.811882994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:48:42.995063932 +0000 UTC m=+98.019645937" watchObservedRunningTime="2026-07-08 22:48:42.996768441 +0000 UTC m=+98.021350440"
Jul 08 22:48:43.009024 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:43.008979    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6" podStartSLOduration=1.179837067 podStartE2EDuration="6.008965967s" totalImagesPullingTime="4.8291289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:48:43.00877108 +0000 UTC m=+98.033353078" watchObservedRunningTime="2026-07-08 22:48:43.008965967 +0000 UTC m=+98.033547968"
Jul 08 22:48:46.911664 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:48:46.911633    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-52n4x"
Jul 08 22:49:14.264927 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:49:14.264884    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs\") pod \"network-metrics-daemon-8kgb8\" (UID: \"b3eb825e-1dd9-461e-86b2-9fad2fade7e4\") " pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:49:14.265405 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:49:14.265030    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 22:49:14.265405 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:49:14.265100    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs podName:b3eb825e-1dd9-461e-86b2-9fad2fade7e4 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:16.265081969 +0000 UTC m=+251.289663956 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs") pod "network-metrics-daemon-8kgb8" (UID: "b3eb825e-1dd9-461e-86b2-9fad2fade7e4") : secret "metrics-daemon-secret" not found
Jul 08 22:49:41.817077 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:49:41.817025    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gbz29" podUID="3285face-efa6-4a24-a733-7907738aba93"
Jul 08 22:49:42.143157 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:49:42.143130    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbz29"
Jul 08 22:49:43.519941 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:49:43.519899    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:49:46.689382 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:49:46.689337    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:49:46.689819 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:49:46.689464    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:49:46.689819 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:49:46.689515    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls podName:3285face-efa6-4a24-a733-7907738aba93 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:48.689501879 +0000 UTC m=+283.714083860 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls") pod "dns-default-gbz29" (UID: "3285face-efa6-4a24-a733-7907738aba93") : secret "dns-default-metrics-tls" not found
Jul 08 22:49:56.496516 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:49:56.496479    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:50:42.979973 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:50:42.979854    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6" podUID="e9dbb719-2195-4b74-8399-a989289f48dd" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused"
Jul 08 22:50:43.320153 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:50:43.320067    2574 generic.go:356] "Generic (PLEG): container finished" podID="e9dbb719-2195-4b74-8399-a989289f48dd" containerID="fc53e174cddd5d76e60a5c8261093adbdcd4b2b80ebeeb6685b41b0577731c0e" exitCode=1
Jul 08 22:50:43.320153 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:50:43.320128    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6" event={"ID":"e9dbb719-2195-4b74-8399-a989289f48dd","Type":"ContainerDied","Data":"fc53e174cddd5d76e60a5c8261093adbdcd4b2b80ebeeb6685b41b0577731c0e"}
Jul 08 22:50:43.320467 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:50:43.320453    2574 scope.go:117] "RemoveContainer" containerID="fc53e174cddd5d76e60a5c8261093adbdcd4b2b80ebeeb6685b41b0577731c0e"
Jul 08 22:50:44.328073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:50:44.328035    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6" event={"ID":"e9dbb719-2195-4b74-8399-a989289f48dd","Type":"ContainerStarted","Data":"d17814b87c8e6ac450797597e89dceaaa54e4c27884c81234a03666f54f4d59c"}
Jul 08 22:50:44.328487 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:50:44.328328    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"
Jul 08 22:50:44.328943 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:50:44.328925    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d6655c7c-zcnl6"
Jul 08 22:51:12.595540 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.595505    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vz8h2"]
Jul 08 22:51:12.597273 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.597257    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:12.600291 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.600262    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 22:51:12.601616 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.601597    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 22:51:12.601739 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.601657    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 22:51:12.601739 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.601657    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 22:51:12.601811 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.601749    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gcg7c\""
Jul 08 22:51:12.608348 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.608323    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vz8h2"]
Jul 08 22:51:12.677972 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.677935    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8145d27e-5c12-40dd-bdde-d3af3b19da13-crio-socket\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:12.678183 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.677992    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:12.678183 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.678059    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kdjz\" (UniqueName: \"kubernetes.io/projected/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-api-access-9kdjz\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:12.678183 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.678155    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:12.678317 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.678192    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8145d27e-5c12-40dd-bdde-d3af3b19da13-data-volume\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:12.779327 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.779288    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8145d27e-5c12-40dd-bdde-d3af3b19da13-crio-socket\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:12.779517 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.779351    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:12.779517 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.779374    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kdjz\" (UniqueName: \"kubernetes.io/projected/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-api-access-9kdjz\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:12.779517 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.779420    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8145d27e-5c12-40dd-bdde-d3af3b19da13-crio-socket\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:12.779517 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:12.779456    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 22:51:12.779517 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.779428    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:12.779517 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:12.779509    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:12.779517 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:12.779520    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm podName:8145d27e-5c12-40dd-bdde-d3af3b19da13 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:13.279500806 +0000 UTC m=+248.304082797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vz8h2" (UID: "8145d27e-5c12-40dd-bdde-d3af3b19da13") : configmap "kube-rbac-proxy" not found
Jul 08 22:51:12.779851 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.779553    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8145d27e-5c12-40dd-bdde-d3af3b19da13-data-volume\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:12.779851 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:12.779573    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls podName:8145d27e-5c12-40dd-bdde-d3af3b19da13 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:13.279556093 +0000 UTC m=+248.304138094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vz8h2" (UID: "8145d27e-5c12-40dd-bdde-d3af3b19da13") : secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:12.779936 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.779862    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8145d27e-5c12-40dd-bdde-d3af3b19da13-data-volume\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:12.787333 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:12.787302    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kdjz\" (UniqueName: \"kubernetes.io/projected/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-api-access-9kdjz\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:13.284174 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:13.284140    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:13.284361 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:13.284197    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:13.284361 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:13.284273    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 22:51:13.284361 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:13.284303    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:13.284361 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:13.284342    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm podName:8145d27e-5c12-40dd-bdde-d3af3b19da13 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:14.284325913 +0000 UTC m=+249.308907895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vz8h2" (UID: "8145d27e-5c12-40dd-bdde-d3af3b19da13") : configmap "kube-rbac-proxy" not found
Jul 08 22:51:13.284361 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:13.284357    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls podName:8145d27e-5c12-40dd-bdde-d3af3b19da13 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:14.284350807 +0000 UTC m=+249.308932789 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vz8h2" (UID: "8145d27e-5c12-40dd-bdde-d3af3b19da13") : secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:14.291970 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:14.291927    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:14.292346 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:14.292082    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:14.292346 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:14.292083    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:14.292346 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:14.292114    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 22:51:14.292346 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:14.292175    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls podName:8145d27e-5c12-40dd-bdde-d3af3b19da13 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:16.292154016 +0000 UTC m=+251.316736021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vz8h2" (UID: "8145d27e-5c12-40dd-bdde-d3af3b19da13") : secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:14.292346 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:14.292202    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm podName:8145d27e-5c12-40dd-bdde-d3af3b19da13 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:16.292187458 +0000 UTC m=+251.316769454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vz8h2" (UID: "8145d27e-5c12-40dd-bdde-d3af3b19da13") : configmap "kube-rbac-proxy" not found
Jul 08 22:51:14.777700 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:14.777667    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ztqww_7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998/dns-node-resolver/0.log"
Jul 08 22:51:15.777733 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:15.777707    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xnvtv_021e1384-753b-4d72-a772-b89e2bfcd232/node-ca/0.log"
Jul 08 22:51:16.303623 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:16.303587    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:16.303800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:16.303636    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs\") pod \"network-metrics-daemon-8kgb8\" (UID: \"b3eb825e-1dd9-461e-86b2-9fad2fade7e4\") " pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:51:16.303800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:16.303664    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:16.303800 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:16.303739    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 22:51:16.303800 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:16.303766    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 22:51:16.303935 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:16.303803    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm podName:8145d27e-5c12-40dd-bdde-d3af3b19da13 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:20.303786645 +0000 UTC m=+255.328368630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vz8h2" (UID: "8145d27e-5c12-40dd-bdde-d3af3b19da13") : configmap "kube-rbac-proxy" not found
Jul 08 22:51:16.303935 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:16.303766    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:16.303935 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:16.303817    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs podName:b3eb825e-1dd9-461e-86b2-9fad2fade7e4 nodeName:}" failed. No retries permitted until 2026-07-08 22:53:18.303811218 +0000 UTC m=+373.328393203 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs") pod "network-metrics-daemon-8kgb8" (UID: "b3eb825e-1dd9-461e-86b2-9fad2fade7e4") : secret "metrics-daemon-secret" not found
Jul 08 22:51:16.303935 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:16.303836    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls podName:8145d27e-5c12-40dd-bdde-d3af3b19da13 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:20.303823675 +0000 UTC m=+255.328405658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vz8h2" (UID: "8145d27e-5c12-40dd-bdde-d3af3b19da13") : secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:16.381364 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:16.381336    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-psmb8_9ec41f12-14d9-462d-b59f-43794e1d4423/serve-healthcheck-canary/0.log"
Jul 08 22:51:20.333737 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:20.333679    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:20.334203 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:20.333771    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:20.334203 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:20.333805    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 22:51:20.334203 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:20.333871    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm podName:8145d27e-5c12-40dd-bdde-d3af3b19da13 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:28.33385389 +0000 UTC m=+263.358435872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vz8h2" (UID: "8145d27e-5c12-40dd-bdde-d3af3b19da13") : configmap "kube-rbac-proxy" not found
Jul 08 22:51:20.334203 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:20.333876    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:20.334203 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:20.333929    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls podName:8145d27e-5c12-40dd-bdde-d3af3b19da13 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:28.333914222 +0000 UTC m=+263.358496226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vz8h2" (UID: "8145d27e-5c12-40dd-bdde-d3af3b19da13") : secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:28.393212 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:28.393128    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:28.393212 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:28.393195    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:28.393948 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:28.393768    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8145d27e-5c12-40dd-bdde-d3af3b19da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:28.398875 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:28.398848    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8145d27e-5c12-40dd-bdde-d3af3b19da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vz8h2\" (UID: \"8145d27e-5c12-40dd-bdde-d3af3b19da13\") " pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:28.506716 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:28.506656    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vz8h2"
Jul 08 22:51:28.634611 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:28.634576    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vz8h2"]
Jul 08 22:51:28.638085 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:51:28.638055    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8145d27e_5c12_40dd_bdde_d3af3b19da13.slice/crio-75b19466c32112294374b9f357df59a2b668712e2c7d07b89a5f980ec321b334 WatchSource:0}: Error finding container 75b19466c32112294374b9f357df59a2b668712e2c7d07b89a5f980ec321b334: Status 404 returned error can't find the container with id 75b19466c32112294374b9f357df59a2b668712e2c7d07b89a5f980ec321b334
Jul 08 22:51:29.457444 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:29.457405    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vz8h2" event={"ID":"8145d27e-5c12-40dd-bdde-d3af3b19da13","Type":"ContainerStarted","Data":"75b19466c32112294374b9f357df59a2b668712e2c7d07b89a5f980ec321b334"}
Jul 08 22:51:32.468398 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:32.468368    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vz8h2" event={"ID":"8145d27e-5c12-40dd-bdde-d3af3b19da13","Type":"ContainerStarted","Data":"7968738db1156d60ed5a882666113a900902cfb1a36a2f87ea9ac6e3a0c3a707"}
Jul 08 22:51:33.474111 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:33.474072    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vz8h2" event={"ID":"8145d27e-5c12-40dd-bdde-d3af3b19da13","Type":"ContainerStarted","Data":"175db04e2b51c6518d8a7499d68b1680a5cb6ff1024b58790f1efc01accb4f41"}
Jul 08 22:51:34.243385 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.243354    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5677c78758-5qjft"]
Jul 08 22:51:34.246136 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.246110    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.248939 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.248910    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 22:51:34.249090 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.248913    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 22:51:34.250121 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.250086    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 22:51:34.250121 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.250092    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cvqzh\""
Jul 08 22:51:34.254124 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.254101    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 22:51:34.261728 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.261669    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5677c78758-5qjft"]
Jul 08 22:51:34.338208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.338174    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7c617de0-afc8-4030-9f3c-1e31a5937fe1-image-registry-private-configuration\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.338208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.338210    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c617de0-afc8-4030-9f3c-1e31a5937fe1-registry-tls\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.338432 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.338237    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7c617de0-afc8-4030-9f3c-1e31a5937fe1-ca-trust-extracted\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.338432 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.338299    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7c617de0-afc8-4030-9f3c-1e31a5937fe1-installation-pull-secrets\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.338432 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.338341    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7c617de0-afc8-4030-9f3c-1e31a5937fe1-registry-certificates\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.338432 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.338391    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz5zp\" (UniqueName: \"kubernetes.io/projected/7c617de0-afc8-4030-9f3c-1e31a5937fe1-kube-api-access-xz5zp\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.338627 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.338450    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c617de0-afc8-4030-9f3c-1e31a5937fe1-trusted-ca\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.338627 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.338485    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c617de0-afc8-4030-9f3c-1e31a5937fe1-bound-sa-token\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.440085 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.440045    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c617de0-afc8-4030-9f3c-1e31a5937fe1-bound-sa-token\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.440271 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.440129    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7c617de0-afc8-4030-9f3c-1e31a5937fe1-image-registry-private-configuration\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.440271 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.440157    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c617de0-afc8-4030-9f3c-1e31a5937fe1-registry-tls\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.440271 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.440179    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7c617de0-afc8-4030-9f3c-1e31a5937fe1-ca-trust-extracted\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.440439 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.440324    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7c617de0-afc8-4030-9f3c-1e31a5937fe1-installation-pull-secrets\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.440439 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.440381    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7c617de0-afc8-4030-9f3c-1e31a5937fe1-registry-certificates\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.440535 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.440455    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz5zp\" (UniqueName: \"kubernetes.io/projected/7c617de0-afc8-4030-9f3c-1e31a5937fe1-kube-api-access-xz5zp\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.440535 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.440500    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c617de0-afc8-4030-9f3c-1e31a5937fe1-trusted-ca\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.440827 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.440774    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7c617de0-afc8-4030-9f3c-1e31a5937fe1-ca-trust-extracted\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.441377 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.441293    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7c617de0-afc8-4030-9f3c-1e31a5937fe1-registry-certificates\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.441377 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.441329    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c617de0-afc8-4030-9f3c-1e31a5937fe1-trusted-ca\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.443039 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.443016    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7c617de0-afc8-4030-9f3c-1e31a5937fe1-image-registry-private-configuration\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.443230 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.443203    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c617de0-afc8-4030-9f3c-1e31a5937fe1-registry-tls\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.443336 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.443318    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7c617de0-afc8-4030-9f3c-1e31a5937fe1-installation-pull-secrets\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.451123 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.451100    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c617de0-afc8-4030-9f3c-1e31a5937fe1-bound-sa-token\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.451811 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.451786    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz5zp\" (UniqueName: \"kubernetes.io/projected/7c617de0-afc8-4030-9f3c-1e31a5937fe1-kube-api-access-xz5zp\") pod \"image-registry-5677c78758-5qjft\" (UID: \"7c617de0-afc8-4030-9f3c-1e31a5937fe1\") " pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:34.556407 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:34.556320    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:35.425639 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:35.425603    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5677c78758-5qjft"]
Jul 08 22:51:35.429275 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:51:35.429244    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c617de0_afc8_4030_9f3c_1e31a5937fe1.slice/crio-25f418be39c0bdfb709a59343d84bdb89ec134fff23c6fefd5bb81299e6b029a WatchSource:0}: Error finding container 25f418be39c0bdfb709a59343d84bdb89ec134fff23c6fefd5bb81299e6b029a: Status 404 returned error can't find the container with id 25f418be39c0bdfb709a59343d84bdb89ec134fff23c6fefd5bb81299e6b029a
Jul 08 22:51:35.481750 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:35.481722    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vz8h2" event={"ID":"8145d27e-5c12-40dd-bdde-d3af3b19da13","Type":"ContainerStarted","Data":"1cd6bbb93bfb6a7051f8a28f01e1e36a5c46d8d48b3d4a8b490cbd67b8916c2e"}
Jul 08 22:51:35.483161 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:35.483139    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5677c78758-5qjft" event={"ID":"7c617de0-afc8-4030-9f3c-1e31a5937fe1","Type":"ContainerStarted","Data":"25f418be39c0bdfb709a59343d84bdb89ec134fff23c6fefd5bb81299e6b029a"}
Jul 08 22:51:35.500411 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:35.500362    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vz8h2" podStartSLOduration=16.905753223 podStartE2EDuration="23.500346776s" totalImagesPullingTime="6.594593553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:51:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:35.499613204 +0000 UTC m=+270.524195223" watchObservedRunningTime="2026-07-08 22:51:35.500346776 +0000 UTC m=+270.524928780"
Jul 08 22:51:36.487780 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:36.487746    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5677c78758-5qjft" event={"ID":"7c617de0-afc8-4030-9f3c-1e31a5937fe1","Type":"ContainerStarted","Data":"1c21e1a692fac4f2077d558ca6f08d351a32f64e6f241f6cc7a817520ebc4f48"}
Jul 08 22:51:36.488156 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:36.487867    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:36.508710 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:36.508649    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5677c78758-5qjft" podStartSLOduration=2.508634268 podStartE2EDuration="2.508634268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:51:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:36.507136097 +0000 UTC m=+271.531718102" watchObservedRunningTime="2026-07-08 22:51:36.508634268 +0000 UTC m=+271.533216271"
Jul 08 22:51:42.618248 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.618216    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nprhm"]
Jul 08 22:51:42.623248 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.623226    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.625730 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.625702    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 22:51:42.625872 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.625854    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zr2jk\""
Jul 08 22:51:42.627027 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.627009    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 22:51:42.627143 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.627026    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 22:51:42.627143 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.627045    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 22:51:42.627143 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.627089    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 22:51:42.627143 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.627126    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 22:51:42.701603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.701565    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.701810 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.701610    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c454d9a2-e484-44ac-bf0f-4e1788ade819-sys\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.701810 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.701659    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-wtmp\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.701810 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.701747    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-tls\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.701810 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.701769    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c454d9a2-e484-44ac-bf0f-4e1788ade819-root\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.701810 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.701791    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-textfile\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.701994 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.701817    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhx5v\" (UniqueName: \"kubernetes.io/projected/c454d9a2-e484-44ac-bf0f-4e1788ade819-kube-api-access-rhx5v\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.701994 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.701851    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c454d9a2-e484-44ac-bf0f-4e1788ade819-metrics-client-ca\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.701994 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.701881    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-accelerators-collector-config\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.802557 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.802520    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c454d9a2-e484-44ac-bf0f-4e1788ade819-sys\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.802766 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.802569    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-wtmp\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.802766 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.802599    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-tls\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.802766 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.802623    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c454d9a2-e484-44ac-bf0f-4e1788ade819-root\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.802766 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.802653    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-textfile\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.802766 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.802622    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c454d9a2-e484-44ac-bf0f-4e1788ade819-sys\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.802766 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.802720    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c454d9a2-e484-44ac-bf0f-4e1788ade819-root\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.803045 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:42.802771    2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 22:51:42.803045 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.802783    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhx5v\" (UniqueName: \"kubernetes.io/projected/c454d9a2-e484-44ac-bf0f-4e1788ade819-kube-api-access-rhx5v\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.803045 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.802769    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-wtmp\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.803045 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:42.802828    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-tls podName:c454d9a2-e484-44ac-bf0f-4e1788ade819 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:43.30280784 +0000 UTC m=+278.327389831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-tls") pod "node-exporter-nprhm" (UID: "c454d9a2-e484-44ac-bf0f-4e1788ade819") : secret "node-exporter-tls" not found
Jul 08 22:51:42.803045 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.802869    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c454d9a2-e484-44ac-bf0f-4e1788ade819-metrics-client-ca\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.803045 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.802928    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-accelerators-collector-config\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.803045 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.802982    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-textfile\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.803045 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.803000    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.803412 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.803393    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-accelerators-collector-config\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.803539 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.803519    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c454d9a2-e484-44ac-bf0f-4e1788ade819-metrics-client-ca\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.805086 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.805070    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:42.810641 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:42.810618    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhx5v\" (UniqueName: \"kubernetes.io/projected/c454d9a2-e484-44ac-bf0f-4e1788ade819-kube-api-access-rhx5v\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:43.306828 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:43.306792    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-tls\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:43.308969 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:43.308952    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c454d9a2-e484-44ac-bf0f-4e1788ade819-node-exporter-tls\") pod \"node-exporter-nprhm\" (UID: \"c454d9a2-e484-44ac-bf0f-4e1788ade819\") " pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:43.532384 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:43.532346    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nprhm"
Jul 08 22:51:43.546250 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:51:43.546213    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc454d9a2_e484_44ac_bf0f_4e1788ade819.slice/crio-9a71058b9b1833ae592f76304d9958d41e17b6c65857190e94713696b228044c WatchSource:0}: Error finding container 9a71058b9b1833ae592f76304d9958d41e17b6c65857190e94713696b228044c: Status 404 returned error can't find the container with id 9a71058b9b1833ae592f76304d9958d41e17b6c65857190e94713696b228044c
Jul 08 22:51:44.513103 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:44.513058    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nprhm" event={"ID":"c454d9a2-e484-44ac-bf0f-4e1788ade819","Type":"ContainerStarted","Data":"9a71058b9b1833ae592f76304d9958d41e17b6c65857190e94713696b228044c"}
Jul 08 22:51:45.144395 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:45.144339    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gbz29" podUID="3285face-efa6-4a24-a733-7907738aba93"
Jul 08 22:51:45.517880 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:45.517792    2574 generic.go:356] "Generic (PLEG): container finished" podID="c454d9a2-e484-44ac-bf0f-4e1788ade819" containerID="4e70733efda9e76157f44210cd08c825388074daca3b1db5fe05048ba81f610d" exitCode=0
Jul 08 22:51:45.518328 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:45.517875    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nprhm" event={"ID":"c454d9a2-e484-44ac-bf0f-4e1788ade819","Type":"ContainerDied","Data":"4e70733efda9e76157f44210cd08c825388074daca3b1db5fe05048ba81f610d"}
Jul 08 22:51:45.518328 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:45.517923    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbz29"
Jul 08 22:51:46.523281 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:46.523246    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nprhm" event={"ID":"c454d9a2-e484-44ac-bf0f-4e1788ade819","Type":"ContainerStarted","Data":"a7b9e04686944267d459b3cdc4071fb5c37e9224a232113a2f145ca1fd354101"}
Jul 08 22:51:46.523647 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:46.523297    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nprhm" event={"ID":"c454d9a2-e484-44ac-bf0f-4e1788ade819","Type":"ContainerStarted","Data":"a961762937f7f4ba9bfe879ca947eb686912e47be4709785a29ca5d76863d14c"}
Jul 08 22:51:46.543662 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:46.543614    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nprhm" podStartSLOduration=3.417333821 podStartE2EDuration="4.543598669s" totalImagesPullingTime="1.062380235s" totalInitContainerRuntime="63.884613ms" isStatefulPod=true podCreationTimestamp="2026-07-08 22:51:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:46.542202694 +0000 UTC m=+281.566784698" watchObservedRunningTime="2026-07-08 22:51:46.543598669 +0000 UTC m=+281.568180672"
Jul 08 22:51:47.785486 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.785455    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"]
Jul 08 22:51:47.788699 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.788673    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.791226 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.791201    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 08 22:51:47.791331 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.791211    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 08 22:51:47.791530 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.791514    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 08 22:51:47.792325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.792302    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 08 22:51:47.792589 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.792574    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 08 22:51:47.793161 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.793131    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nslcd\""
Jul 08 22:51:47.800483 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.800458    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 08 22:51:47.801485 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.801460    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"]
Jul 08 22:51:47.842220 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.842181    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhsbd\" (UniqueName: \"kubernetes.io/projected/ad7a6e39-c232-41ba-9954-03f38ea49774-kube-api-access-hhsbd\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.842220 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.842223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad7a6e39-c232-41ba-9954-03f38ea49774-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.842476 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.842250    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad7a6e39-c232-41ba-9954-03f38ea49774-serving-certs-ca-bundle\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.842476 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.842353    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad7a6e39-c232-41ba-9954-03f38ea49774-secret-telemeter-client\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.842476 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.842391    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad7a6e39-c232-41ba-9954-03f38ea49774-telemeter-client-tls\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.842476 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.842421    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad7a6e39-c232-41ba-9954-03f38ea49774-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.842476 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.842472    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad7a6e39-c232-41ba-9954-03f38ea49774-metrics-client-ca\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.842662 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.842526    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad7a6e39-c232-41ba-9954-03f38ea49774-federate-client-tls\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.943270 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.943229    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhsbd\" (UniqueName: \"kubernetes.io/projected/ad7a6e39-c232-41ba-9954-03f38ea49774-kube-api-access-hhsbd\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.943418 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.943275    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad7a6e39-c232-41ba-9954-03f38ea49774-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.943418 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.943300    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad7a6e39-c232-41ba-9954-03f38ea49774-serving-certs-ca-bundle\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.943418 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.943349    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad7a6e39-c232-41ba-9954-03f38ea49774-secret-telemeter-client\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.943418 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.943374    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad7a6e39-c232-41ba-9954-03f38ea49774-telemeter-client-tls\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.943418 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.943401    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad7a6e39-c232-41ba-9954-03f38ea49774-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.943674 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.943445    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad7a6e39-c232-41ba-9954-03f38ea49774-metrics-client-ca\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.943674 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.943495    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad7a6e39-c232-41ba-9954-03f38ea49774-federate-client-tls\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.944312 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.944254    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad7a6e39-c232-41ba-9954-03f38ea49774-serving-certs-ca-bundle\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.944421 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.944321    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad7a6e39-c232-41ba-9954-03f38ea49774-metrics-client-ca\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.944421 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.944417    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad7a6e39-c232-41ba-9954-03f38ea49774-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.946128 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.946098    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad7a6e39-c232-41ba-9954-03f38ea49774-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.946208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.946165    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad7a6e39-c232-41ba-9954-03f38ea49774-telemeter-client-tls\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.946389 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.946373    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad7a6e39-c232-41ba-9954-03f38ea49774-federate-client-tls\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.946425 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.946414    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad7a6e39-c232-41ba-9954-03f38ea49774-secret-telemeter-client\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:47.950993 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:47.950970    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhsbd\" (UniqueName: \"kubernetes.io/projected/ad7a6e39-c232-41ba-9954-03f38ea49774-kube-api-access-hhsbd\") pod \"telemeter-client-7df9c7b9f7-qspdg\" (UID: \"ad7a6e39-c232-41ba-9954-03f38ea49774\") " pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:48.101591 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:48.101500    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"
Jul 08 22:51:48.230888 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:48.230858    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg"]
Jul 08 22:51:48.234154 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:51:48.234126    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad7a6e39_c232_41ba_9954_03f38ea49774.slice/crio-8b2cd3628dc8c4b8b1147f03a8d6403e30f9d009113bca84317e87935de8deae WatchSource:0}: Error finding container 8b2cd3628dc8c4b8b1147f03a8d6403e30f9d009113bca84317e87935de8deae: Status 404 returned error can't find the container with id 8b2cd3628dc8c4b8b1147f03a8d6403e30f9d009113bca84317e87935de8deae
Jul 08 22:51:48.530809 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:48.530763    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg" event={"ID":"ad7a6e39-c232-41ba-9954-03f38ea49774","Type":"ContainerStarted","Data":"8b2cd3628dc8c4b8b1147f03a8d6403e30f9d009113bca84317e87935de8deae"}
Jul 08 22:51:48.749749 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:48.749670    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:51:48.751957 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:48.751930    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3285face-efa6-4a24-a733-7907738aba93-metrics-tls\") pod \"dns-default-gbz29\" (UID: \"3285face-efa6-4a24-a733-7907738aba93\") " pod="openshift-dns/dns-default-gbz29"
Jul 08 22:51:48.821238 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:48.821159    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fbpb9\""
Jul 08 22:51:48.828701 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:48.828664    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbz29"
Jul 08 22:51:48.955423 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:48.955354    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gbz29"]
Jul 08 22:51:48.959020 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:51:48.958979    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3285face_efa6_4a24_a733_7907738aba93.slice/crio-b97df4aa7f9bc3308ca91cd2ea5c331bfe5a77daa8e71d29b19d4b67f26579ba WatchSource:0}: Error finding container b97df4aa7f9bc3308ca91cd2ea5c331bfe5a77daa8e71d29b19d4b67f26579ba: Status 404 returned error can't find the container with id b97df4aa7f9bc3308ca91cd2ea5c331bfe5a77daa8e71d29b19d4b67f26579ba
Jul 08 22:51:49.263597 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.263561    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cdf5fcd77-l7txh"]
Jul 08 22:51:49.270753 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.270727    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.273449 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.273425    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 22:51:49.273670 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.273474    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 22:51:49.273758 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.273727    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 22:51:49.275104 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.275082    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 22:51:49.275287 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.275273    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bh65l\""
Jul 08 22:51:49.275613 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.275508    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 22:51:49.275613 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.275551    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 22:51:49.275831 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.275814    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 22:51:49.279107 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.279052    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cdf5fcd77-l7txh"]
Jul 08 22:51:49.281212 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.281158    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 22:51:49.354240 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.354202    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-config\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.354428 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.354261    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-trusted-ca-bundle\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.354428 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.354290    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-serving-cert\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.354428 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.354343    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-service-ca\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.354428 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.354384    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-oauth-config\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.354428 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.354413    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krqb9\" (UniqueName: \"kubernetes.io/projected/6ab03a26-cac4-4dd2-8019-7843e56d28d9-kube-api-access-krqb9\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.354618 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.354442    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-oauth-serving-cert\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.455616 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.455575    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krqb9\" (UniqueName: \"kubernetes.io/projected/6ab03a26-cac4-4dd2-8019-7843e56d28d9-kube-api-access-krqb9\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.455616 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.455618    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-oauth-serving-cert\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.455844 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.455648    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-config\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.455844 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.455713    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-trusted-ca-bundle\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.455844 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.455756    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-serving-cert\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.455844 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.455780    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-service-ca\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.455844 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.455815    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-oauth-config\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.456519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.456496    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-config\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.456624 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.456525    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-oauth-serving-cert\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.456624 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.456537    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-trusted-ca-bundle\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.456624 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.456600    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-service-ca\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.458784 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.458757    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-serving-cert\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.458784 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.458771    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-oauth-config\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.464135 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.464088    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krqb9\" (UniqueName: \"kubernetes.io/projected/6ab03a26-cac4-4dd2-8019-7843e56d28d9-kube-api-access-krqb9\") pod \"console-7cdf5fcd77-l7txh\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") " pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.535464 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.535382    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbz29" event={"ID":"3285face-efa6-4a24-a733-7907738aba93","Type":"ContainerStarted","Data":"b97df4aa7f9bc3308ca91cd2ea5c331bfe5a77daa8e71d29b19d4b67f26579ba"}
Jul 08 22:51:49.583344 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.583307    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:49.758598 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:49.758550    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cdf5fcd77-l7txh"]
Jul 08 22:51:50.313144 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:51:50.313100    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab03a26_cac4_4dd2_8019_7843e56d28d9.slice/crio-d3668c4c32aab161f661ea6a00bc736af58f5660c83cef2a8125bdcd63380aba WatchSource:0}: Error finding container d3668c4c32aab161f661ea6a00bc736af58f5660c83cef2a8125bdcd63380aba: Status 404 returned error can't find the container with id d3668c4c32aab161f661ea6a00bc736af58f5660c83cef2a8125bdcd63380aba
Jul 08 22:51:50.539283 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:50.539251    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdf5fcd77-l7txh" event={"ID":"6ab03a26-cac4-4dd2-8019-7843e56d28d9","Type":"ContainerStarted","Data":"d3668c4c32aab161f661ea6a00bc736af58f5660c83cef2a8125bdcd63380aba"}
Jul 08 22:51:51.544322 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:51.544278    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg" event={"ID":"ad7a6e39-c232-41ba-9954-03f38ea49774","Type":"ContainerStarted","Data":"8503ff06923d18828fa695169ca0eef48975122bafc8e51b21d58ae56e815428"}
Jul 08 22:51:52.550489 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:52.550390    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbz29" event={"ID":"3285face-efa6-4a24-a733-7907738aba93","Type":"ContainerStarted","Data":"990d96b92d1a2b3e31027427341ebe009f28523b0ffc5d64c8af545c4fbe5e22"}
Jul 08 22:51:52.550489 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:52.550459    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbz29" event={"ID":"3285face-efa6-4a24-a733-7907738aba93","Type":"ContainerStarted","Data":"873d2073b1c6ddb79881625ee575d296af838552cd67097b8100e7d14ed52a6c"}
Jul 08 22:51:52.550489 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:52.550482    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gbz29"
Jul 08 22:51:52.552856 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:52.552823    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg" event={"ID":"ad7a6e39-c232-41ba-9954-03f38ea49774","Type":"ContainerStarted","Data":"731da5152d981b9c8af99d53b362f099a47af76ff8fe05eafd1c3a8d5dc79fa3"}
Jul 08 22:51:52.552989 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:52.552881    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg" event={"ID":"ad7a6e39-c232-41ba-9954-03f38ea49774","Type":"ContainerStarted","Data":"33c4daacf9adb3a0acce42631df2c1070e587e5dde741d03f549ee6ece6c31cd"}
Jul 08 22:51:52.567826 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:52.567780    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gbz29" podStartSLOduration=252.107517786 podStartE2EDuration="4m14.567764934s" totalImagesPullingTime="2.460247148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:52.566668472 +0000 UTC m=+287.591250476" watchObservedRunningTime="2026-07-08 22:51:52.567764934 +0000 UTC m=+287.592346938"
Jul 08 22:51:52.588480 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:52.588416    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7df9c7b9f7-qspdg" podStartSLOduration=1.64291188 podStartE2EDuration="5.588395838s" totalImagesPullingTime="3.945483958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:51:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:52.587074945 +0000 UTC m=+287.611656949" watchObservedRunningTime="2026-07-08 22:51:52.588395838 +0000 UTC m=+287.612977843"
Jul 08 22:51:54.562020 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:54.561987    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdf5fcd77-l7txh" event={"ID":"6ab03a26-cac4-4dd2-8019-7843e56d28d9","Type":"ContainerStarted","Data":"23b3632f7c4ad6b787c525a75c0cf060e98bc8bb867a681e2e7181b6bbdb8985"}
Jul 08 22:51:54.580153 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:54.580100    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cdf5fcd77-l7txh" podStartSLOduration=2.262843503 podStartE2EDuration="5.580083598s" totalImagesPullingTime="3.317240095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:54.579664488 +0000 UTC m=+289.604246494" watchObservedRunningTime="2026-07-08 22:51:54.580083598 +0000 UTC m=+289.604665602"
Jul 08 22:51:57.475386 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.475348    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8c99cf7d6-dk9cs"]
Jul 08 22:51:57.477670 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.477651    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.488343 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.488317    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8c99cf7d6-dk9cs"]
Jul 08 22:51:57.514942 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.514908    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5677c78758-5qjft"
Jul 08 22:51:57.523574 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.523543    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-trusted-ca-bundle\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.523776 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.523583    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-service-ca\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.523776 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.523611    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9hqq\" (UniqueName: \"kubernetes.io/projected/b625cfba-1721-4da1-b032-171f5973ed1b-kube-api-access-c9hqq\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.523776 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.523634    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-oauth-serving-cert\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.523776 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.523746    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b625cfba-1721-4da1-b032-171f5973ed1b-console-oauth-config\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.524016 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.523778    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-console-config\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.524016 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.523833    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b625cfba-1721-4da1-b032-171f5973ed1b-console-serving-cert\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.624318 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.624281    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b625cfba-1721-4da1-b032-171f5973ed1b-console-oauth-config\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.624318 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.624322    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-console-config\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.624605 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.624376    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b625cfba-1721-4da1-b032-171f5973ed1b-console-serving-cert\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.624605 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.624423    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-trusted-ca-bundle\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.624605 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.624459    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-service-ca\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.624605 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.624578    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9hqq\" (UniqueName: \"kubernetes.io/projected/b625cfba-1721-4da1-b032-171f5973ed1b-kube-api-access-c9hqq\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.624837 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.624612    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-oauth-serving-cert\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.625192 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.625160    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-console-config\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.625318 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.625303    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-oauth-serving-cert\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.625409 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.625390    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-service-ca\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.626080 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.626056    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-trusted-ca-bundle\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.626973 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.626949    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b625cfba-1721-4da1-b032-171f5973ed1b-console-serving-cert\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.627088 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.627072    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b625cfba-1721-4da1-b032-171f5973ed1b-console-oauth-config\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.633454 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.633431    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9hqq\" (UniqueName: \"kubernetes.io/projected/b625cfba-1721-4da1-b032-171f5973ed1b-kube-api-access-c9hqq\") pod \"console-8c99cf7d6-dk9cs\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") " pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.786373 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.786281    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:51:57.910771 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:57.910732    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8c99cf7d6-dk9cs"]
Jul 08 22:51:57.913482 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:51:57.913455    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb625cfba_1721_4da1_b032_171f5973ed1b.slice/crio-6cbd15a771f9229a9d7f16be6db1914ec3ea3ddaf08dff7e3605c40abbfe1c65 WatchSource:0}: Error finding container 6cbd15a771f9229a9d7f16be6db1914ec3ea3ddaf08dff7e3605c40abbfe1c65: Status 404 returned error can't find the container with id 6cbd15a771f9229a9d7f16be6db1914ec3ea3ddaf08dff7e3605c40abbfe1c65
Jul 08 22:51:58.576696 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:58.576646    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c99cf7d6-dk9cs" event={"ID":"b625cfba-1721-4da1-b032-171f5973ed1b","Type":"ContainerStarted","Data":"dc1a5387d571ab52d0f22c153b7a51bbebc59af30d5b44d5899e60a9340078a9"}
Jul 08 22:51:58.577059 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:58.576713    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c99cf7d6-dk9cs" event={"ID":"b625cfba-1721-4da1-b032-171f5973ed1b","Type":"ContainerStarted","Data":"6cbd15a771f9229a9d7f16be6db1914ec3ea3ddaf08dff7e3605c40abbfe1c65"}
Jul 08 22:51:58.594097 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:58.594051    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8c99cf7d6-dk9cs" podStartSLOduration=1.594034529 podStartE2EDuration="1.594034529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:51:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:58.592607323 +0000 UTC m=+293.617189328" watchObservedRunningTime="2026-07-08 22:51:58.594034529 +0000 UTC m=+293.618616533"
Jul 08 22:51:59.497838 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:51:59.497793    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8kgb8" podUID="b3eb825e-1dd9-461e-86b2-9fad2fade7e4"
Jul 08 22:51:59.583761 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:59.583730    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:59.584114 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:59.583780    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:51:59.588433 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:51:59.588409    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:52:00.587534 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:00.587508    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:52:02.560221 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:02.560192    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gbz29"
Jul 08 22:52:05.350333 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:05.350305    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 22:52:05.350998 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:05.350980    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 22:52:05.358339 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:05.358315    2574 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 22:52:07.786603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:07.786548    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:52:07.786603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:07.786625    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:52:07.791342 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:07.791322    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:52:08.616521 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:08.616494    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:52:08.658601 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:08.658569    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cdf5fcd77-l7txh"]
Jul 08 22:52:12.496752 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:12.496712    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:52:27.658121 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:27.658080    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg" podUID="82d32c44-929e-4096-806d-06f274bd9804" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 22:52:33.679297 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:33.679256    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7cdf5fcd77-l7txh" podUID="6ab03a26-cac4-4dd2-8019-7843e56d28d9" containerName="console" containerID="cri-o://23b3632f7c4ad6b787c525a75c0cf060e98bc8bb867a681e2e7181b6bbdb8985" gracePeriod=15
Jul 08 22:52:33.929035 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:33.929011    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:52:33.939633 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:33.939576    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krqb9\" (UniqueName: \"kubernetes.io/projected/6ab03a26-cac4-4dd2-8019-7843e56d28d9-kube-api-access-krqb9\") pod \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") "
Jul 08 22:52:33.939633 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:33.939623    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-oauth-config\") pod \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") "
Jul 08 22:52:33.939794 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:33.939697    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-config\") pod \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") "
Jul 08 22:52:33.939794 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:33.939739    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-trusted-ca-bundle\") pod \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") "
Jul 08 22:52:33.939794 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:33.939771    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-serving-cert\") pod \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") "
Jul 08 22:52:33.940147 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:33.939805    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-oauth-serving-cert\") pod \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") "
Jul 08 22:52:33.940147 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:33.939864    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-service-ca\") pod \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\" (UID: \"6ab03a26-cac4-4dd2-8019-7843e56d28d9\") "
Jul 08 22:52:33.940147 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:33.940136    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-config" (OuterVolumeSpecName: "console-config") pod "6ab03a26-cac4-4dd2-8019-7843e56d28d9" (UID: "6ab03a26-cac4-4dd2-8019-7843e56d28d9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:52:33.940332 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:33.940298    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6ab03a26-cac4-4dd2-8019-7843e56d28d9" (UID: "6ab03a26-cac4-4dd2-8019-7843e56d28d9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:52:33.940390 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:33.940324    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6ab03a26-cac4-4dd2-8019-7843e56d28d9" (UID: "6ab03a26-cac4-4dd2-8019-7843e56d28d9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:52:33.940445 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:33.940405    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-service-ca" (OuterVolumeSpecName: "service-ca") pod "6ab03a26-cac4-4dd2-8019-7843e56d28d9" (UID: "6ab03a26-cac4-4dd2-8019-7843e56d28d9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:52:33.941920 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:33.941899    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ab03a26-cac4-4dd2-8019-7843e56d28d9-kube-api-access-krqb9" (OuterVolumeSpecName: "kube-api-access-krqb9") pod "6ab03a26-cac4-4dd2-8019-7843e56d28d9" (UID: "6ab03a26-cac4-4dd2-8019-7843e56d28d9"). InnerVolumeSpecName "kube-api-access-krqb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:52:33.942011 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:33.941903    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6ab03a26-cac4-4dd2-8019-7843e56d28d9" (UID: "6ab03a26-cac4-4dd2-8019-7843e56d28d9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:52:33.942011 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:33.941988    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6ab03a26-cac4-4dd2-8019-7843e56d28d9" (UID: "6ab03a26-cac4-4dd2-8019-7843e56d28d9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:52:34.040976 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:34.040938    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krqb9\" (UniqueName: \"kubernetes.io/projected/6ab03a26-cac4-4dd2-8019-7843e56d28d9-kube-api-access-krqb9\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:52:34.040976 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:34.040967    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-oauth-config\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:52:34.040976 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:34.040978    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-config\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:52:34.040976 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:34.040986    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-trusted-ca-bundle\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:52:34.041241 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:34.040995    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab03a26-cac4-4dd2-8019-7843e56d28d9-console-serving-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:52:34.041241 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:34.041003    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-oauth-serving-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:52:34.041241 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:34.041013    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab03a26-cac4-4dd2-8019-7843e56d28d9-service-ca\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:52:34.701814 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:34.701781    2574 generic.go:356] "Generic (PLEG): container finished" podID="6ab03a26-cac4-4dd2-8019-7843e56d28d9" containerID="23b3632f7c4ad6b787c525a75c0cf060e98bc8bb867a681e2e7181b6bbdb8985" exitCode=0
Jul 08 22:52:34.702227 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:34.701831    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdf5fcd77-l7txh"
Jul 08 22:52:34.702227 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:34.701855    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdf5fcd77-l7txh" event={"ID":"6ab03a26-cac4-4dd2-8019-7843e56d28d9","Type":"ContainerDied","Data":"23b3632f7c4ad6b787c525a75c0cf060e98bc8bb867a681e2e7181b6bbdb8985"}
Jul 08 22:52:34.702227 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:34.701896    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdf5fcd77-l7txh" event={"ID":"6ab03a26-cac4-4dd2-8019-7843e56d28d9","Type":"ContainerDied","Data":"d3668c4c32aab161f661ea6a00bc736af58f5660c83cef2a8125bdcd63380aba"}
Jul 08 22:52:34.702227 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:34.701919    2574 scope.go:117] "RemoveContainer" containerID="23b3632f7c4ad6b787c525a75c0cf060e98bc8bb867a681e2e7181b6bbdb8985"
Jul 08 22:52:34.710657 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:34.710640    2574 scope.go:117] "RemoveContainer" containerID="23b3632f7c4ad6b787c525a75c0cf060e98bc8bb867a681e2e7181b6bbdb8985"
Jul 08 22:52:34.710968 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:52:34.710924    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23b3632f7c4ad6b787c525a75c0cf060e98bc8bb867a681e2e7181b6bbdb8985\": container with ID starting with 23b3632f7c4ad6b787c525a75c0cf060e98bc8bb867a681e2e7181b6bbdb8985 not found: ID does not exist" containerID="23b3632f7c4ad6b787c525a75c0cf060e98bc8bb867a681e2e7181b6bbdb8985"
Jul 08 22:52:34.711089 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:34.710975    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23b3632f7c4ad6b787c525a75c0cf060e98bc8bb867a681e2e7181b6bbdb8985"} err="failed to get container status \"23b3632f7c4ad6b787c525a75c0cf060e98bc8bb867a681e2e7181b6bbdb8985\": rpc error: code = NotFound desc = could not find container \"23b3632f7c4ad6b787c525a75c0cf060e98bc8bb867a681e2e7181b6bbdb8985\": container with ID starting with 23b3632f7c4ad6b787c525a75c0cf060e98bc8bb867a681e2e7181b6bbdb8985 not found: ID does not exist"
Jul 08 22:52:34.721945 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:34.721918    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cdf5fcd77-l7txh"]
Jul 08 22:52:34.725018 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:34.724994    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cdf5fcd77-l7txh"]
Jul 08 22:52:35.504302 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:35.501992    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ab03a26-cac4-4dd2-8019-7843e56d28d9" path="/var/lib/kubelet/pods/6ab03a26-cac4-4dd2-8019-7843e56d28d9/volumes"
Jul 08 22:52:37.657260 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:37.657222    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg" podUID="82d32c44-929e-4096-806d-06f274bd9804" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 22:52:47.658356 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:47.658312    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg" podUID="82d32c44-929e-4096-806d-06f274bd9804" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 22:52:47.658843 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:47.658394    2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg"
Jul 08 22:52:47.658914 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:47.658899    2574 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"07de0c743206e672be3d050504fbcedad0c3bdf34f0e2ff1e7df24653cb0a9bb"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 08 22:52:47.658957 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:47.658937    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg" podUID="82d32c44-929e-4096-806d-06f274bd9804" containerName="service-proxy" containerID="cri-o://07de0c743206e672be3d050504fbcedad0c3bdf34f0e2ff1e7df24653cb0a9bb" gracePeriod=30
Jul 08 22:52:48.750551 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:48.750517    2574 generic.go:356] "Generic (PLEG): container finished" podID="82d32c44-929e-4096-806d-06f274bd9804" containerID="07de0c743206e672be3d050504fbcedad0c3bdf34f0e2ff1e7df24653cb0a9bb" exitCode=2
Jul 08 22:52:48.750946 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:48.750584    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg" event={"ID":"82d32c44-929e-4096-806d-06f274bd9804","Type":"ContainerDied","Data":"07de0c743206e672be3d050504fbcedad0c3bdf34f0e2ff1e7df24653cb0a9bb"}
Jul 08 22:52:48.750946 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:52:48.750634    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64bff54ddc-v59rg" event={"ID":"82d32c44-929e-4096-806d-06f274bd9804","Type":"ContainerStarted","Data":"b9ada36e90f6d75654cd2085f001683e2271e4aaa4dd39684a28030867c44e25"}
Jul 08 22:53:16.956291 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:16.956254    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54f97757c-8hs8n"]
Jul 08 22:53:16.956741 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:16.956496    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ab03a26-cac4-4dd2-8019-7843e56d28d9" containerName="console"
Jul 08 22:53:16.956741 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:16.956506    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ab03a26-cac4-4dd2-8019-7843e56d28d9" containerName="console"
Jul 08 22:53:16.956741 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:16.956548    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ab03a26-cac4-4dd2-8019-7843e56d28d9" containerName="console"
Jul 08 22:53:16.960675 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:16.960656    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:16.971784 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:16.971762    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f97757c-8hs8n"]
Jul 08 22:53:17.091603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.091560    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-oauth-serving-cert\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.091603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.091616    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-service-ca\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.091853 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.091738    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhx27\" (UniqueName: \"kubernetes.io/projected/e942544a-7447-4197-9b90-19058017cc79-kube-api-access-vhx27\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.091853 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.091764    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-trusted-ca-bundle\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.091853 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.091786    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e942544a-7447-4197-9b90-19058017cc79-console-serving-cert\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.091853 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.091809    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e942544a-7447-4197-9b90-19058017cc79-console-oauth-config\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.091853 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.091836    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-console-config\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.192387 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.192345    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-oauth-serving-cert\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.192550 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.192404    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-service-ca\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.192550 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.192458    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhx27\" (UniqueName: \"kubernetes.io/projected/e942544a-7447-4197-9b90-19058017cc79-kube-api-access-vhx27\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.192550 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.192482    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-trusted-ca-bundle\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.192736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.192605    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e942544a-7447-4197-9b90-19058017cc79-console-serving-cert\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.192736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.192644    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e942544a-7447-4197-9b90-19058017cc79-console-oauth-config\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.192736 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.192674    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-console-config\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.193235 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.193208    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-service-ca\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.193349 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.193208    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-oauth-serving-cert\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.193349 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.193297    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-trusted-ca-bundle\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.193349 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.193341    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-console-config\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.195058 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.195032    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e942544a-7447-4197-9b90-19058017cc79-console-serving-cert\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.195137 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.195071    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e942544a-7447-4197-9b90-19058017cc79-console-oauth-config\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.200219 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.200202    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhx27\" (UniqueName: \"kubernetes.io/projected/e942544a-7447-4197-9b90-19058017cc79-kube-api-access-vhx27\") pod \"console-54f97757c-8hs8n\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") " pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.269337 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.269242    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:17.396041 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.396006    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f97757c-8hs8n"]
Jul 08 22:53:17.398388 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:53:17.398359    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode942544a_7447_4197_9b90_19058017cc79.slice/crio-fab62642a156510af39dd450c1356403febd883614ed306a9203d8dd9424ff72 WatchSource:0}: Error finding container fab62642a156510af39dd450c1356403febd883614ed306a9203d8dd9424ff72: Status 404 returned error can't find the container with id fab62642a156510af39dd450c1356403febd883614ed306a9203d8dd9424ff72
Jul 08 22:53:17.843531 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.843495    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f97757c-8hs8n" event={"ID":"e942544a-7447-4197-9b90-19058017cc79","Type":"ContainerStarted","Data":"4b715330e7a1b6a5f7c035b9301d657201e76b419e15a331925e8e7f17ecfe36"}
Jul 08 22:53:17.843746 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.843543    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f97757c-8hs8n" event={"ID":"e942544a-7447-4197-9b90-19058017cc79","Type":"ContainerStarted","Data":"fab62642a156510af39dd450c1356403febd883614ed306a9203d8dd9424ff72"}
Jul 08 22:53:17.862251 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:17.862201    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54f97757c-8hs8n" podStartSLOduration=1.8621844520000002 podStartE2EDuration="1.862184452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:53:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:53:17.860331776 +0000 UTC m=+372.884913780" watchObservedRunningTime="2026-07-08 22:53:17.862184452 +0000 UTC m=+372.886766455"
Jul 08 22:53:18.403112 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:18.403068    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs\") pod \"network-metrics-daemon-8kgb8\" (UID: \"b3eb825e-1dd9-461e-86b2-9fad2fade7e4\") " pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:53:18.405304 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:18.405284    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eb825e-1dd9-461e-86b2-9fad2fade7e4-metrics-certs\") pod \"network-metrics-daemon-8kgb8\" (UID: \"b3eb825e-1dd9-461e-86b2-9fad2fade7e4\") " pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:53:18.500407 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:18.500378    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-48cc2\""
Jul 08 22:53:18.507716 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:18.507697    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8kgb8"
Jul 08 22:53:18.632196 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:18.632164    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8kgb8"]
Jul 08 22:53:18.636459 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:53:18.636429    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3eb825e_1dd9_461e_86b2_9fad2fade7e4.slice/crio-1ed8aa359e8a7b3b3f5aa9b77110e78bfc85db574cf288c840ca536b97794867 WatchSource:0}: Error finding container 1ed8aa359e8a7b3b3f5aa9b77110e78bfc85db574cf288c840ca536b97794867: Status 404 returned error can't find the container with id 1ed8aa359e8a7b3b3f5aa9b77110e78bfc85db574cf288c840ca536b97794867
Jul 08 22:53:18.638427 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:18.638412    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 22:53:18.848110 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:18.848025    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8kgb8" event={"ID":"b3eb825e-1dd9-461e-86b2-9fad2fade7e4","Type":"ContainerStarted","Data":"1ed8aa359e8a7b3b3f5aa9b77110e78bfc85db574cf288c840ca536b97794867"}
Jul 08 22:53:20.855754 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:20.855714    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8kgb8" event={"ID":"b3eb825e-1dd9-461e-86b2-9fad2fade7e4","Type":"ContainerStarted","Data":"ef38425b1693781ea1054d49c5f401aba8b00e986cc9be543bec3698765c6b4d"}
Jul 08 22:53:20.856162 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:20.855777    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8kgb8" event={"ID":"b3eb825e-1dd9-461e-86b2-9fad2fade7e4","Type":"ContainerStarted","Data":"4a91fea4f3e79fe10f3bcd2cc85a064b2feb0898a5cfec0399d6b9479fdf00f7"}
Jul 08 22:53:20.874167 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:20.874115    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8kgb8" podStartSLOduration=374.645649239 podStartE2EDuration="6m15.874100475s" totalImagesPullingTime="1.228451236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:53:20.873652845 +0000 UTC m=+375.898234851" watchObservedRunningTime="2026-07-08 22:53:20.874100475 +0000 UTC m=+375.898682477"
Jul 08 22:53:27.269430 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:27.269391    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:27.269850 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:27.269454    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:27.274244 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:27.274223    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:27.884774 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:27.884743    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:53:27.926471 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:27.926434    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8c99cf7d6-dk9cs"]
Jul 08 22:53:52.952359 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:52.952314    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8c99cf7d6-dk9cs" podUID="b625cfba-1721-4da1-b032-171f5973ed1b" containerName="console" containerID="cri-o://dc1a5387d571ab52d0f22c153b7a51bbebc59af30d5b44d5899e60a9340078a9" gracePeriod=15
Jul 08 22:53:53.204928 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.204876    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:53:53.263044 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.263009    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-trusted-ca-bundle\") pod \"b625cfba-1721-4da1-b032-171f5973ed1b\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") "
Jul 08 22:53:53.263044 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.263045    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-service-ca\") pod \"b625cfba-1721-4da1-b032-171f5973ed1b\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") "
Jul 08 22:53:53.263261 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.263099    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9hqq\" (UniqueName: \"kubernetes.io/projected/b625cfba-1721-4da1-b032-171f5973ed1b-kube-api-access-c9hqq\") pod \"b625cfba-1721-4da1-b032-171f5973ed1b\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") "
Jul 08 22:53:53.263261 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.263136    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-oauth-serving-cert\") pod \"b625cfba-1721-4da1-b032-171f5973ed1b\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") "
Jul 08 22:53:53.263261 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.263157    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b625cfba-1721-4da1-b032-171f5973ed1b-console-serving-cert\") pod \"b625cfba-1721-4da1-b032-171f5973ed1b\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") "
Jul 08 22:53:53.263261 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.263187    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-console-config\") pod \"b625cfba-1721-4da1-b032-171f5973ed1b\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") "
Jul 08 22:53:53.263261 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.263229    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b625cfba-1721-4da1-b032-171f5973ed1b-console-oauth-config\") pod \"b625cfba-1721-4da1-b032-171f5973ed1b\" (UID: \"b625cfba-1721-4da1-b032-171f5973ed1b\") "
Jul 08 22:53:53.263679 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.263569    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b625cfba-1721-4da1-b032-171f5973ed1b" (UID: "b625cfba-1721-4da1-b032-171f5973ed1b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:53:53.263679 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.263588    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-service-ca" (OuterVolumeSpecName: "service-ca") pod "b625cfba-1721-4da1-b032-171f5973ed1b" (UID: "b625cfba-1721-4da1-b032-171f5973ed1b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:53:53.263822 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.263713    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-console-config" (OuterVolumeSpecName: "console-config") pod "b625cfba-1721-4da1-b032-171f5973ed1b" (UID: "b625cfba-1721-4da1-b032-171f5973ed1b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:53:53.263822 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.263747    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b625cfba-1721-4da1-b032-171f5973ed1b" (UID: "b625cfba-1721-4da1-b032-171f5973ed1b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:53:53.265395 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.265362    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b625cfba-1721-4da1-b032-171f5973ed1b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b625cfba-1721-4da1-b032-171f5973ed1b" (UID: "b625cfba-1721-4da1-b032-171f5973ed1b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:53:53.265473 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.265393    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b625cfba-1721-4da1-b032-171f5973ed1b-kube-api-access-c9hqq" (OuterVolumeSpecName: "kube-api-access-c9hqq") pod "b625cfba-1721-4da1-b032-171f5973ed1b" (UID: "b625cfba-1721-4da1-b032-171f5973ed1b"). InnerVolumeSpecName "kube-api-access-c9hqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:53:53.265513 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.265463    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b625cfba-1721-4da1-b032-171f5973ed1b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b625cfba-1721-4da1-b032-171f5973ed1b" (UID: "b625cfba-1721-4da1-b032-171f5973ed1b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:53:53.363956 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.363924    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-trusted-ca-bundle\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:53:53.363956 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.363951    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-service-ca\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:53:53.363956 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.363961    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9hqq\" (UniqueName: \"kubernetes.io/projected/b625cfba-1721-4da1-b032-171f5973ed1b-kube-api-access-c9hqq\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:53:53.364171 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.363971    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-oauth-serving-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:53:53.364171 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.363981    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b625cfba-1721-4da1-b032-171f5973ed1b-console-serving-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:53:53.364171 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.363988    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b625cfba-1721-4da1-b032-171f5973ed1b-console-config\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:53:53.364171 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.363996    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b625cfba-1721-4da1-b032-171f5973ed1b-console-oauth-config\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:53:53.968395 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.968360    2574 generic.go:356] "Generic (PLEG): container finished" podID="b625cfba-1721-4da1-b032-171f5973ed1b" containerID="dc1a5387d571ab52d0f22c153b7a51bbebc59af30d5b44d5899e60a9340078a9" exitCode=0
Jul 08 22:53:53.968815 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.968415    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c99cf7d6-dk9cs"
Jul 08 22:53:53.968815 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.968445    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c99cf7d6-dk9cs" event={"ID":"b625cfba-1721-4da1-b032-171f5973ed1b","Type":"ContainerDied","Data":"dc1a5387d571ab52d0f22c153b7a51bbebc59af30d5b44d5899e60a9340078a9"}
Jul 08 22:53:53.968815 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.968517    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c99cf7d6-dk9cs" event={"ID":"b625cfba-1721-4da1-b032-171f5973ed1b","Type":"ContainerDied","Data":"6cbd15a771f9229a9d7f16be6db1914ec3ea3ddaf08dff7e3605c40abbfe1c65"}
Jul 08 22:53:53.968815 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.968538    2574 scope.go:117] "RemoveContainer" containerID="dc1a5387d571ab52d0f22c153b7a51bbebc59af30d5b44d5899e60a9340078a9"
Jul 08 22:53:53.976796 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.976780    2574 scope.go:117] "RemoveContainer" containerID="dc1a5387d571ab52d0f22c153b7a51bbebc59af30d5b44d5899e60a9340078a9"
Jul 08 22:53:53.977066 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:53:53.977048    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc1a5387d571ab52d0f22c153b7a51bbebc59af30d5b44d5899e60a9340078a9\": container with ID starting with dc1a5387d571ab52d0f22c153b7a51bbebc59af30d5b44d5899e60a9340078a9 not found: ID does not exist" containerID="dc1a5387d571ab52d0f22c153b7a51bbebc59af30d5b44d5899e60a9340078a9"
Jul 08 22:53:53.977116 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.977079    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc1a5387d571ab52d0f22c153b7a51bbebc59af30d5b44d5899e60a9340078a9"} err="failed to get container status \"dc1a5387d571ab52d0f22c153b7a51bbebc59af30d5b44d5899e60a9340078a9\": rpc error: code = NotFound desc = could not find container \"dc1a5387d571ab52d0f22c153b7a51bbebc59af30d5b44d5899e60a9340078a9\": container with ID starting with dc1a5387d571ab52d0f22c153b7a51bbebc59af30d5b44d5899e60a9340078a9 not found: ID does not exist"
Jul 08 22:53:53.984065 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.984038    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8c99cf7d6-dk9cs"]
Jul 08 22:53:53.987132 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:53.987109    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8c99cf7d6-dk9cs"]
Jul 08 22:53:55.500988 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:53:55.500957    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b625cfba-1721-4da1-b032-171f5973ed1b" path="/var/lib/kubelet/pods/b625cfba-1721-4da1-b032-171f5973ed1b/volumes"
Jul 08 22:54:15.501814 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.501786    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54"]
Jul 08 22:54:15.502174 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.501993    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b625cfba-1721-4da1-b032-171f5973ed1b" containerName="console"
Jul 08 22:54:15.502174 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.502002    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b625cfba-1721-4da1-b032-171f5973ed1b" containerName="console"
Jul 08 22:54:15.502174 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.502053    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b625cfba-1721-4da1-b032-171f5973ed1b" containerName="console"
Jul 08 22:54:15.507832 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.507806    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54"
Jul 08 22:54:15.510947 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.510921    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 22:54:15.512155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.512129    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 22:54:15.512278 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.512214    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9sqd6\""
Jul 08 22:54:15.515497 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.515384    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54"]
Jul 08 22:54:15.631380 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.631341    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54\" (UID: \"7f2360ec-7020-4ad9-8e69-6d12ad02a47e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54"
Jul 08 22:54:15.631548 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.631406    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qp4h\" (UniqueName: \"kubernetes.io/projected/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-kube-api-access-8qp4h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54\" (UID: \"7f2360ec-7020-4ad9-8e69-6d12ad02a47e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54"
Jul 08 22:54:15.631548 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.631432    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54\" (UID: \"7f2360ec-7020-4ad9-8e69-6d12ad02a47e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54"
Jul 08 22:54:15.732836 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.732798    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qp4h\" (UniqueName: \"kubernetes.io/projected/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-kube-api-access-8qp4h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54\" (UID: \"7f2360ec-7020-4ad9-8e69-6d12ad02a47e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54"
Jul 08 22:54:15.733012 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.732845    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54\" (UID: \"7f2360ec-7020-4ad9-8e69-6d12ad02a47e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54"
Jul 08 22:54:15.733012 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.732897    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54\" (UID: \"7f2360ec-7020-4ad9-8e69-6d12ad02a47e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54"
Jul 08 22:54:15.733256 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.733237    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54\" (UID: \"7f2360ec-7020-4ad9-8e69-6d12ad02a47e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54"
Jul 08 22:54:15.733328 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.733264    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54\" (UID: \"7f2360ec-7020-4ad9-8e69-6d12ad02a47e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54"
Jul 08 22:54:15.740558 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.740535    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qp4h\" (UniqueName: \"kubernetes.io/projected/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-kube-api-access-8qp4h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54\" (UID: \"7f2360ec-7020-4ad9-8e69-6d12ad02a47e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54"
Jul 08 22:54:15.818828 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.818725    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54"
Jul 08 22:54:15.947208 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:15.947175    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54"]
Jul 08 22:54:15.951012 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:54:15.950984    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f2360ec_7020_4ad9_8e69_6d12ad02a47e.slice/crio-cfc4f8bdc66d45a801ae1552bd085cfffc4ce4ef72b79472bf6433461011d81f WatchSource:0}: Error finding container cfc4f8bdc66d45a801ae1552bd085cfffc4ce4ef72b79472bf6433461011d81f: Status 404 returned error can't find the container with id cfc4f8bdc66d45a801ae1552bd085cfffc4ce4ef72b79472bf6433461011d81f
Jul 08 22:54:16.046200 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:16.046167    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54" event={"ID":"7f2360ec-7020-4ad9-8e69-6d12ad02a47e","Type":"ContainerStarted","Data":"cfc4f8bdc66d45a801ae1552bd085cfffc4ce4ef72b79472bf6433461011d81f"}
Jul 08 22:54:22.069864 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:22.069778    2574 generic.go:356] "Generic (PLEG): container finished" podID="7f2360ec-7020-4ad9-8e69-6d12ad02a47e" containerID="58ca3f20ba0e75189da2bd5dacdc94d267d786006992272e69e300a087acb60a" exitCode=0
Jul 08 22:54:22.069864 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:22.069818    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54" event={"ID":"7f2360ec-7020-4ad9-8e69-6d12ad02a47e","Type":"ContainerDied","Data":"58ca3f20ba0e75189da2bd5dacdc94d267d786006992272e69e300a087acb60a"}
Jul 08 22:54:25.082428 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:25.082393    2574 generic.go:356] "Generic (PLEG): container finished" podID="7f2360ec-7020-4ad9-8e69-6d12ad02a47e" containerID="192431089e6dd22dae30e322cd6a5555bbaeaea7024a190499a1bfd7c4ac462b" exitCode=0
Jul 08 22:54:25.082877 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:25.082479    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54" event={"ID":"7f2360ec-7020-4ad9-8e69-6d12ad02a47e","Type":"ContainerDied","Data":"192431089e6dd22dae30e322cd6a5555bbaeaea7024a190499a1bfd7c4ac462b"}
Jul 08 22:54:31.109839 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:31.109804    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54" event={"ID":"7f2360ec-7020-4ad9-8e69-6d12ad02a47e","Type":"ContainerStarted","Data":"57ddce9e5cbf38663cab03ed09a2b0422a294a243f9ab23cc072bd0e7330c06d"}
Jul 08 22:54:31.128233 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:31.128182    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54" podStartSLOduration=2.232686137 podStartE2EDuration="16.128165814s" totalImagesPullingTime="13.895479677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:54:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:54:31.126785795 +0000 UTC m=+446.151367798" watchObservedRunningTime="2026-07-08 22:54:31.128165814 +0000 UTC m=+446.152747816"
Jul 08 22:54:32.114916 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:32.114877    2574 generic.go:356] "Generic (PLEG): container finished" podID="7f2360ec-7020-4ad9-8e69-6d12ad02a47e" containerID="57ddce9e5cbf38663cab03ed09a2b0422a294a243f9ab23cc072bd0e7330c06d" exitCode=0
Jul 08 22:54:32.115285 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:32.114924    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54" event={"ID":"7f2360ec-7020-4ad9-8e69-6d12ad02a47e","Type":"ContainerDied","Data":"57ddce9e5cbf38663cab03ed09a2b0422a294a243f9ab23cc072bd0e7330c06d"}
Jul 08 22:54:33.238343 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:33.238316    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54"
Jul 08 22:54:33.287704 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:33.287663    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-util\") pod \"7f2360ec-7020-4ad9-8e69-6d12ad02a47e\" (UID: \"7f2360ec-7020-4ad9-8e69-6d12ad02a47e\") "
Jul 08 22:54:33.287855 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:33.287745    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-bundle\") pod \"7f2360ec-7020-4ad9-8e69-6d12ad02a47e\" (UID: \"7f2360ec-7020-4ad9-8e69-6d12ad02a47e\") "
Jul 08 22:54:33.287855 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:33.287791    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qp4h\" (UniqueName: \"kubernetes.io/projected/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-kube-api-access-8qp4h\") pod \"7f2360ec-7020-4ad9-8e69-6d12ad02a47e\" (UID: \"7f2360ec-7020-4ad9-8e69-6d12ad02a47e\") "
Jul 08 22:54:33.288148 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:33.288123    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-bundle" (OuterVolumeSpecName: "bundle") pod "7f2360ec-7020-4ad9-8e69-6d12ad02a47e" (UID: "7f2360ec-7020-4ad9-8e69-6d12ad02a47e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:54:33.289873 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:33.289845    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-kube-api-access-8qp4h" (OuterVolumeSpecName: "kube-api-access-8qp4h") pod "7f2360ec-7020-4ad9-8e69-6d12ad02a47e" (UID: "7f2360ec-7020-4ad9-8e69-6d12ad02a47e"). InnerVolumeSpecName "kube-api-access-8qp4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:54:33.291985 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:33.291964    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-util" (OuterVolumeSpecName: "util") pod "7f2360ec-7020-4ad9-8e69-6d12ad02a47e" (UID: "7f2360ec-7020-4ad9-8e69-6d12ad02a47e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:54:33.388559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:33.388459    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-util\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:54:33.388559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:33.388500    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-bundle\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:54:33.388559 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:33.388512    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qp4h\" (UniqueName: \"kubernetes.io/projected/7f2360ec-7020-4ad9-8e69-6d12ad02a47e-kube-api-access-8qp4h\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:54:34.124438 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:34.124408    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54"
Jul 08 22:54:34.124438 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:34.124415    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl8m54" event={"ID":"7f2360ec-7020-4ad9-8e69-6d12ad02a47e","Type":"ContainerDied","Data":"cfc4f8bdc66d45a801ae1552bd085cfffc4ce4ef72b79472bf6433461011d81f"}
Jul 08 22:54:34.124623 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:34.124467    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfc4f8bdc66d45a801ae1552bd085cfffc4ce4ef72b79472bf6433461011d81f"
Jul 08 22:54:45.680756 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.680717    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b"]
Jul 08 22:54:45.681122 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.681046    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f2360ec-7020-4ad9-8e69-6d12ad02a47e" containerName="pull"
Jul 08 22:54:45.681122 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.681059    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f2360ec-7020-4ad9-8e69-6d12ad02a47e" containerName="pull"
Jul 08 22:54:45.681122 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.681075    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f2360ec-7020-4ad9-8e69-6d12ad02a47e" containerName="util"
Jul 08 22:54:45.681122 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.681080    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f2360ec-7020-4ad9-8e69-6d12ad02a47e" containerName="util"
Jul 08 22:54:45.681122 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.681086    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f2360ec-7020-4ad9-8e69-6d12ad02a47e" containerName="extract"
Jul 08 22:54:45.681122 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.681091    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f2360ec-7020-4ad9-8e69-6d12ad02a47e" containerName="extract"
Jul 08 22:54:45.681302 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.681136    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f2360ec-7020-4ad9-8e69-6d12ad02a47e" containerName="extract"
Jul 08 22:54:45.684918 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.684896    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b"
Jul 08 22:54:45.687584 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.687558    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 22:54:45.687584 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.687577    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9sqd6\""
Jul 08 22:54:45.687761 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.687598    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 22:54:45.692238 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.692214    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b"]
Jul 08 22:54:45.781802 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.781766    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5afe295-7988-4502-932b-f49b3332fb49-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b\" (UID: \"f5afe295-7988-4502-932b-f49b3332fb49\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b"
Jul 08 22:54:45.781802 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.781806    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md8tb\" (UniqueName: \"kubernetes.io/projected/f5afe295-7988-4502-932b-f49b3332fb49-kube-api-access-md8tb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b\" (UID: \"f5afe295-7988-4502-932b-f49b3332fb49\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b"
Jul 08 22:54:45.782014 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.781831    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5afe295-7988-4502-932b-f49b3332fb49-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b\" (UID: \"f5afe295-7988-4502-932b-f49b3332fb49\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b"
Jul 08 22:54:45.882471 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.882427    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5afe295-7988-4502-932b-f49b3332fb49-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b\" (UID: \"f5afe295-7988-4502-932b-f49b3332fb49\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b"
Jul 08 22:54:45.882471 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.882475    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md8tb\" (UniqueName: \"kubernetes.io/projected/f5afe295-7988-4502-932b-f49b3332fb49-kube-api-access-md8tb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b\" (UID: \"f5afe295-7988-4502-932b-f49b3332fb49\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b"
Jul 08 22:54:45.882713 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.882503    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5afe295-7988-4502-932b-f49b3332fb49-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b\" (UID: \"f5afe295-7988-4502-932b-f49b3332fb49\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b"
Jul 08 22:54:45.882937 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.882919    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5afe295-7988-4502-932b-f49b3332fb49-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b\" (UID: \"f5afe295-7988-4502-932b-f49b3332fb49\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b"
Jul 08 22:54:45.882978 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.882935    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5afe295-7988-4502-932b-f49b3332fb49-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b\" (UID: \"f5afe295-7988-4502-932b-f49b3332fb49\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b"
Jul 08 22:54:45.891281 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.891258    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md8tb\" (UniqueName: \"kubernetes.io/projected/f5afe295-7988-4502-932b-f49b3332fb49-kube-api-access-md8tb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b\" (UID: \"f5afe295-7988-4502-932b-f49b3332fb49\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b"
Jul 08 22:54:45.993459 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:45.993367    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b"
Jul 08 22:54:46.116073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:46.116049    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b"]
Jul 08 22:54:46.118765 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:54:46.118737    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5afe295_7988_4502_932b_f49b3332fb49.slice/crio-7d299b7f404fbca32abbb12579e79f503aa6d34081d04a7462dce9f5430110c2 WatchSource:0}: Error finding container 7d299b7f404fbca32abbb12579e79f503aa6d34081d04a7462dce9f5430110c2: Status 404 returned error can't find the container with id 7d299b7f404fbca32abbb12579e79f503aa6d34081d04a7462dce9f5430110c2
Jul 08 22:54:46.171382 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:46.171343    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b" event={"ID":"f5afe295-7988-4502-932b-f49b3332fb49","Type":"ContainerStarted","Data":"7d299b7f404fbca32abbb12579e79f503aa6d34081d04a7462dce9f5430110c2"}
Jul 08 22:54:47.176833 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:47.176740    2574 generic.go:356] "Generic (PLEG): container finished" podID="f5afe295-7988-4502-932b-f49b3332fb49" containerID="c05d17f0d99abddd9b848b1078c95adddede06dc1f996a95bdb06f83ffef310d" exitCode=0
Jul 08 22:54:47.176833 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:47.176782    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b" event={"ID":"f5afe295-7988-4502-932b-f49b3332fb49","Type":"ContainerDied","Data":"c05d17f0d99abddd9b848b1078c95adddede06dc1f996a95bdb06f83ffef310d"}
Jul 08 22:54:48.182772 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:48.182738    2574 generic.go:356] "Generic (PLEG): container finished" podID="f5afe295-7988-4502-932b-f49b3332fb49" containerID="56da3c87ced00e8124cbc081ab6d235bed381693ac8157cc55df35b3a7bf8bd5" exitCode=0
Jul 08 22:54:48.183199 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:48.182806    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b" event={"ID":"f5afe295-7988-4502-932b-f49b3332fb49","Type":"ContainerDied","Data":"56da3c87ced00e8124cbc081ab6d235bed381693ac8157cc55df35b3a7bf8bd5"}
Jul 08 22:54:49.188635 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:49.188604    2574 generic.go:356] "Generic (PLEG): container finished" podID="f5afe295-7988-4502-932b-f49b3332fb49" containerID="4e7cd6ae08d56b595328bc8c28ad4daa5a0cadf542bec12bb053eeaed98f859f" exitCode=0
Jul 08 22:54:49.188995 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:49.188671    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b" event={"ID":"f5afe295-7988-4502-932b-f49b3332fb49","Type":"ContainerDied","Data":"4e7cd6ae08d56b595328bc8c28ad4daa5a0cadf542bec12bb053eeaed98f859f"}
Jul 08 22:54:50.313819 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:50.313795    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b"
Jul 08 22:54:50.415138 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:50.415098    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-md8tb\" (UniqueName: \"kubernetes.io/projected/f5afe295-7988-4502-932b-f49b3332fb49-kube-api-access-md8tb\") pod \"f5afe295-7988-4502-932b-f49b3332fb49\" (UID: \"f5afe295-7988-4502-932b-f49b3332fb49\") "
Jul 08 22:54:50.415307 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:50.415150    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5afe295-7988-4502-932b-f49b3332fb49-util\") pod \"f5afe295-7988-4502-932b-f49b3332fb49\" (UID: \"f5afe295-7988-4502-932b-f49b3332fb49\") "
Jul 08 22:54:50.415307 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:50.415167    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5afe295-7988-4502-932b-f49b3332fb49-bundle\") pod \"f5afe295-7988-4502-932b-f49b3332fb49\" (UID: \"f5afe295-7988-4502-932b-f49b3332fb49\") "
Jul 08 22:54:50.415904 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:50.415881    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5afe295-7988-4502-932b-f49b3332fb49-bundle" (OuterVolumeSpecName: "bundle") pod "f5afe295-7988-4502-932b-f49b3332fb49" (UID: "f5afe295-7988-4502-932b-f49b3332fb49"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:54:50.417192 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:50.417163    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5afe295-7988-4502-932b-f49b3332fb49-kube-api-access-md8tb" (OuterVolumeSpecName: "kube-api-access-md8tb") pod "f5afe295-7988-4502-932b-f49b3332fb49" (UID: "f5afe295-7988-4502-932b-f49b3332fb49"). InnerVolumeSpecName "kube-api-access-md8tb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:54:50.420501 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:50.420429    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5afe295-7988-4502-932b-f49b3332fb49-util" (OuterVolumeSpecName: "util") pod "f5afe295-7988-4502-932b-f49b3332fb49" (UID: "f5afe295-7988-4502-932b-f49b3332fb49"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:54:50.515991 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:50.515901    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-md8tb\" (UniqueName: \"kubernetes.io/projected/f5afe295-7988-4502-932b-f49b3332fb49-kube-api-access-md8tb\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:54:50.515991 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:50.515927    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5afe295-7988-4502-932b-f49b3332fb49-util\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:54:50.515991 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:50.515940    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5afe295-7988-4502-932b-f49b3332fb49-bundle\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:54:51.197964 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:51.197933    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b" event={"ID":"f5afe295-7988-4502-932b-f49b3332fb49","Type":"ContainerDied","Data":"7d299b7f404fbca32abbb12579e79f503aa6d34081d04a7462dce9f5430110c2"}
Jul 08 22:54:51.198153 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:51.197975    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d299b7f404fbca32abbb12579e79f503aa6d34081d04a7462dce9f5430110c2"
Jul 08 22:54:51.198153 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:54:51.197987    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6z6b"
Jul 08 22:55:02.364043 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.363999    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"]
Jul 08 22:55:02.364636 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.364345    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5afe295-7988-4502-932b-f49b3332fb49" containerName="util"
Jul 08 22:55:02.364636 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.364362    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5afe295-7988-4502-932b-f49b3332fb49" containerName="util"
Jul 08 22:55:02.364636 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.364381    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5afe295-7988-4502-932b-f49b3332fb49" containerName="pull"
Jul 08 22:55:02.364636 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.364389    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5afe295-7988-4502-932b-f49b3332fb49" containerName="pull"
Jul 08 22:55:02.364636 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.364398    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5afe295-7988-4502-932b-f49b3332fb49" containerName="extract"
Jul 08 22:55:02.364636 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.364406    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5afe295-7988-4502-932b-f49b3332fb49" containerName="extract"
Jul 08 22:55:02.364636 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.364488    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5afe295-7988-4502-932b-f49b3332fb49" containerName="extract"
Jul 08 22:55:02.367440 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.367416    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:02.387741 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.387716    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zbz6j\""
Jul 08 22:55:02.388016 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.387997    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 22:55:02.388144 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.388092    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 22:55:02.388314 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.388298    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 22:55:02.388453 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.388436    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 22:55:02.397488 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.397457    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"]
Jul 08 22:55:02.408310 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.408284    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2376bf68-4318-45a0-9c91-c196290fbf9c-tmp\") pod \"opendatahub-operator-controller-manager-86d776fd96-676v4\" (UID: \"2376bf68-4318-45a0-9c91-c196290fbf9c\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:02.408419 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.408336    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2376bf68-4318-45a0-9c91-c196290fbf9c-manifests\") pod \"opendatahub-operator-controller-manager-86d776fd96-676v4\" (UID: \"2376bf68-4318-45a0-9c91-c196290fbf9c\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:02.408419 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.408362    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2376bf68-4318-45a0-9c91-c196290fbf9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d776fd96-676v4\" (UID: \"2376bf68-4318-45a0-9c91-c196290fbf9c\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:02.408419 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.408405    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sgt9\" (UniqueName: \"kubernetes.io/projected/2376bf68-4318-45a0-9c91-c196290fbf9c-kube-api-access-8sgt9\") pod \"opendatahub-operator-controller-manager-86d776fd96-676v4\" (UID: \"2376bf68-4318-45a0-9c91-c196290fbf9c\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:02.408520 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.408451    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2376bf68-4318-45a0-9c91-c196290fbf9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d776fd96-676v4\" (UID: \"2376bf68-4318-45a0-9c91-c196290fbf9c\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:02.509411 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.509359    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sgt9\" (UniqueName: \"kubernetes.io/projected/2376bf68-4318-45a0-9c91-c196290fbf9c-kube-api-access-8sgt9\") pod \"opendatahub-operator-controller-manager-86d776fd96-676v4\" (UID: \"2376bf68-4318-45a0-9c91-c196290fbf9c\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:02.509411 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.509410    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2376bf68-4318-45a0-9c91-c196290fbf9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d776fd96-676v4\" (UID: \"2376bf68-4318-45a0-9c91-c196290fbf9c\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:02.509723 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.509439    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2376bf68-4318-45a0-9c91-c196290fbf9c-tmp\") pod \"opendatahub-operator-controller-manager-86d776fd96-676v4\" (UID: \"2376bf68-4318-45a0-9c91-c196290fbf9c\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:02.509723 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.509472    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2376bf68-4318-45a0-9c91-c196290fbf9c-manifests\") pod \"opendatahub-operator-controller-manager-86d776fd96-676v4\" (UID: \"2376bf68-4318-45a0-9c91-c196290fbf9c\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:02.509723 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.509495    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2376bf68-4318-45a0-9c91-c196290fbf9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d776fd96-676v4\" (UID: \"2376bf68-4318-45a0-9c91-c196290fbf9c\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:02.509996 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.509970    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2376bf68-4318-45a0-9c91-c196290fbf9c-manifests\") pod \"opendatahub-operator-controller-manager-86d776fd96-676v4\" (UID: \"2376bf68-4318-45a0-9c91-c196290fbf9c\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:02.511608 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.511584    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2376bf68-4318-45a0-9c91-c196290fbf9c-tmp\") pod \"opendatahub-operator-controller-manager-86d776fd96-676v4\" (UID: \"2376bf68-4318-45a0-9c91-c196290fbf9c\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:02.511836 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.511815    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2376bf68-4318-45a0-9c91-c196290fbf9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d776fd96-676v4\" (UID: \"2376bf68-4318-45a0-9c91-c196290fbf9c\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:02.511975 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.511957    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2376bf68-4318-45a0-9c91-c196290fbf9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d776fd96-676v4\" (UID: \"2376bf68-4318-45a0-9c91-c196290fbf9c\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:02.516923 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.516905    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sgt9\" (UniqueName: \"kubernetes.io/projected/2376bf68-4318-45a0-9c91-c196290fbf9c-kube-api-access-8sgt9\") pod \"opendatahub-operator-controller-manager-86d776fd96-676v4\" (UID: \"2376bf68-4318-45a0-9c91-c196290fbf9c\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:02.676161 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.676126    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:02.803191 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:02.803169    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"]
Jul 08 22:55:02.805223 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:55:02.805195    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2376bf68_4318_45a0_9c91_c196290fbf9c.slice/crio-01a7dc6d6bbbd6a2872596dbedeccd4f166d7c384a9f4c814ab1f7c71fefcd05 WatchSource:0}: Error finding container 01a7dc6d6bbbd6a2872596dbedeccd4f166d7c384a9f4c814ab1f7c71fefcd05: Status 404 returned error can't find the container with id 01a7dc6d6bbbd6a2872596dbedeccd4f166d7c384a9f4c814ab1f7c71fefcd05
Jul 08 22:55:03.243755 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:03.243720    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4" event={"ID":"2376bf68-4318-45a0-9c91-c196290fbf9c","Type":"ContainerStarted","Data":"01a7dc6d6bbbd6a2872596dbedeccd4f166d7c384a9f4c814ab1f7c71fefcd05"}
Jul 08 22:55:07.260836 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:07.260800    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4" event={"ID":"2376bf68-4318-45a0-9c91-c196290fbf9c","Type":"ContainerStarted","Data":"a7f148c05b85ebd3f2dd475bca61483138b0d15457e616f365f0f5a23c52e850"}
Jul 08 22:55:08.269936 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:08.269899    2574 generic.go:356] "Generic (PLEG): container finished" podID="2376bf68-4318-45a0-9c91-c196290fbf9c" containerID="a7f148c05b85ebd3f2dd475bca61483138b0d15457e616f365f0f5a23c52e850" exitCode=0
Jul 08 22:55:08.270397 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:08.269957    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4" event={"ID":"2376bf68-4318-45a0-9c91-c196290fbf9c","Type":"ContainerDied","Data":"a7f148c05b85ebd3f2dd475bca61483138b0d15457e616f365f0f5a23c52e850"}
Jul 08 22:55:09.275889 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:09.275853    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4" event={"ID":"2376bf68-4318-45a0-9c91-c196290fbf9c","Type":"ContainerStarted","Data":"e861633c72db1ae898489ad77b2380a81b7b0b17420f195adfaf80904d05fda4"}
Jul 08 22:55:09.276305 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:09.275992    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:09.297523 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:09.297471    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4" podStartSLOduration=2.4262098979999998 podStartE2EDuration="7.297452628s" totalImagesPullingTime="3.893360147s" totalInitContainerRuntime="977.882583ms" isStatefulPod=false podCreationTimestamp="2026-07-08 22:55:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:55:09.296291927 +0000 UTC m=+484.320873930" watchObservedRunningTime="2026-07-08 22:55:09.297452628 +0000 UTC m=+484.322034614"
Jul 08 22:55:20.281935 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:20.281905    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-676v4"
Jul 08 22:55:22.192957 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.192924    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-78df955549-gjp2q"]
Jul 08 22:55:22.200850 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.200829    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78df955549-gjp2q"
Jul 08 22:55:22.203574 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.203555    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 22:55:22.203574 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.203572    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 08 22:55:22.204757 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.204738    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 22:55:22.204845 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.204759    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2fh2j\""
Jul 08 22:55:22.204845 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.204737    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 22:55:22.210373 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.210352    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78df955549-gjp2q"]
Jul 08 22:55:22.268405 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.268371    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nknng\" (UniqueName: \"kubernetes.io/projected/70783537-4fee-4553-8ea6-1e67a1866ee9-kube-api-access-nknng\") pod \"kube-auth-proxy-78df955549-gjp2q\" (UID: \"70783537-4fee-4553-8ea6-1e67a1866ee9\") " pod="openshift-ingress/kube-auth-proxy-78df955549-gjp2q"
Jul 08 22:55:22.268570 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.268438    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70783537-4fee-4553-8ea6-1e67a1866ee9-tls-certs\") pod \"kube-auth-proxy-78df955549-gjp2q\" (UID: \"70783537-4fee-4553-8ea6-1e67a1866ee9\") " pod="openshift-ingress/kube-auth-proxy-78df955549-gjp2q"
Jul 08 22:55:22.268570 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.268474    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70783537-4fee-4553-8ea6-1e67a1866ee9-tmp\") pod \"kube-auth-proxy-78df955549-gjp2q\" (UID: \"70783537-4fee-4553-8ea6-1e67a1866ee9\") " pod="openshift-ingress/kube-auth-proxy-78df955549-gjp2q"
Jul 08 22:55:22.369024 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.368980    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70783537-4fee-4553-8ea6-1e67a1866ee9-tls-certs\") pod \"kube-auth-proxy-78df955549-gjp2q\" (UID: \"70783537-4fee-4553-8ea6-1e67a1866ee9\") " pod="openshift-ingress/kube-auth-proxy-78df955549-gjp2q"
Jul 08 22:55:22.369225 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.369032    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70783537-4fee-4553-8ea6-1e67a1866ee9-tmp\") pod \"kube-auth-proxy-78df955549-gjp2q\" (UID: \"70783537-4fee-4553-8ea6-1e67a1866ee9\") " pod="openshift-ingress/kube-auth-proxy-78df955549-gjp2q"
Jul 08 22:55:22.369225 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.369061    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nknng\" (UniqueName: \"kubernetes.io/projected/70783537-4fee-4553-8ea6-1e67a1866ee9-kube-api-access-nknng\") pod \"kube-auth-proxy-78df955549-gjp2q\" (UID: \"70783537-4fee-4553-8ea6-1e67a1866ee9\") " pod="openshift-ingress/kube-auth-proxy-78df955549-gjp2q"
Jul 08 22:55:22.371303 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.371282    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70783537-4fee-4553-8ea6-1e67a1866ee9-tmp\") pod \"kube-auth-proxy-78df955549-gjp2q\" (UID: \"70783537-4fee-4553-8ea6-1e67a1866ee9\") " pod="openshift-ingress/kube-auth-proxy-78df955549-gjp2q"
Jul 08 22:55:22.371558 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.371537    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70783537-4fee-4553-8ea6-1e67a1866ee9-tls-certs\") pod \"kube-auth-proxy-78df955549-gjp2q\" (UID: \"70783537-4fee-4553-8ea6-1e67a1866ee9\") " pod="openshift-ingress/kube-auth-proxy-78df955549-gjp2q"
Jul 08 22:55:22.385421 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.385394    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nknng\" (UniqueName: \"kubernetes.io/projected/70783537-4fee-4553-8ea6-1e67a1866ee9-kube-api-access-nknng\") pod \"kube-auth-proxy-78df955549-gjp2q\" (UID: \"70783537-4fee-4553-8ea6-1e67a1866ee9\") " pod="openshift-ingress/kube-auth-proxy-78df955549-gjp2q"
Jul 08 22:55:22.425639 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.425573    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-s2swb"]
Jul 08 22:55:22.428779 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.428764    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-s2swb"
Jul 08 22:55:22.432783 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.432758    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 08 22:55:22.432891 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.432860    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6lpd9\""
Jul 08 22:55:22.443243 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.443217    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-s2swb"]
Jul 08 22:55:22.510162 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.510128    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78df955549-gjp2q"
Jul 08 22:55:22.571603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.571464    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b517962-b288-42b5-a632-cf87e4f27d69-cert\") pod \"odh-model-controller-7998c67dc4-s2swb\" (UID: \"6b517962-b288-42b5-a632-cf87e4f27d69\") " pod="opendatahub/odh-model-controller-7998c67dc4-s2swb"
Jul 08 22:55:22.571603 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.571575    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmh86\" (UniqueName: \"kubernetes.io/projected/6b517962-b288-42b5-a632-cf87e4f27d69-kube-api-access-kmh86\") pod \"odh-model-controller-7998c67dc4-s2swb\" (UID: \"6b517962-b288-42b5-a632-cf87e4f27d69\") " pod="opendatahub/odh-model-controller-7998c67dc4-s2swb"
Jul 08 22:55:22.634222 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.634199    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78df955549-gjp2q"]
Jul 08 22:55:22.636188 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:55:22.636162    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70783537_4fee_4553_8ea6_1e67a1866ee9.slice/crio-5a1eeeb977107ba80e004f0a28d0301afc4f88982be8385fa7c521b917f45635 WatchSource:0}: Error finding container 5a1eeeb977107ba80e004f0a28d0301afc4f88982be8385fa7c521b917f45635: Status 404 returned error can't find the container with id 5a1eeeb977107ba80e004f0a28d0301afc4f88982be8385fa7c521b917f45635
Jul 08 22:55:22.672443 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.672409    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmh86\" (UniqueName: \"kubernetes.io/projected/6b517962-b288-42b5-a632-cf87e4f27d69-kube-api-access-kmh86\") pod \"odh-model-controller-7998c67dc4-s2swb\" (UID: \"6b517962-b288-42b5-a632-cf87e4f27d69\") " pod="opendatahub/odh-model-controller-7998c67dc4-s2swb"
Jul 08 22:55:22.672604 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.672469    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b517962-b288-42b5-a632-cf87e4f27d69-cert\") pod \"odh-model-controller-7998c67dc4-s2swb\" (UID: \"6b517962-b288-42b5-a632-cf87e4f27d69\") " pod="opendatahub/odh-model-controller-7998c67dc4-s2swb"
Jul 08 22:55:22.672604 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:55:22.672564    2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 08 22:55:22.672673 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:55:22.672632    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b517962-b288-42b5-a632-cf87e4f27d69-cert podName:6b517962-b288-42b5-a632-cf87e4f27d69 nodeName:}" failed. No retries permitted until 2026-07-08 22:55:23.172614421 +0000 UTC m=+498.197196416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6b517962-b288-42b5-a632-cf87e4f27d69-cert") pod "odh-model-controller-7998c67dc4-s2swb" (UID: "6b517962-b288-42b5-a632-cf87e4f27d69") : secret "odh-model-controller-webhook-cert" not found
Jul 08 22:55:22.683636 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:22.683567    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmh86\" (UniqueName: \"kubernetes.io/projected/6b517962-b288-42b5-a632-cf87e4f27d69-kube-api-access-kmh86\") pod \"odh-model-controller-7998c67dc4-s2swb\" (UID: \"6b517962-b288-42b5-a632-cf87e4f27d69\") " pod="opendatahub/odh-model-controller-7998c67dc4-s2swb"
Jul 08 22:55:23.091439 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.091365    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wmvmk"]
Jul 08 22:55:23.095888 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.095873    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wmvmk"
Jul 08 22:55:23.098363 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.098347    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 08 22:55:23.105667 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.105644    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wmvmk"]
Jul 08 22:55:23.177436 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.177409    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b517962-b288-42b5-a632-cf87e4f27d69-cert\") pod \"odh-model-controller-7998c67dc4-s2swb\" (UID: \"6b517962-b288-42b5-a632-cf87e4f27d69\") " pod="opendatahub/odh-model-controller-7998c67dc4-s2swb"
Jul 08 22:55:23.177622 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.177466    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsrhk\" (UniqueName: \"kubernetes.io/projected/b9ee0f00-4ff3-4819-ba88-407e6d60d84e-kube-api-access-zsrhk\") pod \"model-serving-api-54d89bd5fc-wmvmk\" (UID: \"b9ee0f00-4ff3-4819-ba88-407e6d60d84e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wmvmk"
Jul 08 22:55:23.177622 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.177504    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9ee0f00-4ff3-4819-ba88-407e6d60d84e-tls-certs\") pod \"model-serving-api-54d89bd5fc-wmvmk\" (UID: \"b9ee0f00-4ff3-4819-ba88-407e6d60d84e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wmvmk"
Jul 08 22:55:23.179737 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.179716    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b517962-b288-42b5-a632-cf87e4f27d69-cert\") pod \"odh-model-controller-7998c67dc4-s2swb\" (UID: \"6b517962-b288-42b5-a632-cf87e4f27d69\") " pod="opendatahub/odh-model-controller-7998c67dc4-s2swb"
Jul 08 22:55:23.278147 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.278109    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsrhk\" (UniqueName: \"kubernetes.io/projected/b9ee0f00-4ff3-4819-ba88-407e6d60d84e-kube-api-access-zsrhk\") pod \"model-serving-api-54d89bd5fc-wmvmk\" (UID: \"b9ee0f00-4ff3-4819-ba88-407e6d60d84e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wmvmk"
Jul 08 22:55:23.278147 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.278158    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9ee0f00-4ff3-4819-ba88-407e6d60d84e-tls-certs\") pod \"model-serving-api-54d89bd5fc-wmvmk\" (UID: \"b9ee0f00-4ff3-4819-ba88-407e6d60d84e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wmvmk"
Jul 08 22:55:23.280447 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.280428    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9ee0f00-4ff3-4819-ba88-407e6d60d84e-tls-certs\") pod \"model-serving-api-54d89bd5fc-wmvmk\" (UID: \"b9ee0f00-4ff3-4819-ba88-407e6d60d84e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wmvmk"
Jul 08 22:55:23.289395 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.289374    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsrhk\" (UniqueName: \"kubernetes.io/projected/b9ee0f00-4ff3-4819-ba88-407e6d60d84e-kube-api-access-zsrhk\") pod \"model-serving-api-54d89bd5fc-wmvmk\" (UID: \"b9ee0f00-4ff3-4819-ba88-407e6d60d84e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wmvmk"
Jul 08 22:55:23.331082 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.331036    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78df955549-gjp2q" event={"ID":"70783537-4fee-4553-8ea6-1e67a1866ee9","Type":"ContainerStarted","Data":"5a1eeeb977107ba80e004f0a28d0301afc4f88982be8385fa7c521b917f45635"}
Jul 08 22:55:23.339307 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.339284    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-s2swb"
Jul 08 22:55:23.406463 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.406218    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wmvmk"
Jul 08 22:55:23.439700 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.439652    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"]
Jul 08 22:55:23.443507 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.443484    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.446901 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.446658    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 22:55:23.446901 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.446741    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 22:55:23.447103 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.446928    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ktlbh\""
Jul 08 22:55:23.447392 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.447349    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 22:55:23.447510 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.447353    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 22:55:23.461655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.461622    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"]
Jul 08 22:55:23.500813 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:55:23.500755    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b517962_b288_42b5_a632_cf87e4f27d69.slice/crio-6b9e3e8842cafdf52f12f0003ba524eb11fb80ee99c038ba45276ecdacae982e WatchSource:0}: Error finding container 6b9e3e8842cafdf52f12f0003ba524eb11fb80ee99c038ba45276ecdacae982e: Status 404 returned error can't find the container with id 6b9e3e8842cafdf52f12f0003ba524eb11fb80ee99c038ba45276ecdacae982e
Jul 08 22:55:23.502494 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.502422    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-s2swb"]
Jul 08 22:55:23.581176 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.581134    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e663e89-05d1-4317-836e-474fdb118e36-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.581353 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.581200    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc48d\" (UniqueName: \"kubernetes.io/projected/4e663e89-05d1-4317-836e-474fdb118e36-kube-api-access-sc48d\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.581353 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.581263    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-cacerts\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.581353 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.581308    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e663e89-05d1-4317-836e-474fdb118e36-local-certs\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.581353 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.581332    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e663e89-05d1-4317-836e-474fdb118e36-istio-token\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.581353 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.581352    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.581599 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.581379    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.583349 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.583300    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wmvmk"]
Jul 08 22:55:23.585813 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:55:23.585786    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ee0f00_4ff3_4819_ba88_407e6d60d84e.slice/crio-7941fc94a1f40bd9ae6f74775e75e978b1b1a00d1bf7f87d3456f623c2074fdb WatchSource:0}: Error finding container 7941fc94a1f40bd9ae6f74775e75e978b1b1a00d1bf7f87d3456f623c2074fdb: Status 404 returned error can't find the container with id 7941fc94a1f40bd9ae6f74775e75e978b1b1a00d1bf7f87d3456f623c2074fdb
Jul 08 22:55:23.682421 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.682392    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e663e89-05d1-4317-836e-474fdb118e36-local-certs\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.682421 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.682430    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e663e89-05d1-4317-836e-474fdb118e36-istio-token\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.682676 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.682454    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.682676 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.682486    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.682676 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.682526    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e663e89-05d1-4317-836e-474fdb118e36-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.682676 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.682568    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc48d\" (UniqueName: \"kubernetes.io/projected/4e663e89-05d1-4317-836e-474fdb118e36-kube-api-access-sc48d\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.682676 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.682625    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-cacerts\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.683473 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.683423    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e663e89-05d1-4317-836e-474fdb118e36-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.685295 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.685263    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e663e89-05d1-4317-836e-474fdb118e36-local-certs\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.685396 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.685263    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-cacerts\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.685396 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.685379    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.686022 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.686005    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.690958 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.690937    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e663e89-05d1-4317-836e-474fdb118e36-istio-token\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.691516 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.691494    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc48d\" (UniqueName: \"kubernetes.io/projected/4e663e89-05d1-4317-836e-474fdb118e36-kube-api-access-sc48d\") pod \"istiod-openshift-gateway-7574459656-hgbrn\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.758595 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.758567    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:23.903876 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:23.903817    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"]
Jul 08 22:55:23.907336 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:55:23.907311    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e663e89_05d1_4317_836e_474fdb118e36.slice/crio-e78e5976f5ef0e692291a74cb7bc9202aaed169968d958ccd18d8648299d5c13 WatchSource:0}: Error finding container e78e5976f5ef0e692291a74cb7bc9202aaed169968d958ccd18d8648299d5c13: Status 404 returned error can't find the container with id e78e5976f5ef0e692291a74cb7bc9202aaed169968d958ccd18d8648299d5c13
Jul 08 22:55:24.337650 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:24.337600    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn" event={"ID":"4e663e89-05d1-4317-836e-474fdb118e36","Type":"ContainerStarted","Data":"e78e5976f5ef0e692291a74cb7bc9202aaed169968d958ccd18d8648299d5c13"}
Jul 08 22:55:24.339275 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:24.339242    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wmvmk" event={"ID":"b9ee0f00-4ff3-4819-ba88-407e6d60d84e","Type":"ContainerStarted","Data":"7941fc94a1f40bd9ae6f74775e75e978b1b1a00d1bf7f87d3456f623c2074fdb"}
Jul 08 22:55:24.340572 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:24.340544    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-s2swb" event={"ID":"6b517962-b288-42b5-a632-cf87e4f27d69","Type":"ContainerStarted","Data":"6b9e3e8842cafdf52f12f0003ba524eb11fb80ee99c038ba45276ecdacae982e"}
Jul 08 22:55:28.287753 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:28.287666    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 22:55:28.287753 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:28.287745    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 22:55:29.363894 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.363855    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78df955549-gjp2q" event={"ID":"70783537-4fee-4553-8ea6-1e67a1866ee9","Type":"ContainerStarted","Data":"0e9e4844977573fb11daef6fb58309b601d785829c935405d8e8cb04aeb5646c"}
Jul 08 22:55:29.365381 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.365342    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn" event={"ID":"4e663e89-05d1-4317-836e-474fdb118e36","Type":"ContainerStarted","Data":"814e3379461b8e480a33b1f711e668e4090e28180330d3737770c201277cfc99"}
Jul 08 22:55:29.365526 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.365454    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:29.366886 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.366859    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wmvmk" event={"ID":"b9ee0f00-4ff3-4819-ba88-407e6d60d84e","Type":"ContainerStarted","Data":"ecd7691a5059867a7ab0a6f3d95c7283b17cc6eb44ad499350f9a57aaf6fccd7"}
Jul 08 22:55:29.367021 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.366992    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-wmvmk"
Jul 08 22:55:29.367221 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.367200    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-hgbrn container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 22:55:29.367313 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.367248    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn" podUID="4e663e89-05d1-4317-836e-474fdb118e36" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 22:55:29.368348 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.368329    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-s2swb" event={"ID":"6b517962-b288-42b5-a632-cf87e4f27d69","Type":"ContainerStarted","Data":"9759b87b64132ed2687106b226eb685b801a0db3341935f16f9950050787f373"}
Jul 08 22:55:29.368425 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.368388    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-s2swb"
Jul 08 22:55:29.382121 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.382069    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-78df955549-gjp2q" podStartSLOduration=1.745228291 podStartE2EDuration="7.382055305s" totalImagesPullingTime="5.636827014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:55:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:55:29.3798663 +0000 UTC m=+504.404448303" watchObservedRunningTime="2026-07-08 22:55:29.382055305 +0000 UTC m=+504.406637307"
Jul 08 22:55:29.402645 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.402585    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn" podStartSLOduration=2.029768555 podStartE2EDuration="6.402566228s" totalImagesPullingTime="4.372797673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:55:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:55:29.402025604 +0000 UTC m=+504.426607608" watchObservedRunningTime="2026-07-08 22:55:29.402566228 +0000 UTC m=+504.427148232"
Jul 08 22:55:29.413200 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.413168    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"]
Jul 08 22:55:29.416309 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.416289    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.419136 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.419118    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pdx4q\""
Jul 08 22:55:29.445264 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.445219    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-s2swb" podStartSLOduration=2.660571444 podStartE2EDuration="7.445204165s" totalImagesPullingTime="4.784632721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:55:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:55:29.441502455 +0000 UTC m=+504.466084458" watchObservedRunningTime="2026-07-08 22:55:29.445204165 +0000 UTC m=+504.469786182"
Jul 08 22:55:29.447196 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.447172    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"]
Jul 08 22:55:29.486149 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.486097    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-wmvmk" podStartSLOduration=1.795192472 podStartE2EDuration="6.486083462s" totalImagesPullingTime="4.69089099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:55:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:55:29.484450644 +0000 UTC m=+504.509032660" watchObservedRunningTime="2026-07-08 22:55:29.486083462 +0000 UTC m=+504.510665464"
Jul 08 22:55:29.537413 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.537374    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.537413 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.537414    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.537615 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.537437    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.537615 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.537526    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.537615 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.537584    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.537738 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.537639    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4wqg\" (UniqueName: \"kubernetes.io/projected/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-kube-api-access-s4wqg\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.537738 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.537677    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.537738 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.537719    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.537841 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.537765    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.638469 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.638433    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4wqg\" (UniqueName: \"kubernetes.io/projected/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-kube-api-access-s4wqg\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.638641 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.638489    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.638641 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.638613    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.638798 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.638681    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.638798 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.638747    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.638798 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.638771    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.638798 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.638791    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.638982 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.638828    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.638982 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.638927    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.639161 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.639115    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.639457 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.639429    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.639554 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.639429    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.639554 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.639428    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.639731 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.639645    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.641087 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.641061    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.641633 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.641613    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.647173 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.647116    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.647620 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.647601    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4wqg\" (UniqueName: \"kubernetes.io/projected/d33b5f1d-e61b-40b6-b75b-52c78dcdd44d-kube-api-access-s4wqg\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z8p58\" (UID: \"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.727403 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.727369    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:29.884930 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:29.884896    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"]
Jul 08 22:55:29.886218 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:55:29.886196    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33b5f1d_e61b_40b6_b75b_52c78dcdd44d.slice/crio-845571c913f6c51d1d84f5912a5f7b44b2ebbefc49a85be8ae24aacdf04007b1 WatchSource:0}: Error finding container 845571c913f6c51d1d84f5912a5f7b44b2ebbefc49a85be8ae24aacdf04007b1: Status 404 returned error can't find the container with id 845571c913f6c51d1d84f5912a5f7b44b2ebbefc49a85be8ae24aacdf04007b1
Jul 08 22:55:30.373248 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:30.373209    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58" event={"ID":"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d","Type":"ContainerStarted","Data":"845571c913f6c51d1d84f5912a5f7b44b2ebbefc49a85be8ae24aacdf04007b1"}
Jul 08 22:55:30.373960 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:30.373938    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:31.788925 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:31.788888    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b98w5"]
Jul 08 22:55:31.795821 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:31.795795    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b98w5"
Jul 08 22:55:31.797629 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:31.797605    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kkns2"]
Jul 08 22:55:31.798778 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:31.798736    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-p8znh\""
Jul 08 22:55:31.798903 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:31.798821    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 08 22:55:31.800797 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:31.800780    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kkns2"
Jul 08 22:55:31.803339 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:31.803318    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 08 22:55:31.803474 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:31.803412    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dmdbc\""
Jul 08 22:55:31.804228 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:31.804204    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b98w5"]
Jul 08 22:55:31.810651 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:31.810627    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kkns2"]
Jul 08 22:55:31.961985 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:31.961946    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jrmp\" (UniqueName: \"kubernetes.io/projected/9332cd0f-fc0d-4894-ad31-d3874637f74f-kube-api-access-4jrmp\") pod \"llmisvc-controller-manager-777c6bd7d5-kkns2\" (UID: \"9332cd0f-fc0d-4894-ad31-d3874637f74f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kkns2"
Jul 08 22:55:31.961985 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:31.961991    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9p4j\" (UniqueName: \"kubernetes.io/projected/ca3d7e84-75b4-441c-93a5-ab9846083f63-kube-api-access-n9p4j\") pod \"kserve-controller-manager-d6f4b65b8-b98w5\" (UID: \"ca3d7e84-75b4-441c-93a5-ab9846083f63\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b98w5"
Jul 08 22:55:31.962220 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:31.962018    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9332cd0f-fc0d-4894-ad31-d3874637f74f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kkns2\" (UID: \"9332cd0f-fc0d-4894-ad31-d3874637f74f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kkns2"
Jul 08 22:55:31.962220 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:31.962125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca3d7e84-75b4-441c-93a5-ab9846083f63-cert\") pod \"kserve-controller-manager-d6f4b65b8-b98w5\" (UID: \"ca3d7e84-75b4-441c-93a5-ab9846083f63\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b98w5"
Jul 08 22:55:32.063442 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:32.063354    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9332cd0f-fc0d-4894-ad31-d3874637f74f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kkns2\" (UID: \"9332cd0f-fc0d-4894-ad31-d3874637f74f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kkns2"
Jul 08 22:55:32.063442 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:32.063412    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca3d7e84-75b4-441c-93a5-ab9846083f63-cert\") pod \"kserve-controller-manager-d6f4b65b8-b98w5\" (UID: \"ca3d7e84-75b4-441c-93a5-ab9846083f63\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b98w5"
Jul 08 22:55:32.063671 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:32.063486    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jrmp\" (UniqueName: \"kubernetes.io/projected/9332cd0f-fc0d-4894-ad31-d3874637f74f-kube-api-access-4jrmp\") pod \"llmisvc-controller-manager-777c6bd7d5-kkns2\" (UID: \"9332cd0f-fc0d-4894-ad31-d3874637f74f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kkns2"
Jul 08 22:55:32.063671 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:32.063514    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9p4j\" (UniqueName: \"kubernetes.io/projected/ca3d7e84-75b4-441c-93a5-ab9846083f63-kube-api-access-n9p4j\") pod \"kserve-controller-manager-d6f4b65b8-b98w5\" (UID: \"ca3d7e84-75b4-441c-93a5-ab9846083f63\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b98w5"
Jul 08 22:55:32.063671 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:55:32.063592    2574 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 08 22:55:32.063847 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:55:32.063675    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3d7e84-75b4-441c-93a5-ab9846083f63-cert podName:ca3d7e84-75b4-441c-93a5-ab9846083f63 nodeName:}" failed. No retries permitted until 2026-07-08 22:55:32.563652135 +0000 UTC m=+507.588234131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca3d7e84-75b4-441c-93a5-ab9846083f63-cert") pod "kserve-controller-manager-d6f4b65b8-b98w5" (UID: "ca3d7e84-75b4-441c-93a5-ab9846083f63") : secret "kserve-webhook-server-cert" not found
Jul 08 22:55:32.066229 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:32.066200    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9332cd0f-fc0d-4894-ad31-d3874637f74f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kkns2\" (UID: \"9332cd0f-fc0d-4894-ad31-d3874637f74f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kkns2"
Jul 08 22:55:32.082653 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:32.082622    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jrmp\" (UniqueName: \"kubernetes.io/projected/9332cd0f-fc0d-4894-ad31-d3874637f74f-kube-api-access-4jrmp\") pod \"llmisvc-controller-manager-777c6bd7d5-kkns2\" (UID: \"9332cd0f-fc0d-4894-ad31-d3874637f74f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kkns2"
Jul 08 22:55:32.082807 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:32.082662    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9p4j\" (UniqueName: \"kubernetes.io/projected/ca3d7e84-75b4-441c-93a5-ab9846083f63-kube-api-access-n9p4j\") pod \"kserve-controller-manager-d6f4b65b8-b98w5\" (UID: \"ca3d7e84-75b4-441c-93a5-ab9846083f63\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b98w5"
Jul 08 22:55:32.117704 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:32.117654    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kkns2"
Jul 08 22:55:32.478976 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:32.478936    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 22:55:32.479086 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:32.479028    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 22:55:32.479086 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:32.479075    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 22:55:32.538334 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:32.538313    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kkns2"]
Jul 08 22:55:32.540009 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:55:32.539988    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9332cd0f_fc0d_4894_ad31_d3874637f74f.slice/crio-8c75d084bd8a34f1cb2ba1030d6b4448f5051c0e1d67ce1085520059ab753e60 WatchSource:0}: Error finding container 8c75d084bd8a34f1cb2ba1030d6b4448f5051c0e1d67ce1085520059ab753e60: Status 404 returned error can't find the container with id 8c75d084bd8a34f1cb2ba1030d6b4448f5051c0e1d67ce1085520059ab753e60
Jul 08 22:55:32.569050 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:32.569008    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca3d7e84-75b4-441c-93a5-ab9846083f63-cert\") pod \"kserve-controller-manager-d6f4b65b8-b98w5\" (UID: \"ca3d7e84-75b4-441c-93a5-ab9846083f63\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b98w5"
Jul 08 22:55:32.571325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:32.571299    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca3d7e84-75b4-441c-93a5-ab9846083f63-cert\") pod \"kserve-controller-manager-d6f4b65b8-b98w5\" (UID: \"ca3d7e84-75b4-441c-93a5-ab9846083f63\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b98w5"
Jul 08 22:55:32.711505 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:32.711429    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b98w5"
Jul 08 22:55:32.845912 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:32.845876    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b98w5"]
Jul 08 22:55:32.847915 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:55:32.847888    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3d7e84_75b4_441c_93a5_ab9846083f63.slice/crio-4c0595408cb9a4577beba75066e37d89e6a4877964830e3a38ce23896a9c4d4d WatchSource:0}: Error finding container 4c0595408cb9a4577beba75066e37d89e6a4877964830e3a38ce23896a9c4d4d: Status 404 returned error can't find the container with id 4c0595408cb9a4577beba75066e37d89e6a4877964830e3a38ce23896a9c4d4d
Jul 08 22:55:33.393629 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.393597    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58" event={"ID":"d33b5f1d-e61b-40b6-b75b-52c78dcdd44d","Type":"ContainerStarted","Data":"f84df798013041774fd4557ddfb6980920d69d4aab9dd0844b9b1fbc32069924"}
Jul 08 22:55:33.394921 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.394892    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b98w5" event={"ID":"ca3d7e84-75b4-441c-93a5-ab9846083f63","Type":"ContainerStarted","Data":"4c0595408cb9a4577beba75066e37d89e6a4877964830e3a38ce23896a9c4d4d"}
Jul 08 22:55:33.395894 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.395874    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kkns2" event={"ID":"9332cd0f-fc0d-4894-ad31-d3874637f74f","Type":"ContainerStarted","Data":"8c75d084bd8a34f1cb2ba1030d6b4448f5051c0e1d67ce1085520059ab753e60"}
Jul 08 22:55:33.415727 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.415654    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58" podStartSLOduration=1.8252238520000001 podStartE2EDuration="4.415636959s" totalImagesPullingTime="2.590413107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:55:33.413989272 +0000 UTC m=+508.438571276" watchObservedRunningTime="2026-07-08 22:55:33.415636959 +0000 UTC m=+508.440218981"
Jul 08 22:55:33.459151 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.459109    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"]
Jul 08 22:55:33.459339 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.459312    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn" podUID="4e663e89-05d1-4317-836e-474fdb118e36" containerName="discovery" containerID="cri-o://814e3379461b8e480a33b1f711e668e4090e28180330d3737770c201277cfc99" gracePeriod=30
Jul 08 22:55:33.728057 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.727971    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:33.733228 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.733195    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:33.799398 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.799368    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:33.882795 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.882762    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-istio-csr-dns-cert\") pod \"4e663e89-05d1-4317-836e-474fdb118e36\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") "
Jul 08 22:55:33.883321 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.882814    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc48d\" (UniqueName: \"kubernetes.io/projected/4e663e89-05d1-4317-836e-474fdb118e36-kube-api-access-sc48d\") pod \"4e663e89-05d1-4317-836e-474fdb118e36\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") "
Jul 08 22:55:33.883321 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.882852    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e663e89-05d1-4317-836e-474fdb118e36-istio-csr-ca-configmap\") pod \"4e663e89-05d1-4317-836e-474fdb118e36\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") "
Jul 08 22:55:33.883321 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.882889    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-istio-kubeconfig\") pod \"4e663e89-05d1-4317-836e-474fdb118e36\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") "
Jul 08 22:55:33.883321 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.882954    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e663e89-05d1-4317-836e-474fdb118e36-istio-token\") pod \"4e663e89-05d1-4317-836e-474fdb118e36\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") "
Jul 08 22:55:33.883321 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.883005    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e663e89-05d1-4317-836e-474fdb118e36-local-certs\") pod \"4e663e89-05d1-4317-836e-474fdb118e36\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") "
Jul 08 22:55:33.883321 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.883028    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-cacerts\") pod \"4e663e89-05d1-4317-836e-474fdb118e36\" (UID: \"4e663e89-05d1-4317-836e-474fdb118e36\") "
Jul 08 22:55:33.884428 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.884151    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e663e89-05d1-4317-836e-474fdb118e36-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "4e663e89-05d1-4317-836e-474fdb118e36" (UID: "4e663e89-05d1-4317-836e-474fdb118e36"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:55:33.885612 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.885580    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "4e663e89-05d1-4317-836e-474fdb118e36" (UID: "4e663e89-05d1-4317-836e-474fdb118e36"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:55:33.887377 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.887338    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-cacerts" (OuterVolumeSpecName: "cacerts") pod "4e663e89-05d1-4317-836e-474fdb118e36" (UID: "4e663e89-05d1-4317-836e-474fdb118e36"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:55:33.887478 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.887380    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e663e89-05d1-4317-836e-474fdb118e36-kube-api-access-sc48d" (OuterVolumeSpecName: "kube-api-access-sc48d") pod "4e663e89-05d1-4317-836e-474fdb118e36" (UID: "4e663e89-05d1-4317-836e-474fdb118e36"). InnerVolumeSpecName "kube-api-access-sc48d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:55:33.887600 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.887576    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e663e89-05d1-4317-836e-474fdb118e36-local-certs" (OuterVolumeSpecName: "local-certs") pod "4e663e89-05d1-4317-836e-474fdb118e36" (UID: "4e663e89-05d1-4317-836e-474fdb118e36"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:55:33.888085 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.888059    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "4e663e89-05d1-4317-836e-474fdb118e36" (UID: "4e663e89-05d1-4317-836e-474fdb118e36"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:55:33.888301 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.888273    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e663e89-05d1-4317-836e-474fdb118e36-istio-token" (OuterVolumeSpecName: "istio-token") pod "4e663e89-05d1-4317-836e-474fdb118e36" (UID: "4e663e89-05d1-4317-836e-474fdb118e36"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:55:33.984109 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.984028    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc48d\" (UniqueName: \"kubernetes.io/projected/4e663e89-05d1-4317-836e-474fdb118e36-kube-api-access-sc48d\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:55:33.984109 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.984066    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e663e89-05d1-4317-836e-474fdb118e36-istio-csr-ca-configmap\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:55:33.984109 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.984082    2574 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-istio-kubeconfig\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:55:33.984109 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.984095    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e663e89-05d1-4317-836e-474fdb118e36-istio-token\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:55:33.984109 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.984108    2574 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e663e89-05d1-4317-836e-474fdb118e36-local-certs\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:55:33.984443 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.984119    2574 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-cacerts\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:55:33.984443 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:33.984132    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e663e89-05d1-4317-836e-474fdb118e36-istio-csr-dns-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:55:34.401833 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:34.401796    2574 generic.go:356] "Generic (PLEG): container finished" podID="4e663e89-05d1-4317-836e-474fdb118e36" containerID="814e3379461b8e480a33b1f711e668e4090e28180330d3737770c201277cfc99" exitCode=0
Jul 08 22:55:34.402120 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:34.401847    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"
Jul 08 22:55:34.402120 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:34.401882    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn" event={"ID":"4e663e89-05d1-4317-836e-474fdb118e36","Type":"ContainerDied","Data":"814e3379461b8e480a33b1f711e668e4090e28180330d3737770c201277cfc99"}
Jul 08 22:55:34.402120 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:34.401942    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn" event={"ID":"4e663e89-05d1-4317-836e-474fdb118e36","Type":"ContainerDied","Data":"e78e5976f5ef0e692291a74cb7bc9202aaed169968d958ccd18d8648299d5c13"}
Jul 08 22:55:34.402120 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:34.401969    2574 scope.go:117] "RemoveContainer" containerID="814e3379461b8e480a33b1f711e668e4090e28180330d3737770c201277cfc99"
Jul 08 22:55:34.402485 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:34.402215    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:34.403635 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:34.403619    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z8p58"
Jul 08 22:55:34.413131 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:34.413108    2574 scope.go:117] "RemoveContainer" containerID="814e3379461b8e480a33b1f711e668e4090e28180330d3737770c201277cfc99"
Jul 08 22:55:34.413503 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:55:34.413472    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"814e3379461b8e480a33b1f711e668e4090e28180330d3737770c201277cfc99\": container with ID starting with 814e3379461b8e480a33b1f711e668e4090e28180330d3737770c201277cfc99 not found: ID does not exist" containerID="814e3379461b8e480a33b1f711e668e4090e28180330d3737770c201277cfc99"
Jul 08 22:55:34.413588 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:34.413514    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"814e3379461b8e480a33b1f711e668e4090e28180330d3737770c201277cfc99"} err="failed to get container status \"814e3379461b8e480a33b1f711e668e4090e28180330d3737770c201277cfc99\": rpc error: code = NotFound desc = could not find container \"814e3379461b8e480a33b1f711e668e4090e28180330d3737770c201277cfc99\": container with ID starting with 814e3379461b8e480a33b1f711e668e4090e28180330d3737770c201277cfc99 not found: ID does not exist"
Jul 08 22:55:34.432660 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:34.432622    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"]
Jul 08 22:55:34.443011 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:34.442982    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hgbrn"]
Jul 08 22:55:35.503082 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:35.503046    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e663e89-05d1-4317-836e-474fdb118e36" path="/var/lib/kubelet/pods/4e663e89-05d1-4317-836e-474fdb118e36/volumes"
Jul 08 22:55:36.413749 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:36.413710    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b98w5" event={"ID":"ca3d7e84-75b4-441c-93a5-ab9846083f63","Type":"ContainerStarted","Data":"941eae530fb937849c6767a8845d259bf952934f773ec73499b3fa9e6e19f950"}
Jul 08 22:55:36.413936 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:36.413817    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b98w5"
Jul 08 22:55:36.415140 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:36.415109    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kkns2" event={"ID":"9332cd0f-fc0d-4894-ad31-d3874637f74f","Type":"ContainerStarted","Data":"fec919f3e3c53661b6a6ec3c6bf77019164667ce288aa4bce4fb3d2ce4503674"}
Jul 08 22:55:36.415283 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:36.415266    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kkns2"
Jul 08 22:55:36.430970 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:36.430910    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b98w5" podStartSLOduration=2.584656153 podStartE2EDuration="5.430887708s" totalImagesPullingTime="2.846231555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:55:36.430109964 +0000 UTC m=+511.454691977" watchObservedRunningTime="2026-07-08 22:55:36.430887708 +0000 UTC m=+511.455469712"
Jul 08 22:55:36.446355 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:36.446302    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kkns2" podStartSLOduration=2.288390455 podStartE2EDuration="5.446285861s" totalImagesPullingTime="3.157895406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:55:36.444999705 +0000 UTC m=+511.469581708" watchObservedRunningTime="2026-07-08 22:55:36.446285861 +0000 UTC m=+511.470867864"
Jul 08 22:55:40.375877 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:40.375845    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-s2swb"
Jul 08 22:55:40.378373 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:55:40.378351    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-wmvmk"
Jul 08 22:56:07.421671 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:07.421639    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kkns2"
Jul 08 22:56:07.424677 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:07.424652    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b98w5"
Jul 08 22:56:23.341374 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.341340    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l4gph"]
Jul 08 22:56:23.341824 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.341618    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e663e89-05d1-4317-836e-474fdb118e36" containerName="discovery"
Jul 08 22:56:23.341824 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.341629    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e663e89-05d1-4317-836e-474fdb118e36" containerName="discovery"
Jul 08 22:56:23.341824 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.341697    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e663e89-05d1-4317-836e-474fdb118e36" containerName="discovery"
Jul 08 22:56:23.354383 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.354353    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l4gph"
Jul 08 22:56:23.355045 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.354908    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l4gph"]
Jul 08 22:56:23.357595 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.357569    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 22:56:23.357746 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.357649    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 22:56:23.358960 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.358928    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-95ccc\""
Jul 08 22:56:23.506748 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.506716    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8s7z\" (UniqueName: \"kubernetes.io/projected/23fcccf4-05ad-43c6-b426-4b0604abee22-kube-api-access-f8s7z\") pod \"kuadrant-operator-catalog-l4gph\" (UID: \"23fcccf4-05ad-43c6-b426-4b0604abee22\") " pod="kuadrant-system/kuadrant-operator-catalog-l4gph"
Jul 08 22:56:23.607581 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.607493    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8s7z\" (UniqueName: \"kubernetes.io/projected/23fcccf4-05ad-43c6-b426-4b0604abee22-kube-api-access-f8s7z\") pod \"kuadrant-operator-catalog-l4gph\" (UID: \"23fcccf4-05ad-43c6-b426-4b0604abee22\") " pod="kuadrant-system/kuadrant-operator-catalog-l4gph"
Jul 08 22:56:23.619388 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.619361    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8s7z\" (UniqueName: \"kubernetes.io/projected/23fcccf4-05ad-43c6-b426-4b0604abee22-kube-api-access-f8s7z\") pod \"kuadrant-operator-catalog-l4gph\" (UID: \"23fcccf4-05ad-43c6-b426-4b0604abee22\") " pod="kuadrant-system/kuadrant-operator-catalog-l4gph"
Jul 08 22:56:23.665375 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.665335    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l4gph"
Jul 08 22:56:23.712456 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.712433    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l4gph"]
Jul 08 22:56:23.790274 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.790252    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l4gph"]
Jul 08 22:56:23.792842 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:56:23.792812    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23fcccf4_05ad_43c6_b426_4b0604abee22.slice/crio-a365082473ad5d3a73c372781c709a73ad208bfd19fb8046b16d725437840552 WatchSource:0}: Error finding container a365082473ad5d3a73c372781c709a73ad208bfd19fb8046b16d725437840552: Status 404 returned error can't find the container with id a365082473ad5d3a73c372781c709a73ad208bfd19fb8046b16d725437840552
Jul 08 22:56:23.920874 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.920835    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8qvtg"]
Jul 08 22:56:23.923398 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.923378    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8qvtg"
Jul 08 22:56:23.931251 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:23.931225    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8qvtg"]
Jul 08 22:56:24.011249 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:24.011211    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgzsr\" (UniqueName: \"kubernetes.io/projected/c332f4df-54db-4e20-9599-a9a08b0682e7-kube-api-access-vgzsr\") pod \"kuadrant-operator-catalog-8qvtg\" (UID: \"c332f4df-54db-4e20-9599-a9a08b0682e7\") " pod="kuadrant-system/kuadrant-operator-catalog-8qvtg"
Jul 08 22:56:24.112571 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:24.112536    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgzsr\" (UniqueName: \"kubernetes.io/projected/c332f4df-54db-4e20-9599-a9a08b0682e7-kube-api-access-vgzsr\") pod \"kuadrant-operator-catalog-8qvtg\" (UID: \"c332f4df-54db-4e20-9599-a9a08b0682e7\") " pod="kuadrant-system/kuadrant-operator-catalog-8qvtg"
Jul 08 22:56:24.121985 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:24.121952    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgzsr\" (UniqueName: \"kubernetes.io/projected/c332f4df-54db-4e20-9599-a9a08b0682e7-kube-api-access-vgzsr\") pod \"kuadrant-operator-catalog-8qvtg\" (UID: \"c332f4df-54db-4e20-9599-a9a08b0682e7\") " pod="kuadrant-system/kuadrant-operator-catalog-8qvtg"
Jul 08 22:56:24.233316 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:24.233227    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8qvtg"
Jul 08 22:56:24.364646 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:24.364617    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8qvtg"]
Jul 08 22:56:24.366333 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:56:24.366308    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc332f4df_54db_4e20_9599_a9a08b0682e7.slice/crio-88d7964dfaad0ad31af6afddce433fef41b044ac3c51b1daeb5f5ba76d710051 WatchSource:0}: Error finding container 88d7964dfaad0ad31af6afddce433fef41b044ac3c51b1daeb5f5ba76d710051: Status 404 returned error can't find the container with id 88d7964dfaad0ad31af6afddce433fef41b044ac3c51b1daeb5f5ba76d710051
Jul 08 22:56:24.622487 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:24.622454    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l4gph" event={"ID":"23fcccf4-05ad-43c6-b426-4b0604abee22","Type":"ContainerStarted","Data":"a365082473ad5d3a73c372781c709a73ad208bfd19fb8046b16d725437840552"}
Jul 08 22:56:24.623674 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:24.623650    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8qvtg" event={"ID":"c332f4df-54db-4e20-9599-a9a08b0682e7","Type":"ContainerStarted","Data":"88d7964dfaad0ad31af6afddce433fef41b044ac3c51b1daeb5f5ba76d710051"}
Jul 08 22:56:26.634243 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:26.634200    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l4gph" event={"ID":"23fcccf4-05ad-43c6-b426-4b0604abee22","Type":"ContainerStarted","Data":"cab4319c250d1a273a35c1a0933cb6a9a264267f56bbdcf50fbcc6737fd164d6"}
Jul 08 22:56:26.634656 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:26.634280    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-l4gph" podUID="23fcccf4-05ad-43c6-b426-4b0604abee22" containerName="registry-server" containerID="cri-o://cab4319c250d1a273a35c1a0933cb6a9a264267f56bbdcf50fbcc6737fd164d6" gracePeriod=2
Jul 08 22:56:26.635830 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:26.635804    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8qvtg" event={"ID":"c332f4df-54db-4e20-9599-a9a08b0682e7","Type":"ContainerStarted","Data":"3b48735d37be0bd8d80c2b2279d5cb8643d0d18562a41702f7c2ca1b6a580d7f"}
Jul 08 22:56:26.653838 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:26.653796    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-l4gph" podStartSLOduration=1.8437862470000002 podStartE2EDuration="3.653781242s" totalImagesPullingTime="1.809994995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:56:26.653436912 +0000 UTC m=+561.678018917" watchObservedRunningTime="2026-07-08 22:56:26.653781242 +0000 UTC m=+561.678363259"
Jul 08 22:56:26.672376 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:26.672326    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8qvtg" podStartSLOduration=2.435395044 podStartE2EDuration="3.6723108s" totalImagesPullingTime="1.236915756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:56:26.670467869 +0000 UTC m=+561.695049872" watchObservedRunningTime="2026-07-08 22:56:26.6723108 +0000 UTC m=+561.696892801"
Jul 08 22:56:26.869044 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:26.869019    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l4gph"
Jul 08 22:56:27.036871 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:27.036793    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8s7z\" (UniqueName: \"kubernetes.io/projected/23fcccf4-05ad-43c6-b426-4b0604abee22-kube-api-access-f8s7z\") pod \"23fcccf4-05ad-43c6-b426-4b0604abee22\" (UID: \"23fcccf4-05ad-43c6-b426-4b0604abee22\") "
Jul 08 22:56:27.038839 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:27.038812    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23fcccf4-05ad-43c6-b426-4b0604abee22-kube-api-access-f8s7z" (OuterVolumeSpecName: "kube-api-access-f8s7z") pod "23fcccf4-05ad-43c6-b426-4b0604abee22" (UID: "23fcccf4-05ad-43c6-b426-4b0604abee22"). InnerVolumeSpecName "kube-api-access-f8s7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:56:27.137370 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:27.137335    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8s7z\" (UniqueName: \"kubernetes.io/projected/23fcccf4-05ad-43c6-b426-4b0604abee22-kube-api-access-f8s7z\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:56:27.641202 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:27.641166    2574 generic.go:356] "Generic (PLEG): container finished" podID="23fcccf4-05ad-43c6-b426-4b0604abee22" containerID="cab4319c250d1a273a35c1a0933cb6a9a264267f56bbdcf50fbcc6737fd164d6" exitCode=0
Jul 08 22:56:27.641678 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:27.641209    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l4gph"
Jul 08 22:56:27.641678 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:27.641259    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l4gph" event={"ID":"23fcccf4-05ad-43c6-b426-4b0604abee22","Type":"ContainerDied","Data":"cab4319c250d1a273a35c1a0933cb6a9a264267f56bbdcf50fbcc6737fd164d6"}
Jul 08 22:56:27.641678 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:27.641314    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l4gph" event={"ID":"23fcccf4-05ad-43c6-b426-4b0604abee22","Type":"ContainerDied","Data":"a365082473ad5d3a73c372781c709a73ad208bfd19fb8046b16d725437840552"}
Jul 08 22:56:27.641678 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:27.641343    2574 scope.go:117] "RemoveContainer" containerID="cab4319c250d1a273a35c1a0933cb6a9a264267f56bbdcf50fbcc6737fd164d6"
Jul 08 22:56:27.649563 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:27.649543    2574 scope.go:117] "RemoveContainer" containerID="cab4319c250d1a273a35c1a0933cb6a9a264267f56bbdcf50fbcc6737fd164d6"
Jul 08 22:56:27.649831 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:56:27.649813    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cab4319c250d1a273a35c1a0933cb6a9a264267f56bbdcf50fbcc6737fd164d6\": container with ID starting with cab4319c250d1a273a35c1a0933cb6a9a264267f56bbdcf50fbcc6737fd164d6 not found: ID does not exist" containerID="cab4319c250d1a273a35c1a0933cb6a9a264267f56bbdcf50fbcc6737fd164d6"
Jul 08 22:56:27.649910 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:27.649838    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cab4319c250d1a273a35c1a0933cb6a9a264267f56bbdcf50fbcc6737fd164d6"} err="failed to get container status \"cab4319c250d1a273a35c1a0933cb6a9a264267f56bbdcf50fbcc6737fd164d6\": rpc error: code = NotFound desc = could not find container \"cab4319c250d1a273a35c1a0933cb6a9a264267f56bbdcf50fbcc6737fd164d6\": container with ID starting with cab4319c250d1a273a35c1a0933cb6a9a264267f56bbdcf50fbcc6737fd164d6 not found: ID does not exist"
Jul 08 22:56:27.657652 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:27.657632    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l4gph"]
Jul 08 22:56:27.660798 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:27.660778    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l4gph"]
Jul 08 22:56:29.501742 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:29.501699    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23fcccf4-05ad-43c6-b426-4b0604abee22" path="/var/lib/kubelet/pods/23fcccf4-05ad-43c6-b426-4b0604abee22/volumes"
Jul 08 22:56:34.234092 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:34.234042    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8qvtg"
Jul 08 22:56:34.234594 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:34.234120    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8qvtg"
Jul 08 22:56:34.256092 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:34.256068    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8qvtg"
Jul 08 22:56:34.691677 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:34.691650    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8qvtg"
Jul 08 22:56:38.703905 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:38.703870    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj"]
Jul 08 22:56:38.704332 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:38.704175    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23fcccf4-05ad-43c6-b426-4b0604abee22" containerName="registry-server"
Jul 08 22:56:38.704332 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:38.704188    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="23fcccf4-05ad-43c6-b426-4b0604abee22" containerName="registry-server"
Jul 08 22:56:38.704332 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:38.704236    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="23fcccf4-05ad-43c6-b426-4b0604abee22" containerName="registry-server"
Jul 08 22:56:38.707317 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:38.707303    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj"
Jul 08 22:56:38.710103 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:38.710080    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qjss4\""
Jul 08 22:56:38.715432 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:38.715401    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj"]
Jul 08 22:56:38.833447 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:38.833410    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57a4640a-cffb-4320-9ffa-95f17a5e5d83-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj\" (UID: \"57a4640a-cffb-4320-9ffa-95f17a5e5d83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj"
Jul 08 22:56:38.833609 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:38.833468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b88xj\" (UniqueName: \"kubernetes.io/projected/57a4640a-cffb-4320-9ffa-95f17a5e5d83-kube-api-access-b88xj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj\" (UID: \"57a4640a-cffb-4320-9ffa-95f17a5e5d83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj"
Jul 08 22:56:38.833609 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:38.833522    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57a4640a-cffb-4320-9ffa-95f17a5e5d83-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj\" (UID: \"57a4640a-cffb-4320-9ffa-95f17a5e5d83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj"
Jul 08 22:56:38.934494 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:38.934456    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57a4640a-cffb-4320-9ffa-95f17a5e5d83-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj\" (UID: \"57a4640a-cffb-4320-9ffa-95f17a5e5d83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj"
Jul 08 22:56:38.934651 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:38.934512    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57a4640a-cffb-4320-9ffa-95f17a5e5d83-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj\" (UID: \"57a4640a-cffb-4320-9ffa-95f17a5e5d83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj"
Jul 08 22:56:38.934651 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:38.934552    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b88xj\" (UniqueName: \"kubernetes.io/projected/57a4640a-cffb-4320-9ffa-95f17a5e5d83-kube-api-access-b88xj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj\" (UID: \"57a4640a-cffb-4320-9ffa-95f17a5e5d83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj"
Jul 08 22:56:38.934913 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:38.934892    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57a4640a-cffb-4320-9ffa-95f17a5e5d83-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj\" (UID: \"57a4640a-cffb-4320-9ffa-95f17a5e5d83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj"
Jul 08 22:56:38.934913 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:38.934902    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57a4640a-cffb-4320-9ffa-95f17a5e5d83-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj\" (UID: \"57a4640a-cffb-4320-9ffa-95f17a5e5d83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj"
Jul 08 22:56:38.943392 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:38.943369    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b88xj\" (UniqueName: \"kubernetes.io/projected/57a4640a-cffb-4320-9ffa-95f17a5e5d83-kube-api-access-b88xj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj\" (UID: \"57a4640a-cffb-4320-9ffa-95f17a5e5d83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj"
Jul 08 22:56:39.016250 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.016156    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj"
Jul 08 22:56:39.146332 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.146293    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj"]
Jul 08 22:56:39.148613 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:56:39.148586    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57a4640a_cffb_4320_9ffa_95f17a5e5d83.slice/crio-de32633409d7196f33716d44e96d28b2f6d408ccd960abc9cf28443a6ffe1449 WatchSource:0}: Error finding container de32633409d7196f33716d44e96d28b2f6d408ccd960abc9cf28443a6ffe1449: Status 404 returned error can't find the container with id de32633409d7196f33716d44e96d28b2f6d408ccd960abc9cf28443a6ffe1449
Jul 08 22:56:39.304286 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.304191    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8"]
Jul 08 22:56:39.307581 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.307557    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8"
Jul 08 22:56:39.316522 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.316496    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8"]
Jul 08 22:56:39.337672 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.337642    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d389063-cb2c-44bc-8f3d-95eec45728a0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8\" (UID: \"9d389063-cb2c-44bc-8f3d-95eec45728a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8"
Jul 08 22:56:39.337872 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.337677    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km5ns\" (UniqueName: \"kubernetes.io/projected/9d389063-cb2c-44bc-8f3d-95eec45728a0-kube-api-access-km5ns\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8\" (UID: \"9d389063-cb2c-44bc-8f3d-95eec45728a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8"
Jul 08 22:56:39.337872 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.337765    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d389063-cb2c-44bc-8f3d-95eec45728a0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8\" (UID: \"9d389063-cb2c-44bc-8f3d-95eec45728a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8"
Jul 08 22:56:39.438704 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.438662    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d389063-cb2c-44bc-8f3d-95eec45728a0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8\" (UID: \"9d389063-cb2c-44bc-8f3d-95eec45728a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8"
Jul 08 22:56:39.438894 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.438724    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km5ns\" (UniqueName: \"kubernetes.io/projected/9d389063-cb2c-44bc-8f3d-95eec45728a0-kube-api-access-km5ns\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8\" (UID: \"9d389063-cb2c-44bc-8f3d-95eec45728a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8"
Jul 08 22:56:39.438894 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.438767    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d389063-cb2c-44bc-8f3d-95eec45728a0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8\" (UID: \"9d389063-cb2c-44bc-8f3d-95eec45728a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8"
Jul 08 22:56:39.439105 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.439081    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d389063-cb2c-44bc-8f3d-95eec45728a0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8\" (UID: \"9d389063-cb2c-44bc-8f3d-95eec45728a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8"
Jul 08 22:56:39.439158 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.439147    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d389063-cb2c-44bc-8f3d-95eec45728a0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8\" (UID: \"9d389063-cb2c-44bc-8f3d-95eec45728a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8"
Jul 08 22:56:39.452428 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.452401    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-km5ns\" (UniqueName: \"kubernetes.io/projected/9d389063-cb2c-44bc-8f3d-95eec45728a0-kube-api-access-km5ns\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8\" (UID: \"9d389063-cb2c-44bc-8f3d-95eec45728a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8"
Jul 08 22:56:39.617031 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.617007    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8"
Jul 08 22:56:39.695480 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.695405    2574 generic.go:356] "Generic (PLEG): container finished" podID="57a4640a-cffb-4320-9ffa-95f17a5e5d83" containerID="627868dab9fca71715d9fdab94530792f17a05fb18bb46edae52cf21a4f38fcf" exitCode=0
Jul 08 22:56:39.695623 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.695480    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj" event={"ID":"57a4640a-cffb-4320-9ffa-95f17a5e5d83","Type":"ContainerDied","Data":"627868dab9fca71715d9fdab94530792f17a05fb18bb46edae52cf21a4f38fcf"}
Jul 08 22:56:39.695623 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.695534    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj" event={"ID":"57a4640a-cffb-4320-9ffa-95f17a5e5d83","Type":"ContainerStarted","Data":"de32633409d7196f33716d44e96d28b2f6d408ccd960abc9cf28443a6ffe1449"}
Jul 08 22:56:39.750596 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.750569    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8"]
Jul 08 22:56:39.752048 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:56:39.752020    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d389063_cb2c_44bc_8f3d_95eec45728a0.slice/crio-acbb587c4dd6cc1be51c851ea07913e960d9ed19c03489190d2c07d77d2d132c WatchSource:0}: Error finding container acbb587c4dd6cc1be51c851ea07913e960d9ed19c03489190d2c07d77d2d132c: Status 404 returned error can't find the container with id acbb587c4dd6cc1be51c851ea07913e960d9ed19c03489190d2c07d77d2d132c
Jul 08 22:56:39.908100 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.908029    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d"]
Jul 08 22:56:39.911212 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.911196    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d"
Jul 08 22:56:39.921394 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.921368    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d"]
Jul 08 22:56:39.942662 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.942637    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gmrl\" (UniqueName: \"kubernetes.io/projected/6f996e62-e3bc-4779-985f-9469aa177d14-kube-api-access-7gmrl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d\" (UID: \"6f996e62-e3bc-4779-985f-9469aa177d14\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d"
Jul 08 22:56:39.942819 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.942706    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f996e62-e3bc-4779-985f-9469aa177d14-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d\" (UID: \"6f996e62-e3bc-4779-985f-9469aa177d14\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d"
Jul 08 22:56:39.942819 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:39.942756    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f996e62-e3bc-4779-985f-9469aa177d14-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d\" (UID: \"6f996e62-e3bc-4779-985f-9469aa177d14\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d"
Jul 08 22:56:40.043370 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.043337    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gmrl\" (UniqueName: \"kubernetes.io/projected/6f996e62-e3bc-4779-985f-9469aa177d14-kube-api-access-7gmrl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d\" (UID: \"6f996e62-e3bc-4779-985f-9469aa177d14\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d"
Jul 08 22:56:40.043370 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.043378    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f996e62-e3bc-4779-985f-9469aa177d14-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d\" (UID: \"6f996e62-e3bc-4779-985f-9469aa177d14\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d"
Jul 08 22:56:40.043619 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.043403    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f996e62-e3bc-4779-985f-9469aa177d14-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d\" (UID: \"6f996e62-e3bc-4779-985f-9469aa177d14\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d"
Jul 08 22:56:40.043777 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.043759    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f996e62-e3bc-4779-985f-9469aa177d14-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d\" (UID: \"6f996e62-e3bc-4779-985f-9469aa177d14\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d"
Jul 08 22:56:40.043865 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.043805    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f996e62-e3bc-4779-985f-9469aa177d14-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d\" (UID: \"6f996e62-e3bc-4779-985f-9469aa177d14\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d"
Jul 08 22:56:40.052093 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.052074    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gmrl\" (UniqueName: \"kubernetes.io/projected/6f996e62-e3bc-4779-985f-9469aa177d14-kube-api-access-7gmrl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d\" (UID: \"6f996e62-e3bc-4779-985f-9469aa177d14\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d"
Jul 08 22:56:40.219841 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.219743    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d"
Jul 08 22:56:40.303034 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.303007    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn"]
Jul 08 22:56:40.307529 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.307506    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn"
Jul 08 22:56:40.318909 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.318883    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn"]
Jul 08 22:56:40.351231 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.347140    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c74ce02-e122-488d-a87e-da70ea922395-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn\" (UID: \"7c74ce02-e122-488d-a87e-da70ea922395\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn"
Jul 08 22:56:40.351231 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.347252    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69mzj\" (UniqueName: \"kubernetes.io/projected/7c74ce02-e122-488d-a87e-da70ea922395-kube-api-access-69mzj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn\" (UID: \"7c74ce02-e122-488d-a87e-da70ea922395\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn"
Jul 08 22:56:40.351231 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.347349    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c74ce02-e122-488d-a87e-da70ea922395-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn\" (UID: \"7c74ce02-e122-488d-a87e-da70ea922395\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn"
Jul 08 22:56:40.355908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.355884    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d"]
Jul 08 22:56:40.357563 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:56:40.357534    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f996e62_e3bc_4779_985f_9469aa177d14.slice/crio-94f3d20fa70c9c5b08edb0ca3c1a6acdd06021bcf7a5ec77f478bd0abb2a8f65 WatchSource:0}: Error finding container 94f3d20fa70c9c5b08edb0ca3c1a6acdd06021bcf7a5ec77f478bd0abb2a8f65: Status 404 returned error can't find the container with id 94f3d20fa70c9c5b08edb0ca3c1a6acdd06021bcf7a5ec77f478bd0abb2a8f65
Jul 08 22:56:40.448816 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.448789    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69mzj\" (UniqueName: \"kubernetes.io/projected/7c74ce02-e122-488d-a87e-da70ea922395-kube-api-access-69mzj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn\" (UID: \"7c74ce02-e122-488d-a87e-da70ea922395\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn"
Jul 08 22:56:40.448908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.448870    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c74ce02-e122-488d-a87e-da70ea922395-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn\" (UID: \"7c74ce02-e122-488d-a87e-da70ea922395\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn"
Jul 08 22:56:40.448908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.448901    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c74ce02-e122-488d-a87e-da70ea922395-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn\" (UID: \"7c74ce02-e122-488d-a87e-da70ea922395\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn"
Jul 08 22:56:40.449270 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.449250    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c74ce02-e122-488d-a87e-da70ea922395-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn\" (UID: \"7c74ce02-e122-488d-a87e-da70ea922395\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn"
Jul 08 22:56:40.449332 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.449302    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c74ce02-e122-488d-a87e-da70ea922395-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn\" (UID: \"7c74ce02-e122-488d-a87e-da70ea922395\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn"
Jul 08 22:56:40.457366 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.457340    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69mzj\" (UniqueName: \"kubernetes.io/projected/7c74ce02-e122-488d-a87e-da70ea922395-kube-api-access-69mzj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn\" (UID: \"7c74ce02-e122-488d-a87e-da70ea922395\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn"
Jul 08 22:56:40.619990 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.619967    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn"
Jul 08 22:56:40.703061 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.703024    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj" event={"ID":"57a4640a-cffb-4320-9ffa-95f17a5e5d83","Type":"ContainerStarted","Data":"ec0b2907f076ef7360ef48285acff77050b0cc5e5e0b387db19111c6b1d12e69"}
Jul 08 22:56:40.704734 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.704708    2574 generic.go:356] "Generic (PLEG): container finished" podID="6f996e62-e3bc-4779-985f-9469aa177d14" containerID="30bdc211acc7e10b24d8d8281e07e7ac2896b49dec135a4594b094aa2b42edda" exitCode=0
Jul 08 22:56:40.704849 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.704821    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d" event={"ID":"6f996e62-e3bc-4779-985f-9469aa177d14","Type":"ContainerDied","Data":"30bdc211acc7e10b24d8d8281e07e7ac2896b49dec135a4594b094aa2b42edda"}
Jul 08 22:56:40.704914 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.704878    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d" event={"ID":"6f996e62-e3bc-4779-985f-9469aa177d14","Type":"ContainerStarted","Data":"94f3d20fa70c9c5b08edb0ca3c1a6acdd06021bcf7a5ec77f478bd0abb2a8f65"}
Jul 08 22:56:40.708167 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.707959    2574 generic.go:356] "Generic (PLEG): container finished" podID="9d389063-cb2c-44bc-8f3d-95eec45728a0" containerID="4c252bc2e6e833b9581faaa5b9f5b4170390f5e0314a554206370f37fcad5dd4" exitCode=0
Jul 08 22:56:40.708167 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.707993    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8" event={"ID":"9d389063-cb2c-44bc-8f3d-95eec45728a0","Type":"ContainerDied","Data":"4c252bc2e6e833b9581faaa5b9f5b4170390f5e0314a554206370f37fcad5dd4"}
Jul 08 22:56:40.708167 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.708044    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8" event={"ID":"9d389063-cb2c-44bc-8f3d-95eec45728a0","Type":"ContainerStarted","Data":"acbb587c4dd6cc1be51c851ea07913e960d9ed19c03489190d2c07d77d2d132c"}
Jul 08 22:56:40.758771 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:40.758647    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn"]
Jul 08 22:56:40.761916 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:56:40.761891    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c74ce02_e122_488d_a87e_da70ea922395.slice/crio-2cf346af8f224e8b3e24e867a9db05b0ae7f1c1db742cac3188439707f48f110 WatchSource:0}: Error finding container 2cf346af8f224e8b3e24e867a9db05b0ae7f1c1db742cac3188439707f48f110: Status 404 returned error can't find the container with id 2cf346af8f224e8b3e24e867a9db05b0ae7f1c1db742cac3188439707f48f110
Jul 08 22:56:41.714825 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:41.714788    2574 generic.go:356] "Generic (PLEG): container finished" podID="9d389063-cb2c-44bc-8f3d-95eec45728a0" containerID="2617215a866b8bb6dd89067cfb2b212f599c28bdadcc36d937d8dfe6d0e758c7" exitCode=0
Jul 08 22:56:41.714971 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:41.714866    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8" event={"ID":"9d389063-cb2c-44bc-8f3d-95eec45728a0","Type":"ContainerDied","Data":"2617215a866b8bb6dd89067cfb2b212f599c28bdadcc36d937d8dfe6d0e758c7"}
Jul 08 22:56:41.716668 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:41.716646    2574 generic.go:356] "Generic (PLEG): container finished" podID="57a4640a-cffb-4320-9ffa-95f17a5e5d83" containerID="ec0b2907f076ef7360ef48285acff77050b0cc5e5e0b387db19111c6b1d12e69" exitCode=0
Jul 08 22:56:41.716775 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:41.716716    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj" event={"ID":"57a4640a-cffb-4320-9ffa-95f17a5e5d83","Type":"ContainerDied","Data":"ec0b2907f076ef7360ef48285acff77050b0cc5e5e0b387db19111c6b1d12e69"}
Jul 08 22:56:41.718476 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:41.718451    2574 generic.go:356] "Generic (PLEG): container finished" podID="6f996e62-e3bc-4779-985f-9469aa177d14" containerID="5bae7081455dce1b957cae8f0db6665287a1a1a5d73f29dd5321cc320a6a2d71" exitCode=0
Jul 08 22:56:41.718562 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:41.718528    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d" event={"ID":"6f996e62-e3bc-4779-985f-9469aa177d14","Type":"ContainerDied","Data":"5bae7081455dce1b957cae8f0db6665287a1a1a5d73f29dd5321cc320a6a2d71"}
Jul 08 22:56:41.720136 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:41.720119    2574 generic.go:356] "Generic (PLEG): container finished" podID="7c74ce02-e122-488d-a87e-da70ea922395" containerID="08b558730c7fbbc72afa366d99a7572c49354f878494b86067270bcbf9e1b65b" exitCode=0
Jul 08 22:56:41.720228 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:41.720173    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn" event={"ID":"7c74ce02-e122-488d-a87e-da70ea922395","Type":"ContainerDied","Data":"08b558730c7fbbc72afa366d99a7572c49354f878494b86067270bcbf9e1b65b"}
Jul 08 22:56:41.720228 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:41.720198    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn" event={"ID":"7c74ce02-e122-488d-a87e-da70ea922395","Type":"ContainerStarted","Data":"2cf346af8f224e8b3e24e867a9db05b0ae7f1c1db742cac3188439707f48f110"}
Jul 08 22:56:42.733700 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:42.733572    2574 generic.go:356] "Generic (PLEG): container finished" podID="57a4640a-cffb-4320-9ffa-95f17a5e5d83" containerID="4b1b1d3710211024d2c4d0e7a8acb695515d2c3be81acacb8f5fc89b1d81940a" exitCode=0
Jul 08 22:56:42.733700 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:42.733657    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj" event={"ID":"57a4640a-cffb-4320-9ffa-95f17a5e5d83","Type":"ContainerDied","Data":"4b1b1d3710211024d2c4d0e7a8acb695515d2c3be81acacb8f5fc89b1d81940a"}
Jul 08 22:56:42.735980 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:42.735953    2574 generic.go:356] "Generic (PLEG): container finished" podID="6f996e62-e3bc-4779-985f-9469aa177d14" containerID="e7c310cd42cc74337e4423316e603f1b1cef1bc68669449080267ac9dba0a1e8" exitCode=0
Jul 08 22:56:42.736123 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:42.736025    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d" event={"ID":"6f996e62-e3bc-4779-985f-9469aa177d14","Type":"ContainerDied","Data":"e7c310cd42cc74337e4423316e603f1b1cef1bc68669449080267ac9dba0a1e8"}
Jul 08 22:56:42.738062 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:42.738036    2574 generic.go:356] "Generic (PLEG): container finished" podID="7c74ce02-e122-488d-a87e-da70ea922395" containerID="347c090e3fb610830aed786c826b8ee632a070246acc8252cdfcb69cabf98156" exitCode=0
Jul 08 22:56:42.738185 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:42.738126    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn" event={"ID":"7c74ce02-e122-488d-a87e-da70ea922395","Type":"ContainerDied","Data":"347c090e3fb610830aed786c826b8ee632a070246acc8252cdfcb69cabf98156"}
Jul 08 22:56:42.740587 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:42.740562    2574 generic.go:356] "Generic (PLEG): container finished" podID="9d389063-cb2c-44bc-8f3d-95eec45728a0" containerID="9aa086be9c485a916d22a613ea08817733f01afa7480478d941b006a2a44540b" exitCode=0
Jul 08 22:56:42.740716 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:42.740652    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8" event={"ID":"9d389063-cb2c-44bc-8f3d-95eec45728a0","Type":"ContainerDied","Data":"9aa086be9c485a916d22a613ea08817733f01afa7480478d941b006a2a44540b"}
Jul 08 22:56:43.747463 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.747431    2574 generic.go:356] "Generic (PLEG): container finished" podID="7c74ce02-e122-488d-a87e-da70ea922395" containerID="bf88256473daf380dc3110171c53cb81b4c29a938f2d0dea17408f1499aceb04" exitCode=0
Jul 08 22:56:43.747847 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.747512    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn" event={"ID":"7c74ce02-e122-488d-a87e-da70ea922395","Type":"ContainerDied","Data":"bf88256473daf380dc3110171c53cb81b4c29a938f2d0dea17408f1499aceb04"}
Jul 08 22:56:43.894667 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.894638    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8"
Jul 08 22:56:43.932988 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.932963    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d"
Jul 08 22:56:43.935086 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.935067    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj"
Jul 08 22:56:43.979578 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.979549    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57a4640a-cffb-4320-9ffa-95f17a5e5d83-util\") pod \"57a4640a-cffb-4320-9ffa-95f17a5e5d83\" (UID: \"57a4640a-cffb-4320-9ffa-95f17a5e5d83\") "
Jul 08 22:56:43.979790 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.979601    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b88xj\" (UniqueName: \"kubernetes.io/projected/57a4640a-cffb-4320-9ffa-95f17a5e5d83-kube-api-access-b88xj\") pod \"57a4640a-cffb-4320-9ffa-95f17a5e5d83\" (UID: \"57a4640a-cffb-4320-9ffa-95f17a5e5d83\") "
Jul 08 22:56:43.979790 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.979630    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f996e62-e3bc-4779-985f-9469aa177d14-util\") pod \"6f996e62-e3bc-4779-985f-9469aa177d14\" (UID: \"6f996e62-e3bc-4779-985f-9469aa177d14\") "
Jul 08 22:56:43.979790 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.979669    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f996e62-e3bc-4779-985f-9469aa177d14-bundle\") pod \"6f996e62-e3bc-4779-985f-9469aa177d14\" (UID: \"6f996e62-e3bc-4779-985f-9469aa177d14\") "
Jul 08 22:56:43.979790 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.979759    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d389063-cb2c-44bc-8f3d-95eec45728a0-util\") pod \"9d389063-cb2c-44bc-8f3d-95eec45728a0\" (UID: \"9d389063-cb2c-44bc-8f3d-95eec45728a0\") "
Jul 08 22:56:43.979994 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.979791    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gmrl\" (UniqueName: \"kubernetes.io/projected/6f996e62-e3bc-4779-985f-9469aa177d14-kube-api-access-7gmrl\") pod \"6f996e62-e3bc-4779-985f-9469aa177d14\" (UID: \"6f996e62-e3bc-4779-985f-9469aa177d14\") "
Jul 08 22:56:43.979994 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.979817    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-km5ns\" (UniqueName: \"kubernetes.io/projected/9d389063-cb2c-44bc-8f3d-95eec45728a0-kube-api-access-km5ns\") pod \"9d389063-cb2c-44bc-8f3d-95eec45728a0\" (UID: \"9d389063-cb2c-44bc-8f3d-95eec45728a0\") "
Jul 08 22:56:43.979994 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.979841    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d389063-cb2c-44bc-8f3d-95eec45728a0-bundle\") pod \"9d389063-cb2c-44bc-8f3d-95eec45728a0\" (UID: \"9d389063-cb2c-44bc-8f3d-95eec45728a0\") "
Jul 08 22:56:43.979994 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.979866    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57a4640a-cffb-4320-9ffa-95f17a5e5d83-bundle\") pod \"57a4640a-cffb-4320-9ffa-95f17a5e5d83\" (UID: \"57a4640a-cffb-4320-9ffa-95f17a5e5d83\") "
Jul 08 22:56:43.980507 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.980480    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a4640a-cffb-4320-9ffa-95f17a5e5d83-bundle" (OuterVolumeSpecName: "bundle") pod "57a4640a-cffb-4320-9ffa-95f17a5e5d83" (UID: "57a4640a-cffb-4320-9ffa-95f17a5e5d83"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:56:43.981062 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.981032    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f996e62-e3bc-4779-985f-9469aa177d14-bundle" (OuterVolumeSpecName: "bundle") pod "6f996e62-e3bc-4779-985f-9469aa177d14" (UID: "6f996e62-e3bc-4779-985f-9469aa177d14"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:56:43.981176 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.981129    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d389063-cb2c-44bc-8f3d-95eec45728a0-bundle" (OuterVolumeSpecName: "bundle") pod "9d389063-cb2c-44bc-8f3d-95eec45728a0" (UID: "9d389063-cb2c-44bc-8f3d-95eec45728a0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:56:43.982394 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.982364    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57a4640a-cffb-4320-9ffa-95f17a5e5d83-kube-api-access-b88xj" (OuterVolumeSpecName: "kube-api-access-b88xj") pod "57a4640a-cffb-4320-9ffa-95f17a5e5d83" (UID: "57a4640a-cffb-4320-9ffa-95f17a5e5d83"). InnerVolumeSpecName "kube-api-access-b88xj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:56:43.982714 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.982676    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f996e62-e3bc-4779-985f-9469aa177d14-kube-api-access-7gmrl" (OuterVolumeSpecName: "kube-api-access-7gmrl") pod "6f996e62-e3bc-4779-985f-9469aa177d14" (UID: "6f996e62-e3bc-4779-985f-9469aa177d14"). InnerVolumeSpecName "kube-api-access-7gmrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:56:43.984195 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.984164    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d389063-cb2c-44bc-8f3d-95eec45728a0-kube-api-access-km5ns" (OuterVolumeSpecName: "kube-api-access-km5ns") pod "9d389063-cb2c-44bc-8f3d-95eec45728a0" (UID: "9d389063-cb2c-44bc-8f3d-95eec45728a0"). InnerVolumeSpecName "kube-api-access-km5ns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:56:43.986834 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.986796    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d389063-cb2c-44bc-8f3d-95eec45728a0-util" (OuterVolumeSpecName: "util") pod "9d389063-cb2c-44bc-8f3d-95eec45728a0" (UID: "9d389063-cb2c-44bc-8f3d-95eec45728a0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:56:43.987621 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.987600    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f996e62-e3bc-4779-985f-9469aa177d14-util" (OuterVolumeSpecName: "util") pod "6f996e62-e3bc-4779-985f-9469aa177d14" (UID: "6f996e62-e3bc-4779-985f-9469aa177d14"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:56:43.989382 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:43.989360    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a4640a-cffb-4320-9ffa-95f17a5e5d83-util" (OuterVolumeSpecName: "util") pod "57a4640a-cffb-4320-9ffa-95f17a5e5d83" (UID: "57a4640a-cffb-4320-9ffa-95f17a5e5d83"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:56:44.081260 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.081177    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f996e62-e3bc-4779-985f-9469aa177d14-bundle\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:56:44.081260 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.081205    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d389063-cb2c-44bc-8f3d-95eec45728a0-util\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:56:44.081260 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.081214    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gmrl\" (UniqueName: \"kubernetes.io/projected/6f996e62-e3bc-4779-985f-9469aa177d14-kube-api-access-7gmrl\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:56:44.081260 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.081222    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-km5ns\" (UniqueName: \"kubernetes.io/projected/9d389063-cb2c-44bc-8f3d-95eec45728a0-kube-api-access-km5ns\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:56:44.081260 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.081232    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d389063-cb2c-44bc-8f3d-95eec45728a0-bundle\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:56:44.081260 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.081240    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57a4640a-cffb-4320-9ffa-95f17a5e5d83-bundle\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:56:44.081260 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.081247    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57a4640a-cffb-4320-9ffa-95f17a5e5d83-util\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:56:44.081260 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.081255    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b88xj\" (UniqueName: \"kubernetes.io/projected/57a4640a-cffb-4320-9ffa-95f17a5e5d83-kube-api-access-b88xj\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:56:44.081260 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.081262    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f996e62-e3bc-4779-985f-9469aa177d14-util\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:56:44.753843 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.753806    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj" event={"ID":"57a4640a-cffb-4320-9ffa-95f17a5e5d83","Type":"ContainerDied","Data":"de32633409d7196f33716d44e96d28b2f6d408ccd960abc9cf28443a6ffe1449"}
Jul 08 22:56:44.754290 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.753857    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de32633409d7196f33716d44e96d28b2f6d408ccd960abc9cf28443a6ffe1449"
Jul 08 22:56:44.754290 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.753816    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj"
Jul 08 22:56:44.755696 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.755662    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d"
Jul 08 22:56:44.755832 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.755712    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d" event={"ID":"6f996e62-e3bc-4779-985f-9469aa177d14","Type":"ContainerDied","Data":"94f3d20fa70c9c5b08edb0ca3c1a6acdd06021bcf7a5ec77f478bd0abb2a8f65"}
Jul 08 22:56:44.755832 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.755747    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94f3d20fa70c9c5b08edb0ca3c1a6acdd06021bcf7a5ec77f478bd0abb2a8f65"
Jul 08 22:56:44.757640 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.757621    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8"
Jul 08 22:56:44.757741 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.757638    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8" event={"ID":"9d389063-cb2c-44bc-8f3d-95eec45728a0","Type":"ContainerDied","Data":"acbb587c4dd6cc1be51c851ea07913e960d9ed19c03489190d2c07d77d2d132c"}
Jul 08 22:56:44.757741 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.757673    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acbb587c4dd6cc1be51c851ea07913e960d9ed19c03489190d2c07d77d2d132c"
Jul 08 22:56:44.891565 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.891543    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn"
Jul 08 22:56:44.987621 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.987589    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69mzj\" (UniqueName: \"kubernetes.io/projected/7c74ce02-e122-488d-a87e-da70ea922395-kube-api-access-69mzj\") pod \"7c74ce02-e122-488d-a87e-da70ea922395\" (UID: \"7c74ce02-e122-488d-a87e-da70ea922395\") "
Jul 08 22:56:44.987800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.987714    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c74ce02-e122-488d-a87e-da70ea922395-bundle\") pod \"7c74ce02-e122-488d-a87e-da70ea922395\" (UID: \"7c74ce02-e122-488d-a87e-da70ea922395\") "
Jul 08 22:56:44.987800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.987744    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c74ce02-e122-488d-a87e-da70ea922395-util\") pod \"7c74ce02-e122-488d-a87e-da70ea922395\" (UID: \"7c74ce02-e122-488d-a87e-da70ea922395\") "
Jul 08 22:56:44.988248 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.988206    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c74ce02-e122-488d-a87e-da70ea922395-bundle" (OuterVolumeSpecName: "bundle") pod "7c74ce02-e122-488d-a87e-da70ea922395" (UID: "7c74ce02-e122-488d-a87e-da70ea922395"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:56:44.989558 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.989536    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c74ce02-e122-488d-a87e-da70ea922395-kube-api-access-69mzj" (OuterVolumeSpecName: "kube-api-access-69mzj") pod "7c74ce02-e122-488d-a87e-da70ea922395" (UID: "7c74ce02-e122-488d-a87e-da70ea922395"). InnerVolumeSpecName "kube-api-access-69mzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:56:44.992882 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:44.992854    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c74ce02-e122-488d-a87e-da70ea922395-util" (OuterVolumeSpecName: "util") pod "7c74ce02-e122-488d-a87e-da70ea922395" (UID: "7c74ce02-e122-488d-a87e-da70ea922395"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:56:45.089266 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:45.089189    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c74ce02-e122-488d-a87e-da70ea922395-bundle\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:56:45.089266 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:45.089214    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c74ce02-e122-488d-a87e-da70ea922395-util\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:56:45.089266 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:45.089223    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69mzj\" (UniqueName: \"kubernetes.io/projected/7c74ce02-e122-488d-a87e-da70ea922395-kube-api-access-69mzj\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:56:45.763935 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:45.763853    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn"
Jul 08 22:56:45.763935 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:45.763868    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn" event={"ID":"7c74ce02-e122-488d-a87e-da70ea922395","Type":"ContainerDied","Data":"2cf346af8f224e8b3e24e867a9db05b0ae7f1c1db742cac3188439707f48f110"}
Jul 08 22:56:45.763935 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:45.763910    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cf346af8f224e8b3e24e867a9db05b0ae7f1c1db742cac3188439707f48f110"
Jul 08 22:56:56.021441 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021404    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nvmvt"]
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021703    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57a4640a-cffb-4320-9ffa-95f17a5e5d83" containerName="util"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021716    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="57a4640a-cffb-4320-9ffa-95f17a5e5d83" containerName="util"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021726    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c74ce02-e122-488d-a87e-da70ea922395" containerName="extract"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021733    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c74ce02-e122-488d-a87e-da70ea922395" containerName="extract"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021744    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d389063-cb2c-44bc-8f3d-95eec45728a0" containerName="pull"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021750    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d389063-cb2c-44bc-8f3d-95eec45728a0" containerName="pull"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021758    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d389063-cb2c-44bc-8f3d-95eec45728a0" containerName="extract"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021764    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d389063-cb2c-44bc-8f3d-95eec45728a0" containerName="extract"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021769    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c74ce02-e122-488d-a87e-da70ea922395" containerName="pull"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021774    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c74ce02-e122-488d-a87e-da70ea922395" containerName="pull"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021781    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f996e62-e3bc-4779-985f-9469aa177d14" containerName="pull"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021785    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f996e62-e3bc-4779-985f-9469aa177d14" containerName="pull"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021792    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57a4640a-cffb-4320-9ffa-95f17a5e5d83" containerName="pull"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021796    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="57a4640a-cffb-4320-9ffa-95f17a5e5d83" containerName="pull"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021803    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d389063-cb2c-44bc-8f3d-95eec45728a0" containerName="util"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021808    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d389063-cb2c-44bc-8f3d-95eec45728a0" containerName="util"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021813    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f996e62-e3bc-4779-985f-9469aa177d14" containerName="extract"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021817    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f996e62-e3bc-4779-985f-9469aa177d14" containerName="extract"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021826    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f996e62-e3bc-4779-985f-9469aa177d14" containerName="util"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021830    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f996e62-e3bc-4779-985f-9469aa177d14" containerName="util"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021837    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57a4640a-cffb-4320-9ffa-95f17a5e5d83" containerName="extract"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021843    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="57a4640a-cffb-4320-9ffa-95f17a5e5d83" containerName="extract"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021848    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c74ce02-e122-488d-a87e-da70ea922395" containerName="util"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021853    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c74ce02-e122-488d-a87e-da70ea922395" containerName="util"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021896    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f996e62-e3bc-4779-985f-9469aa177d14" containerName="extract"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021904    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d389063-cb2c-44bc-8f3d-95eec45728a0" containerName="extract"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021913    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="57a4640a-cffb-4320-9ffa-95f17a5e5d83" containerName="extract"
Jul 08 22:56:56.021908 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.021918    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c74ce02-e122-488d-a87e-da70ea922395" containerName="extract"
Jul 08 22:56:56.026157 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.026138    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvmvt"
Jul 08 22:56:56.029931 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.029904    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-kq7c2\""
Jul 08 22:56:56.053501 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.053465    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nvmvt"]
Jul 08 22:56:56.084537 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.084498    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtqls\" (UniqueName: \"kubernetes.io/projected/caed00df-5082-4dbd-bc5e-0fec788c93c2-kube-api-access-jtqls\") pod \"authorino-operator-75cc8d5cb7-nvmvt\" (UID: \"caed00df-5082-4dbd-bc5e-0fec788c93c2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvmvt"
Jul 08 22:56:56.185679 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.185642    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtqls\" (UniqueName: \"kubernetes.io/projected/caed00df-5082-4dbd-bc5e-0fec788c93c2-kube-api-access-jtqls\") pod \"authorino-operator-75cc8d5cb7-nvmvt\" (UID: \"caed00df-5082-4dbd-bc5e-0fec788c93c2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvmvt"
Jul 08 22:56:56.195211 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.195185    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtqls\" (UniqueName: \"kubernetes.io/projected/caed00df-5082-4dbd-bc5e-0fec788c93c2-kube-api-access-jtqls\") pod \"authorino-operator-75cc8d5cb7-nvmvt\" (UID: \"caed00df-5082-4dbd-bc5e-0fec788c93c2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvmvt"
Jul 08 22:56:56.335791 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.335675    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvmvt"
Jul 08 22:56:56.467416 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.467392    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nvmvt"]
Jul 08 22:56:56.469364 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:56:56.469337    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaed00df_5082_4dbd_bc5e_0fec788c93c2.slice/crio-16af1738608b99465e5e061535652bfaf2053fd1a03a1a669c32cc9aebb47e31 WatchSource:0}: Error finding container 16af1738608b99465e5e061535652bfaf2053fd1a03a1a669c32cc9aebb47e31: Status 404 returned error can't find the container with id 16af1738608b99465e5e061535652bfaf2053fd1a03a1a669c32cc9aebb47e31
Jul 08 22:56:56.816981 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:56.816934    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvmvt" event={"ID":"caed00df-5082-4dbd-bc5e-0fec788c93c2","Type":"ContainerStarted","Data":"16af1738608b99465e5e061535652bfaf2053fd1a03a1a669c32cc9aebb47e31"}
Jul 08 22:56:58.866133 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:58.866097    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86d977f7bd-9xxv7"]
Jul 08 22:56:58.869448 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:58.869429    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:58.880298 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:58.880274    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d977f7bd-9xxv7"]
Jul 08 22:56:59.011655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.011619    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-console-serving-cert\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.011655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.011657    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-console-oauth-config\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.011882 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.011715    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7g7r\" (UniqueName: \"kubernetes.io/projected/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-kube-api-access-j7g7r\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.011882 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.011794    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-service-ca\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.011882 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.011836    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-console-config\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.011882 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.011863    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-trusted-ca-bundle\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.012010 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.011884    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-oauth-serving-cert\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.112714 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.112605    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-console-oauth-config\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.112714 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.112659    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7g7r\" (UniqueName: \"kubernetes.io/projected/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-kube-api-access-j7g7r\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.112971 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.112723    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-service-ca\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.112971 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.112754    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-console-config\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.112971 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.112776    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-trusted-ca-bundle\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.112971 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.112796    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-oauth-serving-cert\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.112971 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.112827    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-console-serving-cert\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.113564 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.113541    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-oauth-serving-cert\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.113652 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.113568    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-service-ca\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.113741 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.113666    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-trusted-ca-bundle\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.113780 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.113729    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-console-config\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.115382 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.115358    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-console-serving-cert\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.115433 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.115396    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-console-oauth-config\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.121036 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.121017    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7g7r\" (UniqueName: \"kubernetes.io/projected/869b44ea-05e1-4b2f-9c1d-c0affcfc6d61-kube-api-access-j7g7r\") pod \"console-86d977f7bd-9xxv7\" (UID: \"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61\") " pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.179112 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.179070    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:56:59.311459 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.311427    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d977f7bd-9xxv7"]
Jul 08 22:56:59.314298 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:56:59.314269    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod869b44ea_05e1_4b2f_9c1d_c0affcfc6d61.slice/crio-1fc12938dd889b8fa30138760dac01146a72e0c49eebd49b7920b0d12cab8e0c WatchSource:0}: Error finding container 1fc12938dd889b8fa30138760dac01146a72e0c49eebd49b7920b0d12cab8e0c: Status 404 returned error can't find the container with id 1fc12938dd889b8fa30138760dac01146a72e0c49eebd49b7920b0d12cab8e0c
Jul 08 22:56:59.832986 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.832946    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d977f7bd-9xxv7" event={"ID":"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61","Type":"ContainerStarted","Data":"80630a17a728bc0dbc32f373d0f5a7af62a23290ffda59c21ce9f37ab7bda42b"}
Jul 08 22:56:59.833185 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.833003    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d977f7bd-9xxv7" event={"ID":"869b44ea-05e1-4b2f-9c1d-c0affcfc6d61","Type":"ContainerStarted","Data":"1fc12938dd889b8fa30138760dac01146a72e0c49eebd49b7920b0d12cab8e0c"}
Jul 08 22:56:59.834378 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.834355    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvmvt" event={"ID":"caed00df-5082-4dbd-bc5e-0fec788c93c2","Type":"ContainerStarted","Data":"8f412b00d385e00c066e3790866e6b564ebb086470a5afc6c86e7b7f82ad0896"}
Jul 08 22:56:59.834484 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.834432    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvmvt"
Jul 08 22:56:59.851356 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.851307    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86d977f7bd-9xxv7" podStartSLOduration=1.851292945 podStartE2EDuration="1.851292945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:56:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:56:59.849633891 +0000 UTC m=+594.874215896" watchObservedRunningTime="2026-07-08 22:56:59.851292945 +0000 UTC m=+594.875874950"
Jul 08 22:56:59.873461 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:56:59.873404    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvmvt" podStartSLOduration=2.557747189 podStartE2EDuration="4.873388991s" totalImagesPullingTime="2.315641802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:56:59.872254858 +0000 UTC m=+594.896836864" watchObservedRunningTime="2026-07-08 22:56:59.873388991 +0000 UTC m=+594.897970996"
Jul 08 22:57:00.224381 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:00.224343    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"]
Jul 08 22:57:00.227593 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:00.227578    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:00.230677 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:00.230658    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9wrlv\""
Jul 08 22:57:00.245448 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:00.245425    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"]
Jul 08 22:57:00.324509 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:00.324464    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3cc2d9b-bbce-4d60-adfc-956331cc4db2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zr887\" (UID: \"f3cc2d9b-bbce-4d60-adfc-956331cc4db2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:00.324740 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:00.324522    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h4pn\" (UniqueName: \"kubernetes.io/projected/f3cc2d9b-bbce-4d60-adfc-956331cc4db2-kube-api-access-5h4pn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zr887\" (UID: \"f3cc2d9b-bbce-4d60-adfc-956331cc4db2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:00.425969 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:00.425931    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h4pn\" (UniqueName: \"kubernetes.io/projected/f3cc2d9b-bbce-4d60-adfc-956331cc4db2-kube-api-access-5h4pn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zr887\" (UID: \"f3cc2d9b-bbce-4d60-adfc-956331cc4db2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:00.426112 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:00.426040    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3cc2d9b-bbce-4d60-adfc-956331cc4db2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zr887\" (UID: \"f3cc2d9b-bbce-4d60-adfc-956331cc4db2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:00.426469 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:00.426450    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3cc2d9b-bbce-4d60-adfc-956331cc4db2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zr887\" (UID: \"f3cc2d9b-bbce-4d60-adfc-956331cc4db2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:00.439565 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:00.439530    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h4pn\" (UniqueName: \"kubernetes.io/projected/f3cc2d9b-bbce-4d60-adfc-956331cc4db2-kube-api-access-5h4pn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zr887\" (UID: \"f3cc2d9b-bbce-4d60-adfc-956331cc4db2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:00.537682 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:00.537590    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:00.673186 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:00.673161    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"]
Jul 08 22:57:00.675679 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:57:00.675654    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3cc2d9b_bbce_4d60_adfc_956331cc4db2.slice/crio-883c9d0f62693cae5517e000757ad7f9e97991e071b09daf24f5dcf720184df6 WatchSource:0}: Error finding container 883c9d0f62693cae5517e000757ad7f9e97991e071b09daf24f5dcf720184df6: Status 404 returned error can't find the container with id 883c9d0f62693cae5517e000757ad7f9e97991e071b09daf24f5dcf720184df6
Jul 08 22:57:00.841023 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:00.840930    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887" event={"ID":"f3cc2d9b-bbce-4d60-adfc-956331cc4db2","Type":"ContainerStarted","Data":"883c9d0f62693cae5517e000757ad7f9e97991e071b09daf24f5dcf720184df6"}
Jul 08 22:57:02.317779 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:02.317737    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"]
Jul 08 22:57:02.321497 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:02.321475    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"
Jul 08 22:57:02.324512 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:02.324488    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kxr7h\""
Jul 08 22:57:02.332346 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:02.332232    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"]
Jul 08 22:57:02.444062 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:02.444006    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjl2v\" (UniqueName: \"kubernetes.io/projected/32f24069-fc0c-4e20-b4ab-e1547c280251-kube-api-access-vjl2v\") pod \"limitador-operator-controller-manager-859d7b78bd-shj7x\" (UID: \"32f24069-fc0c-4e20-b4ab-e1547c280251\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"
Jul 08 22:57:02.545435 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:02.545401    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjl2v\" (UniqueName: \"kubernetes.io/projected/32f24069-fc0c-4e20-b4ab-e1547c280251-kube-api-access-vjl2v\") pod \"limitador-operator-controller-manager-859d7b78bd-shj7x\" (UID: \"32f24069-fc0c-4e20-b4ab-e1547c280251\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"
Jul 08 22:57:02.556741 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:02.556711    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjl2v\" (UniqueName: \"kubernetes.io/projected/32f24069-fc0c-4e20-b4ab-e1547c280251-kube-api-access-vjl2v\") pod \"limitador-operator-controller-manager-859d7b78bd-shj7x\" (UID: \"32f24069-fc0c-4e20-b4ab-e1547c280251\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"
Jul 08 22:57:02.634328 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:02.634292    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"
Jul 08 22:57:02.777251 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:02.777219    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"]
Jul 08 22:57:02.780817 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:57:02.780775    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32f24069_fc0c_4e20_b4ab_e1547c280251.slice/crio-32b485f5988c67be7574e54c787aabf4fe70aae2db77b8890960542b96bbfcba WatchSource:0}: Error finding container 32b485f5988c67be7574e54c787aabf4fe70aae2db77b8890960542b96bbfcba: Status 404 returned error can't find the container with id 32b485f5988c67be7574e54c787aabf4fe70aae2db77b8890960542b96bbfcba
Jul 08 22:57:02.854373 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:02.854334    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x" event={"ID":"32f24069-fc0c-4e20-b4ab-e1547c280251","Type":"ContainerStarted","Data":"32b485f5988c67be7574e54c787aabf4fe70aae2db77b8890960542b96bbfcba"}
Jul 08 22:57:04.865971 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:04.865888    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x" event={"ID":"32f24069-fc0c-4e20-b4ab-e1547c280251","Type":"ContainerStarted","Data":"ca8c564f830c7927ae938b40db01a7e2abc29bd7d158456975c317532fe8e302"}
Jul 08 22:57:04.866325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:04.866017    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"
Jul 08 22:57:04.888704 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:04.888633    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x" podStartSLOduration=1.090783269 podStartE2EDuration="2.88861637s" totalImagesPullingTime="1.797833101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:57:04.886749667 +0000 UTC m=+599.911331666" watchObservedRunningTime="2026-07-08 22:57:04.88861637 +0000 UTC m=+599.913198373"
Jul 08 22:57:05.390995 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:05.390968    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 22:57:05.391123 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:05.391107    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 22:57:07.887956 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:07.887921    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887" event={"ID":"f3cc2d9b-bbce-4d60-adfc-956331cc4db2","Type":"ContainerStarted","Data":"5b507b5ab61354a9701820155fe0eba4cd877b6b6658decd7498fe92e26f7a36"}
Jul 08 22:57:07.894658 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:07.888045    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:07.910177 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:07.910128    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887" podStartSLOduration=1.617539409 podStartE2EDuration="7.910112971s" totalImagesPullingTime="6.292573562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:57:07.907993689 +0000 UTC m=+602.932575692" watchObservedRunningTime="2026-07-08 22:57:07.910112971 +0000 UTC m=+602.934695001"
Jul 08 22:57:09.179911 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.179866    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:57:09.180347 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.179940    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:57:09.184660 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.184636    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:57:09.704564 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.704528    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n9wnq"]
Jul 08 22:57:09.707849 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.707832    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n9wnq"
Jul 08 22:57:09.710927 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.710906    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 08 22:57:09.711049 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.710912    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 08 22:57:09.711823 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.711803    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qjss4\""
Jul 08 22:57:09.717199 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.717179    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n9wnq"]
Jul 08 22:57:09.807963 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.807927    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzwkc\" (UniqueName: \"kubernetes.io/projected/1c2ba35f-a6bf-44e9-8fd9-35d83d30802d-kube-api-access-nzwkc\") pod \"kuadrant-console-plugin-66b5774985-n9wnq\" (UID: \"1c2ba35f-a6bf-44e9-8fd9-35d83d30802d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n9wnq"
Jul 08 22:57:09.808151 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.807979    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c2ba35f-a6bf-44e9-8fd9-35d83d30802d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n9wnq\" (UID: \"1c2ba35f-a6bf-44e9-8fd9-35d83d30802d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n9wnq"
Jul 08 22:57:09.808151 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.808016    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c2ba35f-a6bf-44e9-8fd9-35d83d30802d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n9wnq\" (UID: \"1c2ba35f-a6bf-44e9-8fd9-35d83d30802d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n9wnq"
Jul 08 22:57:09.901527 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.901502    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86d977f7bd-9xxv7"
Jul 08 22:57:09.908979 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.908960    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c2ba35f-a6bf-44e9-8fd9-35d83d30802d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n9wnq\" (UID: \"1c2ba35f-a6bf-44e9-8fd9-35d83d30802d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n9wnq"
Jul 08 22:57:09.909053 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.909021    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzwkc\" (UniqueName: \"kubernetes.io/projected/1c2ba35f-a6bf-44e9-8fd9-35d83d30802d-kube-api-access-nzwkc\") pod \"kuadrant-console-plugin-66b5774985-n9wnq\" (UID: \"1c2ba35f-a6bf-44e9-8fd9-35d83d30802d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n9wnq"
Jul 08 22:57:09.909091 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.909063    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c2ba35f-a6bf-44e9-8fd9-35d83d30802d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n9wnq\" (UID: \"1c2ba35f-a6bf-44e9-8fd9-35d83d30802d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n9wnq"
Jul 08 22:57:09.909609 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.909583    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c2ba35f-a6bf-44e9-8fd9-35d83d30802d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n9wnq\" (UID: \"1c2ba35f-a6bf-44e9-8fd9-35d83d30802d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n9wnq"
Jul 08 22:57:09.911399 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.911380    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c2ba35f-a6bf-44e9-8fd9-35d83d30802d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n9wnq\" (UID: \"1c2ba35f-a6bf-44e9-8fd9-35d83d30802d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n9wnq"
Jul 08 22:57:09.921529 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.921505    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzwkc\" (UniqueName: \"kubernetes.io/projected/1c2ba35f-a6bf-44e9-8fd9-35d83d30802d-kube-api-access-nzwkc\") pod \"kuadrant-console-plugin-66b5774985-n9wnq\" (UID: \"1c2ba35f-a6bf-44e9-8fd9-35d83d30802d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n9wnq"
Jul 08 22:57:09.949095 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:09.949067    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f97757c-8hs8n"]
Jul 08 22:57:10.018010 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:10.017938    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n9wnq"
Jul 08 22:57:10.149420 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:10.149398    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n9wnq"]
Jul 08 22:57:10.151427 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:57:10.151397    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c2ba35f_a6bf_44e9_8fd9_35d83d30802d.slice/crio-a3c6abe6e580e89ad4d5bbd1411ec955e1a39a7966c43a14e0c2317807d24032 WatchSource:0}: Error finding container a3c6abe6e580e89ad4d5bbd1411ec955e1a39a7966c43a14e0c2317807d24032: Status 404 returned error can't find the container with id a3c6abe6e580e89ad4d5bbd1411ec955e1a39a7966c43a14e0c2317807d24032
Jul 08 22:57:10.844198 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:10.844166    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvmvt"
Jul 08 22:57:10.906132 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:10.906091    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n9wnq" event={"ID":"1c2ba35f-a6bf-44e9-8fd9-35d83d30802d","Type":"ContainerStarted","Data":"a3c6abe6e580e89ad4d5bbd1411ec955e1a39a7966c43a14e0c2317807d24032"}
Jul 08 22:57:15.874112 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:15.874075    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"
Jul 08 22:57:18.895830 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:18.895799    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:20.601493 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.601452    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"]
Jul 08 22:57:20.602114 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.601661    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887" podUID="f3cc2d9b-bbce-4d60-adfc-956331cc4db2" containerName="manager" containerID="cri-o://5b507b5ab61354a9701820155fe0eba4cd877b6b6658decd7498fe92e26f7a36" gracePeriod=2
Jul 08 22:57:20.604109 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:57:20.604058    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zr887\" is forbidden: User \"system:node:ip-10-0-143-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-70.ec2.internal' and this object" podUID="f3cc2d9b-bbce-4d60-adfc-956331cc4db2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:20.606250 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.606183    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"]
Jul 08 22:57:20.622347 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.622307    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"]
Jul 08 22:57:20.623396 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.623132    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x" podUID="32f24069-fc0c-4e20-b4ab-e1547c280251" containerName="manager" containerID="cri-o://ca8c564f830c7927ae938b40db01a7e2abc29bd7d158456975c317532fe8e302" gracePeriod=2
Jul 08 22:57:20.627059 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:57:20.626298    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zr887\" is forbidden: User \"system:node:ip-10-0-143-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-70.ec2.internal' and this object" podUID="f3cc2d9b-bbce-4d60-adfc-956331cc4db2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:20.631169 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.631130    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4"]
Jul 08 22:57:20.631661 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.631644    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3cc2d9b-bbce-4d60-adfc-956331cc4db2" containerName="manager"
Jul 08 22:57:20.631768 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.631664    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3cc2d9b-bbce-4d60-adfc-956331cc4db2" containerName="manager"
Jul 08 22:57:20.631768 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.631763    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3cc2d9b-bbce-4d60-adfc-956331cc4db2" containerName="manager"
Jul 08 22:57:20.650447 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:57:20.650368    2574 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"32f24069-fc0c-4e20-b4ab-e1547c280251\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-shj7x\": pods \"limitador-operator-controller-manager-859d7b78bd-shj7x\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"
Jul 08 22:57:20.656820 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.656789    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"]
Jul 08 22:57:20.656995 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.656838    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4"]
Jul 08 22:57:20.656995 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.656901    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4"
Jul 08 22:57:20.659762 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:57:20.659681    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zr887\" is forbidden: User \"system:node:ip-10-0-143-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-70.ec2.internal' and this object" podUID="f3cc2d9b-bbce-4d60-adfc-956331cc4db2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:20.680459 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:57:20.680405    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-shj7x\" is forbidden: User \"system:node:ip-10-0-143-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-70.ec2.internal' and this object" podUID="32f24069-fc0c-4e20-b4ab-e1547c280251" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"
Jul 08 22:57:20.809336 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.809297    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p9g4\" (UniqueName: \"kubernetes.io/projected/5eb6c3c2-be8b-430b-9854-ea50c9015711-kube-api-access-2p9g4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8lk4\" (UID: \"5eb6c3c2-be8b-430b-9854-ea50c9015711\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4"
Jul 08 22:57:20.809515 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.809361    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5eb6c3c2-be8b-430b-9854-ea50c9015711-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8lk4\" (UID: \"5eb6c3c2-be8b-430b-9854-ea50c9015711\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4"
Jul 08 22:57:20.910371 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.910330    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p9g4\" (UniqueName: \"kubernetes.io/projected/5eb6c3c2-be8b-430b-9854-ea50c9015711-kube-api-access-2p9g4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8lk4\" (UID: \"5eb6c3c2-be8b-430b-9854-ea50c9015711\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4"
Jul 08 22:57:20.910577 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.910409    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5eb6c3c2-be8b-430b-9854-ea50c9015711-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8lk4\" (UID: \"5eb6c3c2-be8b-430b-9854-ea50c9015711\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4"
Jul 08 22:57:20.910865 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.910840    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5eb6c3c2-be8b-430b-9854-ea50c9015711-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8lk4\" (UID: \"5eb6c3c2-be8b-430b-9854-ea50c9015711\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4"
Jul 08 22:57:20.925517 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:20.925487    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p9g4\" (UniqueName: \"kubernetes.io/projected/5eb6c3c2-be8b-430b-9854-ea50c9015711-kube-api-access-2p9g4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8lk4\" (UID: \"5eb6c3c2-be8b-430b-9854-ea50c9015711\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4"
Jul 08 22:57:21.080391 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:21.080354    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4"
Jul 08 22:57:32.440492 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:32.440460    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4"]
Jul 08 22:57:32.442047 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:57:32.442021    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb6c3c2_be8b_430b_9854_ea50c9015711.slice/crio-ed457f275c56e81b51a8d5902bb2ed1f73204ff44ef9f27c9c0b4f183afe0dcb WatchSource:0}: Error finding container ed457f275c56e81b51a8d5902bb2ed1f73204ff44ef9f27c9c0b4f183afe0dcb: Status 404 returned error can't find the container with id ed457f275c56e81b51a8d5902bb2ed1f73204ff44ef9f27c9c0b4f183afe0dcb
Jul 08 22:57:32.501865 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:32.501841    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"
Jul 08 22:57:32.504541 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:57:32.504510    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-shj7x\" is forbidden: User \"system:node:ip-10-0-143-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-70.ec2.internal' and this object" podUID="32f24069-fc0c-4e20-b4ab-e1547c280251" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"
Jul 08 22:57:32.519917 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:32.519893    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjl2v\" (UniqueName: \"kubernetes.io/projected/32f24069-fc0c-4e20-b4ab-e1547c280251-kube-api-access-vjl2v\") pod \"32f24069-fc0c-4e20-b4ab-e1547c280251\" (UID: \"32f24069-fc0c-4e20-b4ab-e1547c280251\") "
Jul 08 22:57:32.520968 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:32.520946    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:32.521949 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:32.521931    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32f24069-fc0c-4e20-b4ab-e1547c280251-kube-api-access-vjl2v" (OuterVolumeSpecName: "kube-api-access-vjl2v") pod "32f24069-fc0c-4e20-b4ab-e1547c280251" (UID: "32f24069-fc0c-4e20-b4ab-e1547c280251"). InnerVolumeSpecName "kube-api-access-vjl2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:57:32.523667 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:57:32.523645    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zr887\" is forbidden: User \"system:node:ip-10-0-143-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-70.ec2.internal' and this object" podUID="f3cc2d9b-bbce-4d60-adfc-956331cc4db2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:32.525813 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:57:32.525786    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-shj7x\" is forbidden: User \"system:node:ip-10-0-143-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-70.ec2.internal' and this object" podUID="32f24069-fc0c-4e20-b4ab-e1547c280251" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"
Jul 08 22:57:32.621308 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:32.621283    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3cc2d9b-bbce-4d60-adfc-956331cc4db2-extensions-socket-volume\") pod \"f3cc2d9b-bbce-4d60-adfc-956331cc4db2\" (UID: \"f3cc2d9b-bbce-4d60-adfc-956331cc4db2\") "
Jul 08 22:57:32.621499 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:32.621355    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h4pn\" (UniqueName: \"kubernetes.io/projected/f3cc2d9b-bbce-4d60-adfc-956331cc4db2-kube-api-access-5h4pn\") pod \"f3cc2d9b-bbce-4d60-adfc-956331cc4db2\" (UID: \"f3cc2d9b-bbce-4d60-adfc-956331cc4db2\") "
Jul 08 22:57:32.621576 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:32.621506    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjl2v\" (UniqueName: \"kubernetes.io/projected/32f24069-fc0c-4e20-b4ab-e1547c280251-kube-api-access-vjl2v\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:57:32.621838 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:32.621813    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3cc2d9b-bbce-4d60-adfc-956331cc4db2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f3cc2d9b-bbce-4d60-adfc-956331cc4db2" (UID: "f3cc2d9b-bbce-4d60-adfc-956331cc4db2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:57:32.623371 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:32.623351    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3cc2d9b-bbce-4d60-adfc-956331cc4db2-kube-api-access-5h4pn" (OuterVolumeSpecName: "kube-api-access-5h4pn") pod "f3cc2d9b-bbce-4d60-adfc-956331cc4db2" (UID: "f3cc2d9b-bbce-4d60-adfc-956331cc4db2"). InnerVolumeSpecName "kube-api-access-5h4pn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:57:32.722141 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:32.722105    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3cc2d9b-bbce-4d60-adfc-956331cc4db2-extensions-socket-volume\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:57:32.722141 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:32.722134    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h4pn\" (UniqueName: \"kubernetes.io/projected/f3cc2d9b-bbce-4d60-adfc-956331cc4db2-kube-api-access-5h4pn\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:57:33.035067 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.034964    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n9wnq" event={"ID":"1c2ba35f-a6bf-44e9-8fd9-35d83d30802d","Type":"ContainerStarted","Data":"c53c5de901691061e1bb836b5240d1e5de7be112157bdc868454e5d785d5178a"}
Jul 08 22:57:33.036298 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.036258    2574 generic.go:356] "Generic (PLEG): container finished" podID="f3cc2d9b-bbce-4d60-adfc-956331cc4db2" containerID="5b507b5ab61354a9701820155fe0eba4cd877b6b6658decd7498fe92e26f7a36" exitCode=0
Jul 08 22:57:33.036298 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.036290    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:33.036497 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.036346    2574 scope.go:117] "RemoveContainer" containerID="5b507b5ab61354a9701820155fe0eba4cd877b6b6658decd7498fe92e26f7a36"
Jul 08 22:57:33.037412 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:57:33.037281    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zr887\" is forbidden: User \"system:node:ip-10-0-143-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-70.ec2.internal' and this object" podUID="f3cc2d9b-bbce-4d60-adfc-956331cc4db2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:33.037750 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.037720    2574 generic.go:356] "Generic (PLEG): container finished" podID="32f24069-fc0c-4e20-b4ab-e1547c280251" containerID="ca8c564f830c7927ae938b40db01a7e2abc29bd7d158456975c317532fe8e302" exitCode=0
Jul 08 22:57:33.037885 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.037756    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"
Jul 08 22:57:33.039435 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:57:33.039409    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-shj7x\" is forbidden: User \"system:node:ip-10-0-143-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-70.ec2.internal' and this object" podUID="32f24069-fc0c-4e20-b4ab-e1547c280251" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"
Jul 08 22:57:33.039621 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.039601    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4" event={"ID":"5eb6c3c2-be8b-430b-9854-ea50c9015711","Type":"ContainerStarted","Data":"d1d6b89a49bf6afd39cf1ca915f4006d23d4f3e58b241ffd782d26c8fe5fd850"}
Jul 08 22:57:33.039709 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.039640    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4" event={"ID":"5eb6c3c2-be8b-430b-9854-ea50c9015711","Type":"ContainerStarted","Data":"ed457f275c56e81b51a8d5902bb2ed1f73204ff44ef9f27c9c0b4f183afe0dcb"}
Jul 08 22:57:33.039770 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.039726    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4"
Jul 08 22:57:33.045747 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.045730    2574 scope.go:117] "RemoveContainer" containerID="5b507b5ab61354a9701820155fe0eba4cd877b6b6658decd7498fe92e26f7a36"
Jul 08 22:57:33.046043 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:57:33.046025    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b507b5ab61354a9701820155fe0eba4cd877b6b6658decd7498fe92e26f7a36\": container with ID starting with 5b507b5ab61354a9701820155fe0eba4cd877b6b6658decd7498fe92e26f7a36 not found: ID does not exist" containerID="5b507b5ab61354a9701820155fe0eba4cd877b6b6658decd7498fe92e26f7a36"
Jul 08 22:57:33.046126 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.046051    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b507b5ab61354a9701820155fe0eba4cd877b6b6658decd7498fe92e26f7a36"} err="failed to get container status \"5b507b5ab61354a9701820155fe0eba4cd877b6b6658decd7498fe92e26f7a36\": rpc error: code = NotFound desc = could not find container \"5b507b5ab61354a9701820155fe0eba4cd877b6b6658decd7498fe92e26f7a36\": container with ID starting with 5b507b5ab61354a9701820155fe0eba4cd877b6b6658decd7498fe92e26f7a36 not found: ID does not exist"
Jul 08 22:57:33.046126 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.046067    2574 scope.go:117] "RemoveContainer" containerID="ca8c564f830c7927ae938b40db01a7e2abc29bd7d158456975c317532fe8e302"
Jul 08 22:57:33.054276 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.054258    2574 scope.go:117] "RemoveContainer" containerID="ca8c564f830c7927ae938b40db01a7e2abc29bd7d158456975c317532fe8e302"
Jul 08 22:57:33.054540 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:57:33.054523    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca8c564f830c7927ae938b40db01a7e2abc29bd7d158456975c317532fe8e302\": container with ID starting with ca8c564f830c7927ae938b40db01a7e2abc29bd7d158456975c317532fe8e302 not found: ID does not exist" containerID="ca8c564f830c7927ae938b40db01a7e2abc29bd7d158456975c317532fe8e302"
Jul 08 22:57:33.054591 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.054548    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8c564f830c7927ae938b40db01a7e2abc29bd7d158456975c317532fe8e302"} err="failed to get container status \"ca8c564f830c7927ae938b40db01a7e2abc29bd7d158456975c317532fe8e302\": rpc error: code = NotFound desc = could not find container \"ca8c564f830c7927ae938b40db01a7e2abc29bd7d158456975c317532fe8e302\": container with ID starting with ca8c564f830c7927ae938b40db01a7e2abc29bd7d158456975c317532fe8e302 not found: ID does not exist"
Jul 08 22:57:33.054591 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.054565    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n9wnq" podStartSLOduration=1.476409026 podStartE2EDuration="24.054551792s" totalImagesPullingTime="22.578142766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:57:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:57:33.053017575 +0000 UTC m=+628.077599579" watchObservedRunningTime="2026-07-08 22:57:33.054551792 +0000 UTC m=+628.079133795"
Jul 08 22:57:33.072246 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:57:33.072213    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-shj7x\" is forbidden: User \"system:node:ip-10-0-143-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-70.ec2.internal' and this object" podUID="32f24069-fc0c-4e20-b4ab-e1547c280251" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-shj7x"
Jul 08 22:57:33.072615 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.072567    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4" podStartSLOduration=13.072549707 podStartE2EDuration="13.072549707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:57:33.070019432 +0000 UTC m=+628.094601464" watchObservedRunningTime="2026-07-08 22:57:33.072549707 +0000 UTC m=+628.097131711"
Jul 08 22:57:33.074441 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:57:33.074402    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zr887\" is forbidden: User \"system:node:ip-10-0-143-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-70.ec2.internal' and this object" podUID="f3cc2d9b-bbce-4d60-adfc-956331cc4db2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr887"
Jul 08 22:57:33.502732 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.502667    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32f24069-fc0c-4e20-b4ab-e1547c280251" path="/var/lib/kubelet/pods/32f24069-fc0c-4e20-b4ab-e1547c280251/volumes"
Jul 08 22:57:33.503100 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:33.503078    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3cc2d9b-bbce-4d60-adfc-956331cc4db2" path="/var/lib/kubelet/pods/f3cc2d9b-bbce-4d60-adfc-956331cc4db2/volumes"
Jul 08 22:57:34.970426 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:34.970386    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54f97757c-8hs8n" podUID="e942544a-7447-4197-9b90-19058017cc79" containerName="console" containerID="cri-o://4b715330e7a1b6a5f7c035b9301d657201e76b419e15a331925e8e7f17ecfe36" gracePeriod=15
Jul 08 22:57:35.272449 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.272415    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:57:35.342610 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.342573    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e942544a-7447-4197-9b90-19058017cc79-console-serving-cert\") pod \"e942544a-7447-4197-9b90-19058017cc79\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") "
Jul 08 22:57:35.342801 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.342636    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-console-config\") pod \"e942544a-7447-4197-9b90-19058017cc79\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") "
Jul 08 22:57:35.342801 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.342667    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-trusted-ca-bundle\") pod \"e942544a-7447-4197-9b90-19058017cc79\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") "
Jul 08 22:57:35.342801 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.342755    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-service-ca\") pod \"e942544a-7447-4197-9b90-19058017cc79\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") "
Jul 08 22:57:35.342801 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.342799    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-oauth-serving-cert\") pod \"e942544a-7447-4197-9b90-19058017cc79\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") "
Jul 08 22:57:35.343003 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.342823    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhx27\" (UniqueName: \"kubernetes.io/projected/e942544a-7447-4197-9b90-19058017cc79-kube-api-access-vhx27\") pod \"e942544a-7447-4197-9b90-19058017cc79\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") "
Jul 08 22:57:35.343003 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.342861    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e942544a-7447-4197-9b90-19058017cc79-console-oauth-config\") pod \"e942544a-7447-4197-9b90-19058017cc79\" (UID: \"e942544a-7447-4197-9b90-19058017cc79\") "
Jul 08 22:57:35.343213 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.343172    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-console-config" (OuterVolumeSpecName: "console-config") pod "e942544a-7447-4197-9b90-19058017cc79" (UID: "e942544a-7447-4197-9b90-19058017cc79"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:57:35.343213 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.343185    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e942544a-7447-4197-9b90-19058017cc79" (UID: "e942544a-7447-4197-9b90-19058017cc79"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:57:35.343388 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.343287    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-service-ca" (OuterVolumeSpecName: "service-ca") pod "e942544a-7447-4197-9b90-19058017cc79" (UID: "e942544a-7447-4197-9b90-19058017cc79"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:57:35.343388 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.343353    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e942544a-7447-4197-9b90-19058017cc79" (UID: "e942544a-7447-4197-9b90-19058017cc79"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:57:35.344862 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.344842    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e942544a-7447-4197-9b90-19058017cc79-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e942544a-7447-4197-9b90-19058017cc79" (UID: "e942544a-7447-4197-9b90-19058017cc79"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:57:35.344977 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.344957    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e942544a-7447-4197-9b90-19058017cc79-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e942544a-7447-4197-9b90-19058017cc79" (UID: "e942544a-7447-4197-9b90-19058017cc79"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:57:35.345128 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.345114    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e942544a-7447-4197-9b90-19058017cc79-kube-api-access-vhx27" (OuterVolumeSpecName: "kube-api-access-vhx27") pod "e942544a-7447-4197-9b90-19058017cc79" (UID: "e942544a-7447-4197-9b90-19058017cc79"). InnerVolumeSpecName "kube-api-access-vhx27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:57:35.443590 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.443551    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e942544a-7447-4197-9b90-19058017cc79-console-serving-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:57:35.443590 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.443583    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-console-config\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:57:35.443590 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.443593    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-trusted-ca-bundle\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:57:35.443590 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.443602    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-service-ca\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:57:35.443885 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.443611    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e942544a-7447-4197-9b90-19058017cc79-oauth-serving-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:57:35.443885 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.443620    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhx27\" (UniqueName: \"kubernetes.io/projected/e942544a-7447-4197-9b90-19058017cc79-kube-api-access-vhx27\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:57:35.443885 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:35.443628    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e942544a-7447-4197-9b90-19058017cc79-console-oauth-config\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:57:36.057604 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:36.057566    2574 generic.go:356] "Generic (PLEG): container finished" podID="e942544a-7447-4197-9b90-19058017cc79" containerID="4b715330e7a1b6a5f7c035b9301d657201e76b419e15a331925e8e7f17ecfe36" exitCode=0
Jul 08 22:57:36.058021 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:36.057629    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f97757c-8hs8n"
Jul 08 22:57:36.058021 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:36.057654    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f97757c-8hs8n" event={"ID":"e942544a-7447-4197-9b90-19058017cc79","Type":"ContainerDied","Data":"4b715330e7a1b6a5f7c035b9301d657201e76b419e15a331925e8e7f17ecfe36"}
Jul 08 22:57:36.058021 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:36.057727    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f97757c-8hs8n" event={"ID":"e942544a-7447-4197-9b90-19058017cc79","Type":"ContainerDied","Data":"fab62642a156510af39dd450c1356403febd883614ed306a9203d8dd9424ff72"}
Jul 08 22:57:36.058021 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:36.057752    2574 scope.go:117] "RemoveContainer" containerID="4b715330e7a1b6a5f7c035b9301d657201e76b419e15a331925e8e7f17ecfe36"
Jul 08 22:57:36.066073 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:36.066055    2574 scope.go:117] "RemoveContainer" containerID="4b715330e7a1b6a5f7c035b9301d657201e76b419e15a331925e8e7f17ecfe36"
Jul 08 22:57:36.066341 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:57:36.066323    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b715330e7a1b6a5f7c035b9301d657201e76b419e15a331925e8e7f17ecfe36\": container with ID starting with 4b715330e7a1b6a5f7c035b9301d657201e76b419e15a331925e8e7f17ecfe36 not found: ID does not exist" containerID="4b715330e7a1b6a5f7c035b9301d657201e76b419e15a331925e8e7f17ecfe36"
Jul 08 22:57:36.066392 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:36.066351    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b715330e7a1b6a5f7c035b9301d657201e76b419e15a331925e8e7f17ecfe36"} err="failed to get container status \"4b715330e7a1b6a5f7c035b9301d657201e76b419e15a331925e8e7f17ecfe36\": rpc error: code = NotFound desc = could not find container \"4b715330e7a1b6a5f7c035b9301d657201e76b419e15a331925e8e7f17ecfe36\": container with ID starting with 4b715330e7a1b6a5f7c035b9301d657201e76b419e15a331925e8e7f17ecfe36 not found: ID does not exist"
Jul 08 22:57:36.075441 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:36.075407    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f97757c-8hs8n"]
Jul 08 22:57:36.077737 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:36.077715    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54f97757c-8hs8n"]
Jul 08 22:57:36.947871 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:36.947835    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4"]
Jul 08 22:57:36.948066 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:36.948008    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4" podUID="5eb6c3c2-be8b-430b-9854-ea50c9015711" containerName="manager" containerID="cri-o://d1d6b89a49bf6afd39cf1ca915f4006d23d4f3e58b241ffd782d26c8fe5fd850" gracePeriod=10
Jul 08 22:57:37.065393 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.065367    2574 generic.go:356] "Generic (PLEG): container finished" podID="5eb6c3c2-be8b-430b-9854-ea50c9015711" containerID="d1d6b89a49bf6afd39cf1ca915f4006d23d4f3e58b241ffd782d26c8fe5fd850" exitCode=0
Jul 08 22:57:37.065790 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.065433    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4" event={"ID":"5eb6c3c2-be8b-430b-9854-ea50c9015711","Type":"ContainerDied","Data":"d1d6b89a49bf6afd39cf1ca915f4006d23d4f3e58b241ffd782d26c8fe5fd850"}
Jul 08 22:57:37.196916 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.196882    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"]
Jul 08 22:57:37.197290 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.197273    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32f24069-fc0c-4e20-b4ab-e1547c280251" containerName="manager"
Jul 08 22:57:37.197376 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.197294    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="32f24069-fc0c-4e20-b4ab-e1547c280251" containerName="manager"
Jul 08 22:57:37.197376 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.197310    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e942544a-7447-4197-9b90-19058017cc79" containerName="console"
Jul 08 22:57:37.197376 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.197318    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e942544a-7447-4197-9b90-19058017cc79" containerName="console"
Jul 08 22:57:37.197531 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.197393    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e942544a-7447-4197-9b90-19058017cc79" containerName="console"
Jul 08 22:57:37.197531 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.197405    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="32f24069-fc0c-4e20-b4ab-e1547c280251" containerName="manager"
Jul 08 22:57:37.225978 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.225950    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"]
Jul 08 22:57:37.226126 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.226048    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"
Jul 08 22:57:37.233651 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.233626    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4"
Jul 08 22:57:37.256353 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.256325    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5eb6c3c2-be8b-430b-9854-ea50c9015711-extensions-socket-volume\") pod \"5eb6c3c2-be8b-430b-9854-ea50c9015711\" (UID: \"5eb6c3c2-be8b-430b-9854-ea50c9015711\") "
Jul 08 22:57:37.256529 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.256376    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2p9g4\" (UniqueName: \"kubernetes.io/projected/5eb6c3c2-be8b-430b-9854-ea50c9015711-kube-api-access-2p9g4\") pod \"5eb6c3c2-be8b-430b-9854-ea50c9015711\" (UID: \"5eb6c3c2-be8b-430b-9854-ea50c9015711\") "
Jul 08 22:57:37.256529 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.256500    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96d109f3-a17c-4569-bf35-ed9f1a48e7cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-f9btt\" (UID: \"96d109f3-a17c-4569-bf35-ed9f1a48e7cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"
Jul 08 22:57:37.256647 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.256555    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnpgt\" (UniqueName: \"kubernetes.io/projected/96d109f3-a17c-4569-bf35-ed9f1a48e7cb-kube-api-access-wnpgt\") pod \"kuadrant-operator-controller-manager-86878c769f-f9btt\" (UID: \"96d109f3-a17c-4569-bf35-ed9f1a48e7cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"
Jul 08 22:57:37.256804 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.256780    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb6c3c2-be8b-430b-9854-ea50c9015711-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5eb6c3c2-be8b-430b-9854-ea50c9015711" (UID: "5eb6c3c2-be8b-430b-9854-ea50c9015711"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:57:37.258484 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.258462    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eb6c3c2-be8b-430b-9854-ea50c9015711-kube-api-access-2p9g4" (OuterVolumeSpecName: "kube-api-access-2p9g4") pod "5eb6c3c2-be8b-430b-9854-ea50c9015711" (UID: "5eb6c3c2-be8b-430b-9854-ea50c9015711"). InnerVolumeSpecName "kube-api-access-2p9g4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:57:37.357990 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.357953    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96d109f3-a17c-4569-bf35-ed9f1a48e7cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-f9btt\" (UID: \"96d109f3-a17c-4569-bf35-ed9f1a48e7cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"
Jul 08 22:57:37.358160 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.358080    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpgt\" (UniqueName: \"kubernetes.io/projected/96d109f3-a17c-4569-bf35-ed9f1a48e7cb-kube-api-access-wnpgt\") pod \"kuadrant-operator-controller-manager-86878c769f-f9btt\" (UID: \"96d109f3-a17c-4569-bf35-ed9f1a48e7cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"
Jul 08 22:57:37.358160 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.358152    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2p9g4\" (UniqueName: \"kubernetes.io/projected/5eb6c3c2-be8b-430b-9854-ea50c9015711-kube-api-access-2p9g4\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:57:37.358237 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.358170    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5eb6c3c2-be8b-430b-9854-ea50c9015711-extensions-socket-volume\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:57:37.358387 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.358371    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96d109f3-a17c-4569-bf35-ed9f1a48e7cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-f9btt\" (UID: \"96d109f3-a17c-4569-bf35-ed9f1a48e7cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"
Jul 08 22:57:37.367048 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.367015    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnpgt\" (UniqueName: \"kubernetes.io/projected/96d109f3-a17c-4569-bf35-ed9f1a48e7cb-kube-api-access-wnpgt\") pod \"kuadrant-operator-controller-manager-86878c769f-f9btt\" (UID: \"96d109f3-a17c-4569-bf35-ed9f1a48e7cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"
Jul 08 22:57:37.502423 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.502350    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e942544a-7447-4197-9b90-19058017cc79" path="/var/lib/kubelet/pods/e942544a-7447-4197-9b90-19058017cc79/volumes"
Jul 08 22:57:37.536260 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.536231    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"
Jul 08 22:57:37.686671 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:37.686600    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"]
Jul 08 22:57:37.689469 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:57:37.689441    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d109f3_a17c_4569_bf35_ed9f1a48e7cb.slice/crio-171d09d21755b391b27a5561344c78cdc69d0d1f161a59fc3ca0b9ef86b4eaf7 WatchSource:0}: Error finding container 171d09d21755b391b27a5561344c78cdc69d0d1f161a59fc3ca0b9ef86b4eaf7: Status 404 returned error can't find the container with id 171d09d21755b391b27a5561344c78cdc69d0d1f161a59fc3ca0b9ef86b4eaf7
Jul 08 22:57:38.072616 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:38.072531    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4"
Jul 08 22:57:38.072616 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:38.072563    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4" event={"ID":"5eb6c3c2-be8b-430b-9854-ea50c9015711","Type":"ContainerDied","Data":"ed457f275c56e81b51a8d5902bb2ed1f73204ff44ef9f27c9c0b4f183afe0dcb"}
Jul 08 22:57:38.073126 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:38.072628    2574 scope.go:117] "RemoveContainer" containerID="d1d6b89a49bf6afd39cf1ca915f4006d23d4f3e58b241ffd782d26c8fe5fd850"
Jul 08 22:57:38.074454 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:38.074427    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt" event={"ID":"96d109f3-a17c-4569-bf35-ed9f1a48e7cb","Type":"ContainerStarted","Data":"45870402565a3dd5562bc52558a24b7203323efc4b1422ea84be2179b44842f5"}
Jul 08 22:57:38.074574 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:38.074477    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt" event={"ID":"96d109f3-a17c-4569-bf35-ed9f1a48e7cb","Type":"ContainerStarted","Data":"171d09d21755b391b27a5561344c78cdc69d0d1f161a59fc3ca0b9ef86b4eaf7"}
Jul 08 22:57:38.074636 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:38.074582    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"
Jul 08 22:57:38.100837 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:38.100780    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt" podStartSLOduration=1.100759238 podStartE2EDuration="1.100759238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:57:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:57:38.098990603 +0000 UTC m=+633.123572604" watchObservedRunningTime="2026-07-08 22:57:38.100759238 +0000 UTC m=+633.125341245"
Jul 08 22:57:38.118561 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:38.118535    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4"]
Jul 08 22:57:38.129943 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:38.129907    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8lk4"]
Jul 08 22:57:39.504161 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:39.504117    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eb6c3c2-be8b-430b-9854-ea50c9015711" path="/var/lib/kubelet/pods/5eb6c3c2-be8b-430b-9854-ea50c9015711/volumes"
Jul 08 22:57:49.083125 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:49.083091    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"
Jul 08 22:57:53.234167 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.234134    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"]
Jul 08 22:57:53.234532 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.234451    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eb6c3c2-be8b-430b-9854-ea50c9015711" containerName="manager"
Jul 08 22:57:53.234532 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.234462    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eb6c3c2-be8b-430b-9854-ea50c9015711" containerName="manager"
Jul 08 22:57:53.234532 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.234512    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eb6c3c2-be8b-430b-9854-ea50c9015711" containerName="manager"
Jul 08 22:57:53.282512 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.282479    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"]
Jul 08 22:57:53.282670 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.282585    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.285084 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.285062    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cvwj9\""
Jul 08 22:57:53.403060 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.403017    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.403060 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.403061    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.403272 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.403088    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.403272 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.403154    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.403272 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.403176    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.403272 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.403229    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.403272 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.403266    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.403428 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.403302    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.403428 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.403330    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7w6b\" (UniqueName: \"kubernetes.io/projected/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-kube-api-access-n7w6b\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.504720 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.504619    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7w6b\" (UniqueName: \"kubernetes.io/projected/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-kube-api-access-n7w6b\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.504720 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.504660    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.504922 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.504789    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.504922 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.504822    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.504922 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.504859    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.505079 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.505042    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.505176 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.505147    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.505626 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.505597    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.505775 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.505667    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.505775 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.505756    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.505883 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.505782    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.507857 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.505987    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.507857 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.506108    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.507857 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.506240    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.508367 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.508348    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.513227 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.513205    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.513756 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.513735    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.514778 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.514758    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7w6b\" (UniqueName: \"kubernetes.io/projected/bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce-kube-api-access-n7w6b\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d86tq\" (UID: \"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.592806 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.592770    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:53.727560 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.727536    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"]
Jul 08 22:57:53.729447 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:57:53.729422    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcb3dc2f_488d_4ef0_8613_c6fbe6fe68ce.slice/crio-e317228244d0dff07d303a6b8c01ab4b3922b6f0aa4b001646392cbcbe337249 WatchSource:0}: Error finding container e317228244d0dff07d303a6b8c01ab4b3922b6f0aa4b001646392cbcbe337249: Status 404 returned error can't find the container with id e317228244d0dff07d303a6b8c01ab4b3922b6f0aa4b001646392cbcbe337249
Jul 08 22:57:53.732115 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.732082    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 22:57:53.732180 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.732151    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 22:57:53.732221 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:53.732180    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 22:57:54.158763 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:54.158720    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq" event={"ID":"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce","Type":"ContainerStarted","Data":"dd4a0340104ad3766410a375c85cd429a61accae04b5b9dbe6b5d6a9128fae04"}
Jul 08 22:57:54.158941 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:54.158783    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq" event={"ID":"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce","Type":"ContainerStarted","Data":"e317228244d0dff07d303a6b8c01ab4b3922b6f0aa4b001646392cbcbe337249"}
Jul 08 22:57:54.178899 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:54.178840    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq" podStartSLOduration=1.178823936 podStartE2EDuration="1.178823936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:57:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:57:54.178091475 +0000 UTC m=+649.202673482" watchObservedRunningTime="2026-07-08 22:57:54.178823936 +0000 UTC m=+649.203406011"
Jul 08 22:57:54.593239 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:54.593153    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:54.597808 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:54.597782    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:55.164124 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:55.164092    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:57:55.165018 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:57:55.165002    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:58:07.073762 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:07.073725    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n22wp"]
Jul 08 22:58:07.097532 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:07.097495    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n22wp"]
Jul 08 22:58:07.097705 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:07.097621    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp"
Jul 08 22:58:07.100440 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:07.100419    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 22:58:07.168238 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:07.168206    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n22wp"]
Jul 08 22:58:07.233860 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:07.233830    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5374529f-2dec-46d3-9182-cff3e9856536-config-file\") pod \"limitador-limitador-64c94fd64f-n22wp\" (UID: \"5374529f-2dec-46d3-9182-cff3e9856536\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp"
Jul 08 22:58:07.234036 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:07.233896    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7lr8\" (UniqueName: \"kubernetes.io/projected/5374529f-2dec-46d3-9182-cff3e9856536-kube-api-access-t7lr8\") pod \"limitador-limitador-64c94fd64f-n22wp\" (UID: \"5374529f-2dec-46d3-9182-cff3e9856536\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp"
Jul 08 22:58:07.334728 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:07.334630    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5374529f-2dec-46d3-9182-cff3e9856536-config-file\") pod \"limitador-limitador-64c94fd64f-n22wp\" (UID: \"5374529f-2dec-46d3-9182-cff3e9856536\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp"
Jul 08 22:58:07.334728 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:07.334705    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7lr8\" (UniqueName: \"kubernetes.io/projected/5374529f-2dec-46d3-9182-cff3e9856536-kube-api-access-t7lr8\") pod \"limitador-limitador-64c94fd64f-n22wp\" (UID: \"5374529f-2dec-46d3-9182-cff3e9856536\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp"
Jul 08 22:58:07.335301 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:07.335283    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5374529f-2dec-46d3-9182-cff3e9856536-config-file\") pod \"limitador-limitador-64c94fd64f-n22wp\" (UID: \"5374529f-2dec-46d3-9182-cff3e9856536\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp"
Jul 08 22:58:07.342909 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:07.342885    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7lr8\" (UniqueName: \"kubernetes.io/projected/5374529f-2dec-46d3-9182-cff3e9856536-kube-api-access-t7lr8\") pod \"limitador-limitador-64c94fd64f-n22wp\" (UID: \"5374529f-2dec-46d3-9182-cff3e9856536\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp"
Jul 08 22:58:07.407358 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:07.407318    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp"
Jul 08 22:58:07.543113 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:07.543074    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n22wp"]
Jul 08 22:58:07.545933 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:58:07.545904    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5374529f_2dec_46d3_9182_cff3e9856536.slice/crio-0b53095c5f2dac1e82707a9c86b69a646f05fc9bc071ff42cb8b89bb363d99cc WatchSource:0}: Error finding container 0b53095c5f2dac1e82707a9c86b69a646f05fc9bc071ff42cb8b89bb363d99cc: Status 404 returned error can't find the container with id 0b53095c5f2dac1e82707a9c86b69a646f05fc9bc071ff42cb8b89bb363d99cc
Jul 08 22:58:07.872358 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:07.872318    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-8cc5d"]
Jul 08 22:58:07.878915 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:07.878886    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8cc5d"
Jul 08 22:58:07.881513 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:07.881491    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dmwqc\""
Jul 08 22:58:07.883332 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:07.883307    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8cc5d"]
Jul 08 22:58:08.040970 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:08.040925    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v5nz\" (UniqueName: \"kubernetes.io/projected/a8640c87-9973-42cc-8ddc-e072d02adb1c-kube-api-access-8v5nz\") pod \"authorino-58cd955675-8cc5d\" (UID: \"a8640c87-9973-42cc-8ddc-e072d02adb1c\") " pod="kuadrant-system/authorino-58cd955675-8cc5d"
Jul 08 22:58:08.055105 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:08.055077    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-twjbl"]
Jul 08 22:58:08.058358 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:08.058342    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-twjbl"
Jul 08 22:58:08.062754 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:08.062729    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-twjbl"]
Jul 08 22:58:08.141828 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:08.141763    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v5nz\" (UniqueName: \"kubernetes.io/projected/a8640c87-9973-42cc-8ddc-e072d02adb1c-kube-api-access-8v5nz\") pod \"authorino-58cd955675-8cc5d\" (UID: \"a8640c87-9973-42cc-8ddc-e072d02adb1c\") " pod="kuadrant-system/authorino-58cd955675-8cc5d"
Jul 08 22:58:08.149785 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:08.149756    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v5nz\" (UniqueName: \"kubernetes.io/projected/a8640c87-9973-42cc-8ddc-e072d02adb1c-kube-api-access-8v5nz\") pod \"authorino-58cd955675-8cc5d\" (UID: \"a8640c87-9973-42cc-8ddc-e072d02adb1c\") " pod="kuadrant-system/authorino-58cd955675-8cc5d"
Jul 08 22:58:08.190441 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:08.190411    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8cc5d"
Jul 08 22:58:08.231282 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:08.231244    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp" event={"ID":"5374529f-2dec-46d3-9182-cff3e9856536","Type":"ContainerStarted","Data":"0b53095c5f2dac1e82707a9c86b69a646f05fc9bc071ff42cb8b89bb363d99cc"}
Jul 08 22:58:08.243033 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:08.242947    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdq4h\" (UniqueName: \"kubernetes.io/projected/6ceb824e-4395-44e9-8a78-95fcf503800e-kube-api-access-xdq4h\") pod \"authorino-75d556bd77-twjbl\" (UID: \"6ceb824e-4395-44e9-8a78-95fcf503800e\") " pod="kuadrant-system/authorino-75d556bd77-twjbl"
Jul 08 22:58:08.344512 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:08.344133    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdq4h\" (UniqueName: \"kubernetes.io/projected/6ceb824e-4395-44e9-8a78-95fcf503800e-kube-api-access-xdq4h\") pod \"authorino-75d556bd77-twjbl\" (UID: \"6ceb824e-4395-44e9-8a78-95fcf503800e\") " pod="kuadrant-system/authorino-75d556bd77-twjbl"
Jul 08 22:58:08.344587 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:08.344542    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8cc5d"]
Jul 08 22:58:08.346998 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:58:08.346966    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8640c87_9973_42cc_8ddc_e072d02adb1c.slice/crio-8c4ff0ee47a30cfd0d3783080ff6564cbed97b5ef3a40f7efcb3600004b70c26 WatchSource:0}: Error finding container 8c4ff0ee47a30cfd0d3783080ff6564cbed97b5ef3a40f7efcb3600004b70c26: Status 404 returned error can't find the container with id 8c4ff0ee47a30cfd0d3783080ff6564cbed97b5ef3a40f7efcb3600004b70c26
Jul 08 22:58:08.354770 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:08.354705    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdq4h\" (UniqueName: \"kubernetes.io/projected/6ceb824e-4395-44e9-8a78-95fcf503800e-kube-api-access-xdq4h\") pod \"authorino-75d556bd77-twjbl\" (UID: \"6ceb824e-4395-44e9-8a78-95fcf503800e\") " pod="kuadrant-system/authorino-75d556bd77-twjbl"
Jul 08 22:58:08.369071 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:08.368430    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-twjbl"
Jul 08 22:58:08.571810 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:08.571614    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-twjbl"]
Jul 08 22:58:08.574757 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:58:08.574726    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ceb824e_4395_44e9_8a78_95fcf503800e.slice/crio-26409613e01f80bc13652f25c4a027a13343f7e0f7d0077c2e24117da8a689f7 WatchSource:0}: Error finding container 26409613e01f80bc13652f25c4a027a13343f7e0f7d0077c2e24117da8a689f7: Status 404 returned error can't find the container with id 26409613e01f80bc13652f25c4a027a13343f7e0f7d0077c2e24117da8a689f7
Jul 08 22:58:09.242846 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:09.242799    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-twjbl" event={"ID":"6ceb824e-4395-44e9-8a78-95fcf503800e","Type":"ContainerStarted","Data":"26409613e01f80bc13652f25c4a027a13343f7e0f7d0077c2e24117da8a689f7"}
Jul 08 22:58:09.247845 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:09.247772    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8cc5d" event={"ID":"a8640c87-9973-42cc-8ddc-e072d02adb1c","Type":"ContainerStarted","Data":"8c4ff0ee47a30cfd0d3783080ff6564cbed97b5ef3a40f7efcb3600004b70c26"}
Jul 08 22:58:13.276524 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:13.276476    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp" event={"ID":"5374529f-2dec-46d3-9182-cff3e9856536","Type":"ContainerStarted","Data":"95481146366d374e1848e9d21747fc2b47687ad979d3afb02c3b0fbd8820fa27"}
Jul 08 22:58:13.277008 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:13.276542    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp"
Jul 08 22:58:13.277914 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:13.277883    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-twjbl" event={"ID":"6ceb824e-4395-44e9-8a78-95fcf503800e","Type":"ContainerStarted","Data":"30101ba4ff6f4bd15dc64671ae15c1c4f96d2bd4e1e1a0c0225166ffc2a82a3a"}
Jul 08 22:58:13.279159 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:13.279137    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8cc5d" event={"ID":"a8640c87-9973-42cc-8ddc-e072d02adb1c","Type":"ContainerStarted","Data":"a6a5e0c190bc9cb856e54b929f256df4d27978ab2c33fa732f10027f21904059"}
Jul 08 22:58:13.292674 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:13.292628    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp" podStartSLOduration=0.99247732 podStartE2EDuration="6.292614179s" totalImagesPullingTime="5.300136859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:58:13.291800864 +0000 UTC m=+668.316382880" watchObservedRunningTime="2026-07-08 22:58:13.292614179 +0000 UTC m=+668.317196210"
Jul 08 22:58:13.306115 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:13.306067    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-8cc5d" podStartSLOduration=1.794507899 podStartE2EDuration="6.306051377s" totalImagesPullingTime="4.511543478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:58:13.304055328 +0000 UTC m=+668.328637311" watchObservedRunningTime="2026-07-08 22:58:13.306051377 +0000 UTC m=+668.330633380"
Jul 08 22:58:13.319411 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:13.319353    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-twjbl" podStartSLOduration=1.048359332 podStartE2EDuration="5.319335595s" totalImagesPullingTime="4.270976263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:58:13.317647854 +0000 UTC m=+668.342229861" watchObservedRunningTime="2026-07-08 22:58:13.319335595 +0000 UTC m=+668.343917600"
Jul 08 22:58:13.342505 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:13.342474    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8cc5d"]
Jul 08 22:58:15.288775 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:15.288726    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-8cc5d" podUID="a8640c87-9973-42cc-8ddc-e072d02adb1c" containerName="authorino" containerID="cri-o://a6a5e0c190bc9cb856e54b929f256df4d27978ab2c33fa732f10027f21904059" gracePeriod=30
Jul 08 22:58:15.538832 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:15.538767    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8cc5d"
Jul 08 22:58:15.609040 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:15.609004    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v5nz\" (UniqueName: \"kubernetes.io/projected/a8640c87-9973-42cc-8ddc-e072d02adb1c-kube-api-access-8v5nz\") pod \"a8640c87-9973-42cc-8ddc-e072d02adb1c\" (UID: \"a8640c87-9973-42cc-8ddc-e072d02adb1c\") "
Jul 08 22:58:15.611021 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:15.610988    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8640c87-9973-42cc-8ddc-e072d02adb1c-kube-api-access-8v5nz" (OuterVolumeSpecName: "kube-api-access-8v5nz") pod "a8640c87-9973-42cc-8ddc-e072d02adb1c" (UID: "a8640c87-9973-42cc-8ddc-e072d02adb1c"). InnerVolumeSpecName "kube-api-access-8v5nz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:58:15.709643 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:15.709608    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v5nz\" (UniqueName: \"kubernetes.io/projected/a8640c87-9973-42cc-8ddc-e072d02adb1c-kube-api-access-8v5nz\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:58:16.295030 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:16.294990    2574 generic.go:356] "Generic (PLEG): container finished" podID="a8640c87-9973-42cc-8ddc-e072d02adb1c" containerID="a6a5e0c190bc9cb856e54b929f256df4d27978ab2c33fa732f10027f21904059" exitCode=0
Jul 08 22:58:16.295030 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:16.295031    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8cc5d"
Jul 08 22:58:16.295542 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:16.295076    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8cc5d" event={"ID":"a8640c87-9973-42cc-8ddc-e072d02adb1c","Type":"ContainerDied","Data":"a6a5e0c190bc9cb856e54b929f256df4d27978ab2c33fa732f10027f21904059"}
Jul 08 22:58:16.295542 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:16.295115    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8cc5d" event={"ID":"a8640c87-9973-42cc-8ddc-e072d02adb1c","Type":"ContainerDied","Data":"8c4ff0ee47a30cfd0d3783080ff6564cbed97b5ef3a40f7efcb3600004b70c26"}
Jul 08 22:58:16.295542 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:16.295131    2574 scope.go:117] "RemoveContainer" containerID="a6a5e0c190bc9cb856e54b929f256df4d27978ab2c33fa732f10027f21904059"
Jul 08 22:58:16.304006 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:16.303988    2574 scope.go:117] "RemoveContainer" containerID="a6a5e0c190bc9cb856e54b929f256df4d27978ab2c33fa732f10027f21904059"
Jul 08 22:58:16.304304 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:58:16.304281    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6a5e0c190bc9cb856e54b929f256df4d27978ab2c33fa732f10027f21904059\": container with ID starting with a6a5e0c190bc9cb856e54b929f256df4d27978ab2c33fa732f10027f21904059 not found: ID does not exist" containerID="a6a5e0c190bc9cb856e54b929f256df4d27978ab2c33fa732f10027f21904059"
Jul 08 22:58:16.304394 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:16.304315    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6a5e0c190bc9cb856e54b929f256df4d27978ab2c33fa732f10027f21904059"} err="failed to get container status \"a6a5e0c190bc9cb856e54b929f256df4d27978ab2c33fa732f10027f21904059\": rpc error: code = NotFound desc = could not find container \"a6a5e0c190bc9cb856e54b929f256df4d27978ab2c33fa732f10027f21904059\": container with ID starting with a6a5e0c190bc9cb856e54b929f256df4d27978ab2c33fa732f10027f21904059 not found: ID does not exist"
Jul 08 22:58:16.316072 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:16.316036    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8cc5d"]
Jul 08 22:58:16.319655 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:16.319631    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-8cc5d"]
Jul 08 22:58:17.502702 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:17.502660    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8640c87-9973-42cc-8ddc-e072d02adb1c" path="/var/lib/kubelet/pods/a8640c87-9973-42cc-8ddc-e072d02adb1c/volumes"
Jul 08 22:58:22.165227 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:22.165193    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n22wp"]
Jul 08 22:58:22.165653 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:22.165379    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp" podUID="5374529f-2dec-46d3-9182-cff3e9856536" containerName="limitador" containerID="cri-o://95481146366d374e1848e9d21747fc2b47687ad979d3afb02c3b0fbd8820fa27" gracePeriod=30
Jul 08 22:58:22.166463 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:22.166440    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp"
Jul 08 22:58:23.111148 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:23.111121    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp"
Jul 08 22:58:23.174314 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:23.174278    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7lr8\" (UniqueName: \"kubernetes.io/projected/5374529f-2dec-46d3-9182-cff3e9856536-kube-api-access-t7lr8\") pod \"5374529f-2dec-46d3-9182-cff3e9856536\" (UID: \"5374529f-2dec-46d3-9182-cff3e9856536\") "
Jul 08 22:58:23.174743 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:23.174328    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5374529f-2dec-46d3-9182-cff3e9856536-config-file\") pod \"5374529f-2dec-46d3-9182-cff3e9856536\" (UID: \"5374529f-2dec-46d3-9182-cff3e9856536\") "
Jul 08 22:58:23.174796 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:23.174731    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5374529f-2dec-46d3-9182-cff3e9856536-config-file" (OuterVolumeSpecName: "config-file") pod "5374529f-2dec-46d3-9182-cff3e9856536" (UID: "5374529f-2dec-46d3-9182-cff3e9856536"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:58:23.176551 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:23.176529    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5374529f-2dec-46d3-9182-cff3e9856536-kube-api-access-t7lr8" (OuterVolumeSpecName: "kube-api-access-t7lr8") pod "5374529f-2dec-46d3-9182-cff3e9856536" (UID: "5374529f-2dec-46d3-9182-cff3e9856536"). InnerVolumeSpecName "kube-api-access-t7lr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:58:23.275830 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:23.275741    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7lr8\" (UniqueName: \"kubernetes.io/projected/5374529f-2dec-46d3-9182-cff3e9856536-kube-api-access-t7lr8\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:58:23.275830 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:23.275774    2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5374529f-2dec-46d3-9182-cff3e9856536-config-file\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:58:23.330649 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:23.330618    2574 generic.go:356] "Generic (PLEG): container finished" podID="5374529f-2dec-46d3-9182-cff3e9856536" containerID="95481146366d374e1848e9d21747fc2b47687ad979d3afb02c3b0fbd8820fa27" exitCode=0
Jul 08 22:58:23.330831 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:23.330670    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp"
Jul 08 22:58:23.330831 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:23.330679    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp" event={"ID":"5374529f-2dec-46d3-9182-cff3e9856536","Type":"ContainerDied","Data":"95481146366d374e1848e9d21747fc2b47687ad979d3afb02c3b0fbd8820fa27"}
Jul 08 22:58:23.330831 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:23.330749    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n22wp" event={"ID":"5374529f-2dec-46d3-9182-cff3e9856536","Type":"ContainerDied","Data":"0b53095c5f2dac1e82707a9c86b69a646f05fc9bc071ff42cb8b89bb363d99cc"}
Jul 08 22:58:23.330831 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:23.330779    2574 scope.go:117] "RemoveContainer" containerID="95481146366d374e1848e9d21747fc2b47687ad979d3afb02c3b0fbd8820fa27"
Jul 08 22:58:23.339126 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:23.339102    2574 scope.go:117] "RemoveContainer" containerID="95481146366d374e1848e9d21747fc2b47687ad979d3afb02c3b0fbd8820fa27"
Jul 08 22:58:23.339401 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:58:23.339379    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95481146366d374e1848e9d21747fc2b47687ad979d3afb02c3b0fbd8820fa27\": container with ID starting with 95481146366d374e1848e9d21747fc2b47687ad979d3afb02c3b0fbd8820fa27 not found: ID does not exist" containerID="95481146366d374e1848e9d21747fc2b47687ad979d3afb02c3b0fbd8820fa27"
Jul 08 22:58:23.339460 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:23.339413    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95481146366d374e1848e9d21747fc2b47687ad979d3afb02c3b0fbd8820fa27"} err="failed to get container status \"95481146366d374e1848e9d21747fc2b47687ad979d3afb02c3b0fbd8820fa27\": rpc error: code = NotFound desc = could not find container \"95481146366d374e1848e9d21747fc2b47687ad979d3afb02c3b0fbd8820fa27\": container with ID starting with 95481146366d374e1848e9d21747fc2b47687ad979d3afb02c3b0fbd8820fa27 not found: ID does not exist"
Jul 08 22:58:23.354186 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:23.354152    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n22wp"]
Jul 08 22:58:23.356054 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:23.356028    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n22wp"]
Jul 08 22:58:23.502003 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:23.501972    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5374529f-2dec-46d3-9182-cff3e9856536" path="/var/lib/kubelet/pods/5374529f-2dec-46d3-9182-cff3e9856536/volumes"
Jul 08 22:58:26.976384 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:26.976352    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dcrws"]
Jul 08 22:58:26.976887 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:26.976868    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8640c87-9973-42cc-8ddc-e072d02adb1c" containerName="authorino"
Jul 08 22:58:26.976961 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:26.976891    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8640c87-9973-42cc-8ddc-e072d02adb1c" containerName="authorino"
Jul 08 22:58:26.976961 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:26.976919    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5374529f-2dec-46d3-9182-cff3e9856536" containerName="limitador"
Jul 08 22:58:26.976961 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:26.976928    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5374529f-2dec-46d3-9182-cff3e9856536" containerName="limitador"
Jul 08 22:58:26.977112 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:26.977026    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5374529f-2dec-46d3-9182-cff3e9856536" containerName="limitador"
Jul 08 22:58:26.977112 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:26.977039    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8640c87-9973-42cc-8ddc-e072d02adb1c" containerName="authorino"
Jul 08 22:58:26.981290 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:26.981268    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dcrws"
Jul 08 22:58:26.984896 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:26.984801    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 08 22:58:26.984896 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:26.984812    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 22:58:26.985186 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:26.985167    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 22:58:26.985313 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:26.985298    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-nwz8z\""
Jul 08 22:58:26.986255 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:26.986233    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dcrws"]
Jul 08 22:58:27.112646 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:27.112607    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b7725f5d-0f40-4d55-ba13-bd685daefaf0-data\") pod \"postgres-69fb4594cf-dcrws\" (UID: \"b7725f5d-0f40-4d55-ba13-bd685daefaf0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dcrws"
Jul 08 22:58:27.112848 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:27.112720    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gjtx\" (UniqueName: \"kubernetes.io/projected/b7725f5d-0f40-4d55-ba13-bd685daefaf0-kube-api-access-5gjtx\") pod \"postgres-69fb4594cf-dcrws\" (UID: \"b7725f5d-0f40-4d55-ba13-bd685daefaf0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dcrws"
Jul 08 22:58:27.213560 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:27.213519    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gjtx\" (UniqueName: \"kubernetes.io/projected/b7725f5d-0f40-4d55-ba13-bd685daefaf0-kube-api-access-5gjtx\") pod \"postgres-69fb4594cf-dcrws\" (UID: \"b7725f5d-0f40-4d55-ba13-bd685daefaf0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dcrws"
Jul 08 22:58:27.213771 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:27.213621    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b7725f5d-0f40-4d55-ba13-bd685daefaf0-data\") pod \"postgres-69fb4594cf-dcrws\" (UID: \"b7725f5d-0f40-4d55-ba13-bd685daefaf0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dcrws"
Jul 08 22:58:27.214044 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:27.214024    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b7725f5d-0f40-4d55-ba13-bd685daefaf0-data\") pod \"postgres-69fb4594cf-dcrws\" (UID: \"b7725f5d-0f40-4d55-ba13-bd685daefaf0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dcrws"
Jul 08 22:58:27.221786 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:27.221767    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gjtx\" (UniqueName: \"kubernetes.io/projected/b7725f5d-0f40-4d55-ba13-bd685daefaf0-kube-api-access-5gjtx\") pod \"postgres-69fb4594cf-dcrws\" (UID: \"b7725f5d-0f40-4d55-ba13-bd685daefaf0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dcrws"
Jul 08 22:58:27.292940 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:27.292850    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dcrws"
Jul 08 22:58:27.421929 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:27.421906    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dcrws"]
Jul 08 22:58:27.423515 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:58:27.423486    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7725f5d_0f40_4d55_ba13_bd685daefaf0.slice/crio-3631b521759e6e7cfb5bc1d7eed054e05e5a345ce941022c3ca7d76963c872e8 WatchSource:0}: Error finding container 3631b521759e6e7cfb5bc1d7eed054e05e5a345ce941022c3ca7d76963c872e8: Status 404 returned error can't find the container with id 3631b521759e6e7cfb5bc1d7eed054e05e5a345ce941022c3ca7d76963c872e8
Jul 08 22:58:27.425144 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:27.425125    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 22:58:28.370493 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:28.370415    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dcrws" event={"ID":"b7725f5d-0f40-4d55-ba13-bd685daefaf0","Type":"ContainerStarted","Data":"3631b521759e6e7cfb5bc1d7eed054e05e5a345ce941022c3ca7d76963c872e8"}
Jul 08 22:58:32.399618 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:32.399581    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dcrws" event={"ID":"b7725f5d-0f40-4d55-ba13-bd685daefaf0","Type":"ContainerStarted","Data":"1ff251883797ce9b52fb14ae7fdd57f217f6060680c372ed98eb00899cf05cf4"}
Jul 08 22:58:32.400101 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:32.399727    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dcrws"
Jul 08 22:58:32.418756 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:32.418698    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dcrws" podStartSLOduration=1.6175530839999999 podStartE2EDuration="6.418667049s" totalImagesPullingTime="4.801113965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:58:32.417175294 +0000 UTC m=+687.441757295" watchObservedRunningTime="2026-07-08 22:58:32.418667049 +0000 UTC m=+687.443249053"
Jul 08 22:58:38.434767 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:38.434734    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dcrws"
Jul 08 22:58:38.976056 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:38.976015    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9vtjp"]
Jul 08 22:58:38.982564 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:38.982535    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9vtjp"
Jul 08 22:58:38.986734 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:38.986707    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9vtjp"]
Jul 08 22:58:39.126409 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.126368    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xs8l\" (UniqueName: \"kubernetes.io/projected/c268170d-15f2-48e7-8801-6474795a8758-kube-api-access-7xs8l\") pod \"authorino-5d4b67c446-9vtjp\" (UID: \"c268170d-15f2-48e7-8801-6474795a8758\") " pod="kuadrant-system/authorino-5d4b67c446-9vtjp"
Jul 08 22:58:39.198441 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.198407    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9vtjp"]
Jul 08 22:58:39.198710 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:58:39.198675    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7xs8l], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-9vtjp" podUID="c268170d-15f2-48e7-8801-6474795a8758"
Jul 08 22:58:39.227672 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.227593    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xs8l\" (UniqueName: \"kubernetes.io/projected/c268170d-15f2-48e7-8801-6474795a8758-kube-api-access-7xs8l\") pod \"authorino-5d4b67c446-9vtjp\" (UID: \"c268170d-15f2-48e7-8801-6474795a8758\") " pod="kuadrant-system/authorino-5d4b67c446-9vtjp"
Jul 08 22:58:39.238534 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.238509    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xs8l\" (UniqueName: \"kubernetes.io/projected/c268170d-15f2-48e7-8801-6474795a8758-kube-api-access-7xs8l\") pod \"authorino-5d4b67c446-9vtjp\" (UID: \"c268170d-15f2-48e7-8801-6474795a8758\") " pod="kuadrant-system/authorino-5d4b67c446-9vtjp"
Jul 08 22:58:39.346482 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.346446    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85bd858c6c-9nbn7"]
Jul 08 22:58:39.350530 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.350510    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85bd858c6c-9nbn7"
Jul 08 22:58:39.353287 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.353261    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 08 22:58:39.356458 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.356434    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85bd858c6c-9nbn7"]
Jul 08 22:58:39.429216 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.429182    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76gvk\" (UniqueName: \"kubernetes.io/projected/84bb1757-a6fa-4b67-a4e7-6d72e86025dc-kube-api-access-76gvk\") pod \"authorino-85bd858c6c-9nbn7\" (UID: \"84bb1757-a6fa-4b67-a4e7-6d72e86025dc\") " pod="kuadrant-system/authorino-85bd858c6c-9nbn7"
Jul 08 22:58:39.429410 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.429259    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84bb1757-a6fa-4b67-a4e7-6d72e86025dc-tls-cert\") pod \"authorino-85bd858c6c-9nbn7\" (UID: \"84bb1757-a6fa-4b67-a4e7-6d72e86025dc\") " pod="kuadrant-system/authorino-85bd858c6c-9nbn7"
Jul 08 22:58:39.433235 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.433211    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9vtjp"
Jul 08 22:58:39.440145 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.440125    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9vtjp"
Jul 08 22:58:39.530449 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.530368    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xs8l\" (UniqueName: \"kubernetes.io/projected/c268170d-15f2-48e7-8801-6474795a8758-kube-api-access-7xs8l\") pod \"c268170d-15f2-48e7-8801-6474795a8758\" (UID: \"c268170d-15f2-48e7-8801-6474795a8758\") "
Jul 08 22:58:39.530598 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.530475    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76gvk\" (UniqueName: \"kubernetes.io/projected/84bb1757-a6fa-4b67-a4e7-6d72e86025dc-kube-api-access-76gvk\") pod \"authorino-85bd858c6c-9nbn7\" (UID: \"84bb1757-a6fa-4b67-a4e7-6d72e86025dc\") " pod="kuadrant-system/authorino-85bd858c6c-9nbn7"
Jul 08 22:58:39.530598 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.530527    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84bb1757-a6fa-4b67-a4e7-6d72e86025dc-tls-cert\") pod \"authorino-85bd858c6c-9nbn7\" (UID: \"84bb1757-a6fa-4b67-a4e7-6d72e86025dc\") " pod="kuadrant-system/authorino-85bd858c6c-9nbn7"
Jul 08 22:58:39.532525 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.532496    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c268170d-15f2-48e7-8801-6474795a8758-kube-api-access-7xs8l" (OuterVolumeSpecName: "kube-api-access-7xs8l") pod "c268170d-15f2-48e7-8801-6474795a8758" (UID: "c268170d-15f2-48e7-8801-6474795a8758"). InnerVolumeSpecName "kube-api-access-7xs8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:58:39.532886 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.532868    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84bb1757-a6fa-4b67-a4e7-6d72e86025dc-tls-cert\") pod \"authorino-85bd858c6c-9nbn7\" (UID: \"84bb1757-a6fa-4b67-a4e7-6d72e86025dc\") " pod="kuadrant-system/authorino-85bd858c6c-9nbn7"
Jul 08 22:58:39.538010 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.537992    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76gvk\" (UniqueName: \"kubernetes.io/projected/84bb1757-a6fa-4b67-a4e7-6d72e86025dc-kube-api-access-76gvk\") pod \"authorino-85bd858c6c-9nbn7\" (UID: \"84bb1757-a6fa-4b67-a4e7-6d72e86025dc\") " pod="kuadrant-system/authorino-85bd858c6c-9nbn7"
Jul 08 22:58:39.631886 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.631847    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xs8l\" (UniqueName: \"kubernetes.io/projected/c268170d-15f2-48e7-8801-6474795a8758-kube-api-access-7xs8l\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:58:39.660726 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.660670    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85bd858c6c-9nbn7"
Jul 08 22:58:39.792256 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:39.792225    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85bd858c6c-9nbn7"]
Jul 08 22:58:39.793960 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:58:39.793933    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84bb1757_a6fa_4b67_a4e7_6d72e86025dc.slice/crio-4254baff93905918b26735cc7b9836df6088d5e9b1657b474caa04999acb3ca7 WatchSource:0}: Error finding container 4254baff93905918b26735cc7b9836df6088d5e9b1657b474caa04999acb3ca7: Status 404 returned error can't find the container with id 4254baff93905918b26735cc7b9836df6088d5e9b1657b474caa04999acb3ca7
Jul 08 22:58:40.439975 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:40.439885    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85bd858c6c-9nbn7" event={"ID":"84bb1757-a6fa-4b67-a4e7-6d72e86025dc","Type":"ContainerStarted","Data":"5eb8aced6ea2125a507750d2951a4d4f3cd939665ab94a2e7388282295532ff0"}
Jul 08 22:58:40.439975 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:40.439930    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85bd858c6c-9nbn7" event={"ID":"84bb1757-a6fa-4b67-a4e7-6d72e86025dc","Type":"ContainerStarted","Data":"4254baff93905918b26735cc7b9836df6088d5e9b1657b474caa04999acb3ca7"}
Jul 08 22:58:40.439975 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:40.439898    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9vtjp"
Jul 08 22:58:40.459367 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:40.459311    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85bd858c6c-9nbn7" podStartSLOduration=1.110821445 podStartE2EDuration="1.459293844s" totalImagesPullingTime="348.472399ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:58:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:58:40.457416235 +0000 UTC m=+695.481998240" watchObservedRunningTime="2026-07-08 22:58:40.459293844 +0000 UTC m=+695.483875866"
Jul 08 22:58:40.479387 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:40.479350    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9vtjp"]
Jul 08 22:58:40.486447 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:40.486420    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-twjbl"]
Jul 08 22:58:40.486639 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:40.486612    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-twjbl" podUID="6ceb824e-4395-44e9-8a78-95fcf503800e" containerName="authorino" containerID="cri-o://30101ba4ff6f4bd15dc64671ae15c1c4f96d2bd4e1e1a0c0225166ffc2a82a3a" gracePeriod=30
Jul 08 22:58:40.489868 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:40.489820    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9vtjp"]
Jul 08 22:58:40.731929 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:40.731901    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-twjbl"
Jul 08 22:58:40.842438 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:40.842398    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdq4h\" (UniqueName: \"kubernetes.io/projected/6ceb824e-4395-44e9-8a78-95fcf503800e-kube-api-access-xdq4h\") pod \"6ceb824e-4395-44e9-8a78-95fcf503800e\" (UID: \"6ceb824e-4395-44e9-8a78-95fcf503800e\") "
Jul 08 22:58:40.844398 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:40.844374    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ceb824e-4395-44e9-8a78-95fcf503800e-kube-api-access-xdq4h" (OuterVolumeSpecName: "kube-api-access-xdq4h") pod "6ceb824e-4395-44e9-8a78-95fcf503800e" (UID: "6ceb824e-4395-44e9-8a78-95fcf503800e"). InnerVolumeSpecName "kube-api-access-xdq4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:58:40.943919 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:40.943877    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdq4h\" (UniqueName: \"kubernetes.io/projected/6ceb824e-4395-44e9-8a78-95fcf503800e-kube-api-access-xdq4h\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:58:41.446584 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:41.446550    2574 generic.go:356] "Generic (PLEG): container finished" podID="6ceb824e-4395-44e9-8a78-95fcf503800e" containerID="30101ba4ff6f4bd15dc64671ae15c1c4f96d2bd4e1e1a0c0225166ffc2a82a3a" exitCode=0
Jul 08 22:58:41.447023 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:41.446591    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-twjbl"
Jul 08 22:58:41.447023 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:41.446636    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-twjbl" event={"ID":"6ceb824e-4395-44e9-8a78-95fcf503800e","Type":"ContainerDied","Data":"30101ba4ff6f4bd15dc64671ae15c1c4f96d2bd4e1e1a0c0225166ffc2a82a3a"}
Jul 08 22:58:41.447023 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:41.446676    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-twjbl" event={"ID":"6ceb824e-4395-44e9-8a78-95fcf503800e","Type":"ContainerDied","Data":"26409613e01f80bc13652f25c4a027a13343f7e0f7d0077c2e24117da8a689f7"}
Jul 08 22:58:41.447023 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:41.446714    2574 scope.go:117] "RemoveContainer" containerID="30101ba4ff6f4bd15dc64671ae15c1c4f96d2bd4e1e1a0c0225166ffc2a82a3a"
Jul 08 22:58:41.455644 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:41.455625    2574 scope.go:117] "RemoveContainer" containerID="30101ba4ff6f4bd15dc64671ae15c1c4f96d2bd4e1e1a0c0225166ffc2a82a3a"
Jul 08 22:58:41.455929 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:58:41.455912    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30101ba4ff6f4bd15dc64671ae15c1c4f96d2bd4e1e1a0c0225166ffc2a82a3a\": container with ID starting with 30101ba4ff6f4bd15dc64671ae15c1c4f96d2bd4e1e1a0c0225166ffc2a82a3a not found: ID does not exist" containerID="30101ba4ff6f4bd15dc64671ae15c1c4f96d2bd4e1e1a0c0225166ffc2a82a3a"
Jul 08 22:58:41.456050 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:41.455938    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30101ba4ff6f4bd15dc64671ae15c1c4f96d2bd4e1e1a0c0225166ffc2a82a3a"} err="failed to get container status \"30101ba4ff6f4bd15dc64671ae15c1c4f96d2bd4e1e1a0c0225166ffc2a82a3a\": rpc error: code = NotFound desc = could not find container \"30101ba4ff6f4bd15dc64671ae15c1c4f96d2bd4e1e1a0c0225166ffc2a82a3a\": container with ID starting with 30101ba4ff6f4bd15dc64671ae15c1c4f96d2bd4e1e1a0c0225166ffc2a82a3a not found: ID does not exist"
Jul 08 22:58:41.467236 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:41.467206    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-twjbl"]
Jul 08 22:58:41.470998 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:41.470976    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-twjbl"]
Jul 08 22:58:41.502851 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:41.502820    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ceb824e-4395-44e9-8a78-95fcf503800e" path="/var/lib/kubelet/pods/6ceb824e-4395-44e9-8a78-95fcf503800e/volumes"
Jul 08 22:58:41.503189 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:41.503173    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c268170d-15f2-48e7-8801-6474795a8758" path="/var/lib/kubelet/pods/c268170d-15f2-48e7-8801-6474795a8758/volumes"
Jul 08 22:58:44.961862 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:44.961824    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8686dcd8ff-7fgpm"]
Jul 08 22:58:44.962347 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:44.962217    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ceb824e-4395-44e9-8a78-95fcf503800e" containerName="authorino"
Jul 08 22:58:44.962347 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:44.962237    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ceb824e-4395-44e9-8a78-95fcf503800e" containerName="authorino"
Jul 08 22:58:44.962347 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:44.962327    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ceb824e-4395-44e9-8a78-95fcf503800e" containerName="authorino"
Jul 08 22:58:45.071882 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.071847    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8686dcd8ff-7fgpm"]
Jul 08 22:58:45.072029 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.071952    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8686dcd8ff-7fgpm"
Jul 08 22:58:45.074800 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.074769    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 22:58:45.074954 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.074876    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 22:58:45.075026 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.075004    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-djf66\""
Jul 08 22:58:45.132393 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.132357    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-795d44945-rrvsl"]
Jul 08 22:58:45.180616 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.180579    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-795d44945-rrvsl"]
Jul 08 22:58:45.180797 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.180723    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-795d44945-rrvsl"
Jul 08 22:58:45.183505 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.183484    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9422479a-cc31-4748-8776-4ed48b3713c3-webhook-cert\") pod \"maas-controller-8686dcd8ff-7fgpm\" (UID: \"9422479a-cc31-4748-8776-4ed48b3713c3\") " pod="opendatahub/maas-controller-8686dcd8ff-7fgpm"
Jul 08 22:58:45.183563 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.183542    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfsk4\" (UniqueName: \"kubernetes.io/projected/9422479a-cc31-4748-8776-4ed48b3713c3-kube-api-access-jfsk4\") pod \"maas-controller-8686dcd8ff-7fgpm\" (UID: \"9422479a-cc31-4748-8776-4ed48b3713c3\") " pod="opendatahub/maas-controller-8686dcd8ff-7fgpm"
Jul 08 22:58:45.284211 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.284121    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b1eb47d-85c7-479d-a958-d8d6e8a11f2b-webhook-cert\") pod \"maas-controller-795d44945-rrvsl\" (UID: \"2b1eb47d-85c7-479d-a958-d8d6e8a11f2b\") " pod="opendatahub/maas-controller-795d44945-rrvsl"
Jul 08 22:58:45.284211 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.284164    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlcdp\" (UniqueName: \"kubernetes.io/projected/2b1eb47d-85c7-479d-a958-d8d6e8a11f2b-kube-api-access-mlcdp\") pod \"maas-controller-795d44945-rrvsl\" (UID: \"2b1eb47d-85c7-479d-a958-d8d6e8a11f2b\") " pod="opendatahub/maas-controller-795d44945-rrvsl"
Jul 08 22:58:45.284211 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.284196    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfsk4\" (UniqueName: \"kubernetes.io/projected/9422479a-cc31-4748-8776-4ed48b3713c3-kube-api-access-jfsk4\") pod \"maas-controller-8686dcd8ff-7fgpm\" (UID: \"9422479a-cc31-4748-8776-4ed48b3713c3\") " pod="opendatahub/maas-controller-8686dcd8ff-7fgpm"
Jul 08 22:58:45.284485 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.284318    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9422479a-cc31-4748-8776-4ed48b3713c3-webhook-cert\") pod \"maas-controller-8686dcd8ff-7fgpm\" (UID: \"9422479a-cc31-4748-8776-4ed48b3713c3\") " pod="opendatahub/maas-controller-8686dcd8ff-7fgpm"
Jul 08 22:58:45.284485 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:58:45.284451    2574 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 08 22:58:45.284551 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:58:45.284508    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9422479a-cc31-4748-8776-4ed48b3713c3-webhook-cert podName:9422479a-cc31-4748-8776-4ed48b3713c3 nodeName:}" failed. No retries permitted until 2026-07-08 22:58:45.784492215 +0000 UTC m=+700.809074198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/9422479a-cc31-4748-8776-4ed48b3713c3-webhook-cert") pod "maas-controller-8686dcd8ff-7fgpm" (UID: "9422479a-cc31-4748-8776-4ed48b3713c3") : secret "maas-controller-webhook-cert" not found
Jul 08 22:58:45.294647 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.294618    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfsk4\" (UniqueName: \"kubernetes.io/projected/9422479a-cc31-4748-8776-4ed48b3713c3-kube-api-access-jfsk4\") pod \"maas-controller-8686dcd8ff-7fgpm\" (UID: \"9422479a-cc31-4748-8776-4ed48b3713c3\") " pod="opendatahub/maas-controller-8686dcd8ff-7fgpm"
Jul 08 22:58:45.385390 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.385343    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b1eb47d-85c7-479d-a958-d8d6e8a11f2b-webhook-cert\") pod \"maas-controller-795d44945-rrvsl\" (UID: \"2b1eb47d-85c7-479d-a958-d8d6e8a11f2b\") " pod="opendatahub/maas-controller-795d44945-rrvsl"
Jul 08 22:58:45.385390 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.385397    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlcdp\" (UniqueName: \"kubernetes.io/projected/2b1eb47d-85c7-479d-a958-d8d6e8a11f2b-kube-api-access-mlcdp\") pod \"maas-controller-795d44945-rrvsl\" (UID: \"2b1eb47d-85c7-479d-a958-d8d6e8a11f2b\") " pod="opendatahub/maas-controller-795d44945-rrvsl"
Jul 08 22:58:45.385594 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:58:45.385498    2574 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 08 22:58:45.385594 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:58:45.385565    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1eb47d-85c7-479d-a958-d8d6e8a11f2b-webhook-cert podName:2b1eb47d-85c7-479d-a958-d8d6e8a11f2b nodeName:}" failed. No retries permitted until 2026-07-08 22:58:45.885549089 +0000 UTC m=+700.910131075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/2b1eb47d-85c7-479d-a958-d8d6e8a11f2b-webhook-cert") pod "maas-controller-795d44945-rrvsl" (UID: "2b1eb47d-85c7-479d-a958-d8d6e8a11f2b") : secret "maas-controller-webhook-cert" not found
Jul 08 22:58:45.394634 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.394609    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlcdp\" (UniqueName: \"kubernetes.io/projected/2b1eb47d-85c7-479d-a958-d8d6e8a11f2b-kube-api-access-mlcdp\") pod \"maas-controller-795d44945-rrvsl\" (UID: \"2b1eb47d-85c7-479d-a958-d8d6e8a11f2b\") " pod="opendatahub/maas-controller-795d44945-rrvsl"
Jul 08 22:58:45.788552 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.788505    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9422479a-cc31-4748-8776-4ed48b3713c3-webhook-cert\") pod \"maas-controller-8686dcd8ff-7fgpm\" (UID: \"9422479a-cc31-4748-8776-4ed48b3713c3\") " pod="opendatahub/maas-controller-8686dcd8ff-7fgpm"
Jul 08 22:58:45.790933 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.790903    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9422479a-cc31-4748-8776-4ed48b3713c3-webhook-cert\") pod \"maas-controller-8686dcd8ff-7fgpm\" (UID: \"9422479a-cc31-4748-8776-4ed48b3713c3\") " pod="opendatahub/maas-controller-8686dcd8ff-7fgpm"
Jul 08 22:58:45.889595 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.889556    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b1eb47d-85c7-479d-a958-d8d6e8a11f2b-webhook-cert\") pod \"maas-controller-795d44945-rrvsl\" (UID: \"2b1eb47d-85c7-479d-a958-d8d6e8a11f2b\") " pod="opendatahub/maas-controller-795d44945-rrvsl"
Jul 08 22:58:45.891948 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.891920    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b1eb47d-85c7-479d-a958-d8d6e8a11f2b-webhook-cert\") pod \"maas-controller-795d44945-rrvsl\" (UID: \"2b1eb47d-85c7-479d-a958-d8d6e8a11f2b\") " pod="opendatahub/maas-controller-795d44945-rrvsl"
Jul 08 22:58:45.982727 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:45.982678    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8686dcd8ff-7fgpm"
Jul 08 22:58:46.090612 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:46.090570    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-795d44945-rrvsl"
Jul 08 22:58:46.180650 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:46.180618    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8686dcd8ff-7fgpm"]
Jul 08 22:58:46.183213 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:58:46.183168    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9422479a_cc31_4748_8776_4ed48b3713c3.slice/crio-6cdede42a26536b48da78d0e609d063f181af6f027b3b4f942dccbd955740e34 WatchSource:0}: Error finding container 6cdede42a26536b48da78d0e609d063f181af6f027b3b4f942dccbd955740e34: Status 404 returned error can't find the container with id 6cdede42a26536b48da78d0e609d063f181af6f027b3b4f942dccbd955740e34
Jul 08 22:58:46.256537 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:46.256511    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-795d44945-rrvsl"]
Jul 08 22:58:46.257564 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:58:46.257534    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b1eb47d_85c7_479d_a958_d8d6e8a11f2b.slice/crio-494fa437e30873d5e56141f18fd22af9dd182e615b486119ea749d2e7d5f16aa WatchSource:0}: Error finding container 494fa437e30873d5e56141f18fd22af9dd182e615b486119ea749d2e7d5f16aa: Status 404 returned error can't find the container with id 494fa437e30873d5e56141f18fd22af9dd182e615b486119ea749d2e7d5f16aa
Jul 08 22:58:46.474196 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:46.474163    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-795d44945-rrvsl" event={"ID":"2b1eb47d-85c7-479d-a958-d8d6e8a11f2b","Type":"ContainerStarted","Data":"494fa437e30873d5e56141f18fd22af9dd182e615b486119ea749d2e7d5f16aa"}
Jul 08 22:58:46.475358 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:46.475336    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8686dcd8ff-7fgpm" event={"ID":"9422479a-cc31-4748-8776-4ed48b3713c3","Type":"ContainerStarted","Data":"6cdede42a26536b48da78d0e609d063f181af6f027b3b4f942dccbd955740e34"}
Jul 08 22:58:49.502497 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:49.502466    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-795d44945-rrvsl"
Jul 08 22:58:49.502951 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:49.502514    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8686dcd8ff-7fgpm"
Jul 08 22:58:49.502951 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:49.502531    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-795d44945-rrvsl" event={"ID":"2b1eb47d-85c7-479d-a958-d8d6e8a11f2b","Type":"ContainerStarted","Data":"2cc6dadc60176bcae3bf433df3ba1542a279b53fea5f0d5171a643ba150afbdc"}
Jul 08 22:58:49.502951 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:49.502560    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8686dcd8ff-7fgpm" event={"ID":"9422479a-cc31-4748-8776-4ed48b3713c3","Type":"ContainerStarted","Data":"adb3a4f89fe0232cd96a35ead5acfa552b6275634030b2f05021801a4a9905f0"}
Jul 08 22:58:49.520070 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:49.520008    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-795d44945-rrvsl" podStartSLOduration=1.784352713 podStartE2EDuration="4.51999079s" totalImagesPullingTime="2.735638077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:58:49.517936118 +0000 UTC m=+704.542518128" watchObservedRunningTime="2026-07-08 22:58:49.51999079 +0000 UTC m=+704.544572796"
Jul 08 22:58:49.536102 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:58:49.536036    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8686dcd8ff-7fgpm" podStartSLOduration=2.720651604 podStartE2EDuration="5.536020374s" totalImagesPullingTime="2.81536877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:58:49.533998168 +0000 UTC m=+704.558580172" watchObservedRunningTime="2026-07-08 22:58:49.536020374 +0000 UTC m=+704.560602377"
Jul 08 22:59:01.516155 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:01.516074    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8686dcd8ff-7fgpm"
Jul 08 22:59:01.516566 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:01.516188    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-795d44945-rrvsl"
Jul 08 22:59:01.569913 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:01.569879    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8686dcd8ff-7fgpm"]
Jul 08 22:59:01.570108 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:01.570085    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-8686dcd8ff-7fgpm" podUID="9422479a-cc31-4748-8776-4ed48b3713c3" containerName="manager" containerID="cri-o://adb3a4f89fe0232cd96a35ead5acfa552b6275634030b2f05021801a4a9905f0" gracePeriod=30
Jul 08 22:59:01.820115 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:01.820083    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8686dcd8ff-7fgpm"
Jul 08 22:59:01.917462 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:01.917432    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9422479a-cc31-4748-8776-4ed48b3713c3-webhook-cert\") pod \"9422479a-cc31-4748-8776-4ed48b3713c3\" (UID: \"9422479a-cc31-4748-8776-4ed48b3713c3\") "
Jul 08 22:59:01.917638 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:01.917470    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfsk4\" (UniqueName: \"kubernetes.io/projected/9422479a-cc31-4748-8776-4ed48b3713c3-kube-api-access-jfsk4\") pod \"9422479a-cc31-4748-8776-4ed48b3713c3\" (UID: \"9422479a-cc31-4748-8776-4ed48b3713c3\") "
Jul 08 22:59:01.919646 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:01.919618    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9422479a-cc31-4748-8776-4ed48b3713c3-kube-api-access-jfsk4" (OuterVolumeSpecName: "kube-api-access-jfsk4") pod "9422479a-cc31-4748-8776-4ed48b3713c3" (UID: "9422479a-cc31-4748-8776-4ed48b3713c3"). InnerVolumeSpecName "kube-api-access-jfsk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:59:01.919781 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:01.919729    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9422479a-cc31-4748-8776-4ed48b3713c3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9422479a-cc31-4748-8776-4ed48b3713c3" (UID: "9422479a-cc31-4748-8776-4ed48b3713c3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:59:02.017994 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:02.017955    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9422479a-cc31-4748-8776-4ed48b3713c3-webhook-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:59:02.017994 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:02.017986    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfsk4\" (UniqueName: \"kubernetes.io/projected/9422479a-cc31-4748-8776-4ed48b3713c3-kube-api-access-jfsk4\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 22:59:02.566300 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:02.566270    2574 generic.go:356] "Generic (PLEG): container finished" podID="9422479a-cc31-4748-8776-4ed48b3713c3" containerID="adb3a4f89fe0232cd96a35ead5acfa552b6275634030b2f05021801a4a9905f0" exitCode=0
Jul 08 22:59:02.566680 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:02.566316    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8686dcd8ff-7fgpm"
Jul 08 22:59:02.566680 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:02.566354    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8686dcd8ff-7fgpm" event={"ID":"9422479a-cc31-4748-8776-4ed48b3713c3","Type":"ContainerDied","Data":"adb3a4f89fe0232cd96a35ead5acfa552b6275634030b2f05021801a4a9905f0"}
Jul 08 22:59:02.566680 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:02.566409    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8686dcd8ff-7fgpm" event={"ID":"9422479a-cc31-4748-8776-4ed48b3713c3","Type":"ContainerDied","Data":"6cdede42a26536b48da78d0e609d063f181af6f027b3b4f942dccbd955740e34"}
Jul 08 22:59:02.566680 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:02.566446    2574 scope.go:117] "RemoveContainer" containerID="adb3a4f89fe0232cd96a35ead5acfa552b6275634030b2f05021801a4a9905f0"
Jul 08 22:59:02.575417 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:02.575238    2574 scope.go:117] "RemoveContainer" containerID="adb3a4f89fe0232cd96a35ead5acfa552b6275634030b2f05021801a4a9905f0"
Jul 08 22:59:02.575518 ip-10-0-143-70 kubenswrapper[2574]: E0708 22:59:02.575502    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adb3a4f89fe0232cd96a35ead5acfa552b6275634030b2f05021801a4a9905f0\": container with ID starting with adb3a4f89fe0232cd96a35ead5acfa552b6275634030b2f05021801a4a9905f0 not found: ID does not exist" containerID="adb3a4f89fe0232cd96a35ead5acfa552b6275634030b2f05021801a4a9905f0"
Jul 08 22:59:02.575561 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:02.575524    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adb3a4f89fe0232cd96a35ead5acfa552b6275634030b2f05021801a4a9905f0"} err="failed to get container status \"adb3a4f89fe0232cd96a35ead5acfa552b6275634030b2f05021801a4a9905f0\": rpc error: code = NotFound desc = could not find container \"adb3a4f89fe0232cd96a35ead5acfa552b6275634030b2f05021801a4a9905f0\": container with ID starting with adb3a4f89fe0232cd96a35ead5acfa552b6275634030b2f05021801a4a9905f0 not found: ID does not exist"
Jul 08 22:59:02.588987 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:02.588953    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8686dcd8ff-7fgpm"]
Jul 08 22:59:02.591934 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:02.591909    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8686dcd8ff-7fgpm"]
Jul 08 22:59:03.502819 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:03.502786    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9422479a-cc31-4748-8776-4ed48b3713c3" path="/var/lib/kubelet/pods/9422479a-cc31-4748-8776-4ed48b3713c3/volumes"
Jul 08 22:59:22.976148 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:22.976114    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh"]
Jul 08 22:59:22.976578 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:22.976455    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9422479a-cc31-4748-8776-4ed48b3713c3" containerName="manager"
Jul 08 22:59:22.976578 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:22.976468    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9422479a-cc31-4748-8776-4ed48b3713c3" containerName="manager"
Jul 08 22:59:22.976578 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:22.976535    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9422479a-cc31-4748-8776-4ed48b3713c3" containerName="manager"
Jul 08 22:59:22.981661 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:22.981642    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh"
Jul 08 22:59:22.984481 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:22.984455    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 08 22:59:22.984624 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:22.984609    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wcbsn\""
Jul 08 22:59:22.990829 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:22.990806    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh"]
Jul 08 22:59:23.091975 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.091941    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c4f0727-9250-446b-89f9-40f2eb6598c6-openshift-service-ca\") pod \"maas-api-58b8b87c5b-d28dh\" (UID: \"8c4f0727-9250-446b-89f9-40f2eb6598c6\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh"
Jul 08 22:59:23.091975 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.091984    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86kwx\" (UniqueName: \"kubernetes.io/projected/8c4f0727-9250-446b-89f9-40f2eb6598c6-kube-api-access-86kwx\") pod \"maas-api-58b8b87c5b-d28dh\" (UID: \"8c4f0727-9250-446b-89f9-40f2eb6598c6\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh"
Jul 08 22:59:23.092231 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.092012    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c4f0727-9250-446b-89f9-40f2eb6598c6-maas-api-tls\") pod \"maas-api-58b8b87c5b-d28dh\" (UID: \"8c4f0727-9250-446b-89f9-40f2eb6598c6\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh"
Jul 08 22:59:23.192951 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.192918    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c4f0727-9250-446b-89f9-40f2eb6598c6-openshift-service-ca\") pod \"maas-api-58b8b87c5b-d28dh\" (UID: \"8c4f0727-9250-446b-89f9-40f2eb6598c6\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh"
Jul 08 22:59:23.192951 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.192954    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86kwx\" (UniqueName: \"kubernetes.io/projected/8c4f0727-9250-446b-89f9-40f2eb6598c6-kube-api-access-86kwx\") pod \"maas-api-58b8b87c5b-d28dh\" (UID: \"8c4f0727-9250-446b-89f9-40f2eb6598c6\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh"
Jul 08 22:59:23.193148 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.192980    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c4f0727-9250-446b-89f9-40f2eb6598c6-maas-api-tls\") pod \"maas-api-58b8b87c5b-d28dh\" (UID: \"8c4f0727-9250-446b-89f9-40f2eb6598c6\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh"
Jul 08 22:59:23.193706 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.193669    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c4f0727-9250-446b-89f9-40f2eb6598c6-openshift-service-ca\") pod \"maas-api-58b8b87c5b-d28dh\" (UID: \"8c4f0727-9250-446b-89f9-40f2eb6598c6\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh"
Jul 08 22:59:23.195519 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.195495    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c4f0727-9250-446b-89f9-40f2eb6598c6-maas-api-tls\") pod \"maas-api-58b8b87c5b-d28dh\" (UID: \"8c4f0727-9250-446b-89f9-40f2eb6598c6\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh"
Jul 08 22:59:23.200653 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.200633    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86kwx\" (UniqueName: \"kubernetes.io/projected/8c4f0727-9250-446b-89f9-40f2eb6598c6-kube-api-access-86kwx\") pod \"maas-api-58b8b87c5b-d28dh\" (UID: \"8c4f0727-9250-446b-89f9-40f2eb6598c6\") " pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh"
Jul 08 22:59:23.293253 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.293161    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh"
Jul 08 22:59:23.435925 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.435903    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh"]
Jul 08 22:59:23.438192 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:59:23.438163    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c4f0727_9250_446b_89f9_40f2eb6598c6.slice/crio-4e08bf7e2a37d69886593c6c80b7b3112ebb10bfb53785bbc1b90a6378752633 WatchSource:0}: Error finding container 4e08bf7e2a37d69886593c6c80b7b3112ebb10bfb53785bbc1b90a6378752633: Status 404 returned error can't find the container with id 4e08bf7e2a37d69886593c6c80b7b3112ebb10bfb53785bbc1b90a6378752633
Jul 08 22:59:23.475118 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.475084    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-28k6f"]
Jul 08 22:59:23.478757 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.478740    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-28k6f"
Jul 08 22:59:23.481497 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.481465    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-cxs4d\""
Jul 08 22:59:23.481639 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.481479    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 08 22:59:23.487873 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.487841    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-28k6f"]
Jul 08 22:59:23.596437 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.596333    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09f0ce99-c32f-4570-9668-06abf6268ae1-plugins-config-volume\") pod \"payload-processing-58f86c7798-28k6f\" (UID: \"09f0ce99-c32f-4570-9668-06abf6268ae1\") " pod="openshift-ingress/payload-processing-58f86c7798-28k6f"
Jul 08 22:59:23.596437 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.596419    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tzck\" (UniqueName: \"kubernetes.io/projected/09f0ce99-c32f-4570-9668-06abf6268ae1-kube-api-access-8tzck\") pod \"payload-processing-58f86c7798-28k6f\" (UID: \"09f0ce99-c32f-4570-9668-06abf6268ae1\") " pod="openshift-ingress/payload-processing-58f86c7798-28k6f"
Jul 08 22:59:23.672166 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.672127    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh" event={"ID":"8c4f0727-9250-446b-89f9-40f2eb6598c6","Type":"ContainerStarted","Data":"4e08bf7e2a37d69886593c6c80b7b3112ebb10bfb53785bbc1b90a6378752633"}
Jul 08 22:59:23.697604 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.697570    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tzck\" (UniqueName: \"kubernetes.io/projected/09f0ce99-c32f-4570-9668-06abf6268ae1-kube-api-access-8tzck\") pod \"payload-processing-58f86c7798-28k6f\" (UID: \"09f0ce99-c32f-4570-9668-06abf6268ae1\") " pod="openshift-ingress/payload-processing-58f86c7798-28k6f"
Jul 08 22:59:23.697803 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.697636    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09f0ce99-c32f-4570-9668-06abf6268ae1-plugins-config-volume\") pod \"payload-processing-58f86c7798-28k6f\" (UID: \"09f0ce99-c32f-4570-9668-06abf6268ae1\") " pod="openshift-ingress/payload-processing-58f86c7798-28k6f"
Jul 08 22:59:23.698303 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.698283    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09f0ce99-c32f-4570-9668-06abf6268ae1-plugins-config-volume\") pod \"payload-processing-58f86c7798-28k6f\" (UID: \"09f0ce99-c32f-4570-9668-06abf6268ae1\") " pod="openshift-ingress/payload-processing-58f86c7798-28k6f"
Jul 08 22:59:23.705222 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.705199    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tzck\" (UniqueName: \"kubernetes.io/projected/09f0ce99-c32f-4570-9668-06abf6268ae1-kube-api-access-8tzck\") pod \"payload-processing-58f86c7798-28k6f\" (UID: \"09f0ce99-c32f-4570-9668-06abf6268ae1\") " pod="openshift-ingress/payload-processing-58f86c7798-28k6f"
Jul 08 22:59:23.790608 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.790572    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-28k6f"
Jul 08 22:59:23.951430 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:23.951390    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-28k6f"]
Jul 08 22:59:23.962549 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:59:23.962501    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f0ce99_c32f_4570_9668_06abf6268ae1.slice/crio-3fad81d1d4abb4474b771c7f38fc77a5eac3be87e3ea102d0db433c3d97c3b25 WatchSource:0}: Error finding container 3fad81d1d4abb4474b771c7f38fc77a5eac3be87e3ea102d0db433c3d97c3b25: Status 404 returned error can't find the container with id 3fad81d1d4abb4474b771c7f38fc77a5eac3be87e3ea102d0db433c3d97c3b25
Jul 08 22:59:24.679325 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:24.679245    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-28k6f" event={"ID":"09f0ce99-c32f-4570-9668-06abf6268ae1","Type":"ContainerStarted","Data":"3fad81d1d4abb4474b771c7f38fc77a5eac3be87e3ea102d0db433c3d97c3b25"}
Jul 08 22:59:26.692343 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:26.692309    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh" event={"ID":"8c4f0727-9250-446b-89f9-40f2eb6598c6","Type":"ContainerStarted","Data":"641fd53e955f81cb5a9b92ea31d28a69e3e565f8217971de014fd47a4beea0f4"}
Jul 08 22:59:26.692917 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:26.692881    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh"
Jul 08 22:59:26.694387 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:26.694363    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-28k6f" event={"ID":"09f0ce99-c32f-4570-9668-06abf6268ae1","Type":"ContainerStarted","Data":"4a6f1dea9f56366841c6a773919c99c753bdf090ebdb69816f1c98f520e5ebfd"}
Jul 08 22:59:26.694461 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:26.694419    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-28k6f"
Jul 08 22:59:26.710577 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:26.710532    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh" podStartSLOduration=2.294632131 podStartE2EDuration="4.710517819s" totalImagesPullingTime="2.415885688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:59:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:59:26.708440426 +0000 UTC m=+741.733022452" watchObservedRunningTime="2026-07-08 22:59:26.710517819 +0000 UTC m=+741.735099823"
Jul 08 22:59:26.723231 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:26.723187    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-28k6f" podStartSLOduration=1.82968943 podStartE2EDuration="3.723172571s" totalImagesPullingTime="1.893483141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:59:26.721881406 +0000 UTC m=+741.746463413" watchObservedRunningTime="2026-07-08 22:59:26.723172571 +0000 UTC m=+741.747754574"
Jul 08 22:59:31.721928 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:31.721891    2574 generic.go:356] "Generic (PLEG): container finished" podID="bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce" containerID="dd4a0340104ad3766410a375c85cd429a61accae04b5b9dbe6b5d6a9128fae04" exitCode=0
Jul 08 22:59:31.721928 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:31.721928    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq" event={"ID":"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce","Type":"ContainerDied","Data":"dd4a0340104ad3766410a375c85cd429a61accae04b5b9dbe6b5d6a9128fae04"}
Jul 08 22:59:31.722405 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:31.722260    2574 scope.go:117] "RemoveContainer" containerID="dd4a0340104ad3766410a375c85cd429a61accae04b5b9dbe6b5d6a9128fae04"
Jul 08 22:59:31.723167 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:31.723141    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 22:59:31.723222 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:31.723209    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 22:59:31.723263 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:31.723237    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 22:59:32.732252 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:32.732213    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq" event={"ID":"bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce","Type":"ContainerStarted","Data":"62b1e687b98dc341736a9d34071b50ea5f7148375ebb8b254844e8d1a900c646"}
Jul 08 22:59:33.593870 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:33.593832    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:59:33.594061 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:33.594044    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-d86tq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 08 22:59:33.594108 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:33.594094    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq" podUID="bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 08 22:59:33.711296 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:33.711268    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-58b8b87c5b-d28dh"
Jul 08 22:59:34.593816 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:34.593779    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-d86tq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 08 22:59:34.594227 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:34.593838    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq" podUID="bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 08 22:59:35.593075 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:35.593044    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-d86tq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 08 22:59:35.593249 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:35.593096    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq" podUID="bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 08 22:59:36.597279 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:36.597248    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:59:36.597656 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:36.597532    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:59:36.598297 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:36.598281    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d86tq"
Jul 08 22:59:37.701840 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:37.701805    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-28k6f"
Jul 08 22:59:54.082641 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.082602    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"]
Jul 08 22:59:54.086537 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.086500    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.091053 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.090736    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 22:59:54.091053 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.090765    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qxrkl\""
Jul 08 22:59:54.091053 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.090793    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 22:59:54.091053 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.090790    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 08 22:59:54.094789 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.094760    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"]
Jul 08 22:59:54.179192 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.179161    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9405d7be-7479-4bc9-84fa-004b6362d13e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.179192 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.179199    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9405d7be-7479-4bc9-84fa-004b6362d13e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.179427 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.179272    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9405d7be-7479-4bc9-84fa-004b6362d13e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.179427 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.179300    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9405d7be-7479-4bc9-84fa-004b6362d13e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.179427 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.179324    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9405d7be-7479-4bc9-84fa-004b6362d13e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.179427 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.179381    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhblz\" (UniqueName: \"kubernetes.io/projected/9405d7be-7479-4bc9-84fa-004b6362d13e-kube-api-access-dhblz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.280614 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.280577    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9405d7be-7479-4bc9-84fa-004b6362d13e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.280803 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.280627    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhblz\" (UniqueName: \"kubernetes.io/projected/9405d7be-7479-4bc9-84fa-004b6362d13e-kube-api-access-dhblz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.280803 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.280677    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9405d7be-7479-4bc9-84fa-004b6362d13e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.280803 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.280713    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9405d7be-7479-4bc9-84fa-004b6362d13e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.280803 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.280759    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9405d7be-7479-4bc9-84fa-004b6362d13e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.280803 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.280780    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9405d7be-7479-4bc9-84fa-004b6362d13e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.281113 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.281089    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9405d7be-7479-4bc9-84fa-004b6362d13e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.281370 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.281343    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9405d7be-7479-4bc9-84fa-004b6362d13e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.281480 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.281388    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9405d7be-7479-4bc9-84fa-004b6362d13e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.283095 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.283071    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9405d7be-7479-4bc9-84fa-004b6362d13e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.283406 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.283387    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9405d7be-7479-4bc9-84fa-004b6362d13e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.289295 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.289274    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhblz\" (UniqueName: \"kubernetes.io/projected/9405d7be-7479-4bc9-84fa-004b6362d13e-kube-api-access-dhblz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tj9x8\" (UID: \"9405d7be-7479-4bc9-84fa-004b6362d13e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.399718 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.399640    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 22:59:54.539647 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.539623    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"]
Jul 08 22:59:54.541671 ip-10-0-143-70 kubenswrapper[2574]: W0708 22:59:54.541647    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9405d7be_7479_4bc9_84fa_004b6362d13e.slice/crio-dea4f1f720670efb0b97342ea0f119434c4d58c73791a930d1fde516d7396f8e WatchSource:0}: Error finding container dea4f1f720670efb0b97342ea0f119434c4d58c73791a930d1fde516d7396f8e: Status 404 returned error can't find the container with id dea4f1f720670efb0b97342ea0f119434c4d58c73791a930d1fde516d7396f8e
Jul 08 22:59:54.860100 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:54.859994    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8" event={"ID":"9405d7be-7479-4bc9-84fa-004b6362d13e","Type":"ContainerStarted","Data":"dea4f1f720670efb0b97342ea0f119434c4d58c73791a930d1fde516d7396f8e"}
Jul 08 22:59:55.867781 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:55.867737    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8" event={"ID":"9405d7be-7479-4bc9-84fa-004b6362d13e","Type":"ContainerStarted","Data":"a435b97f1f1d1822e5a36f87abf6557a36213fb529c38c9f43a4743094c1eaaf"}
Jul 08 22:59:55.892192 ip-10-0-143-70 kubenswrapper[2574]: I0708 22:59:55.892128    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8" podStartSLOduration=0.823629921 podStartE2EDuration="1.892111578s" totalImagesPullingTime="1.068481657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:59:55.890002672 +0000 UTC m=+770.914584679" watchObservedRunningTime="2026-07-08 22:59:55.892111578 +0000 UTC m=+770.916693611"
Jul 08 23:00:04.400425 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:04.400391    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 23:00:04.400896 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:04.400465    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 23:00:04.413337 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:04.413305    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 23:00:04.921758 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:04.921732    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tj9x8"
Jul 08 23:00:59.181931 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.181824    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"]
Jul 08 23:00:59.184151 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.184135    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.186803 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.186778    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 08 23:00:59.193480 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.193458    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"]
Jul 08 23:00:59.263184 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.263147    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac31ec2e-983e-4f01-a043-d9dcdc633399-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.263184 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.263181    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac31ec2e-983e-4f01-a043-d9dcdc633399-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.263381 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.263218    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7mld\" (UniqueName: \"kubernetes.io/projected/ac31ec2e-983e-4f01-a043-d9dcdc633399-kube-api-access-z7mld\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.263381 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.263248    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac31ec2e-983e-4f01-a043-d9dcdc633399-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.263381 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.263348    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac31ec2e-983e-4f01-a043-d9dcdc633399-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.263479 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.263395    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac31ec2e-983e-4f01-a043-d9dcdc633399-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.364955 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.364900    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac31ec2e-983e-4f01-a043-d9dcdc633399-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.364955 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.364956    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac31ec2e-983e-4f01-a043-d9dcdc633399-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.365182 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.365006    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7mld\" (UniqueName: \"kubernetes.io/projected/ac31ec2e-983e-4f01-a043-d9dcdc633399-kube-api-access-z7mld\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.365182 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.365052    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac31ec2e-983e-4f01-a043-d9dcdc633399-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.365182 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.365105    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac31ec2e-983e-4f01-a043-d9dcdc633399-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.365182 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.365135    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac31ec2e-983e-4f01-a043-d9dcdc633399-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.365833 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.365538    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac31ec2e-983e-4f01-a043-d9dcdc633399-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.365833 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.365786    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac31ec2e-983e-4f01-a043-d9dcdc633399-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.366285 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.366236    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac31ec2e-983e-4f01-a043-d9dcdc633399-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.368127 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.368083    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac31ec2e-983e-4f01-a043-d9dcdc633399-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.368239 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.368223    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac31ec2e-983e-4f01-a043-d9dcdc633399-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.373750 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.373724    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7mld\" (UniqueName: \"kubernetes.io/projected/ac31ec2e-983e-4f01-a043-d9dcdc633399-kube-api-access-z7mld\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hll64\" (UID: \"ac31ec2e-983e-4f01-a043-d9dcdc633399\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.494344 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.494253    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:00:59.629237 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:00:59.629208    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac31ec2e_983e_4f01_a043_d9dcdc633399.slice/crio-7c69690b0b9b0b24f4dbbe6d6c973399da499c0453e3df1130aadad885a24da9 WatchSource:0}: Error finding container 7c69690b0b9b0b24f4dbbe6d6c973399da499c0453e3df1130aadad885a24da9: Status 404 returned error can't find the container with id 7c69690b0b9b0b24f4dbbe6d6c973399da499c0453e3df1130aadad885a24da9
Jul 08 23:00:59.629390 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:00:59.629267    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"]
Jul 08 23:01:00.189122 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:01:00.189088    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64" event={"ID":"ac31ec2e-983e-4f01-a043-d9dcdc633399","Type":"ContainerStarted","Data":"7c69690b0b9b0b24f4dbbe6d6c973399da499c0453e3df1130aadad885a24da9"}
Jul 08 23:01:03.205555 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:01:03.205519    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64" event={"ID":"ac31ec2e-983e-4f01-a043-d9dcdc633399","Type":"ContainerStarted","Data":"8d253bc5ceabd8f4a77e7ce82961c7eaffabe5996850c3f055988118f02019f8"}
Jul 08 23:01:03.222742 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:01:03.222678    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64" podStartSLOduration=1.437088793 podStartE2EDuration="4.222662022s" totalImagesPullingTime="2.785573229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:01:03.221464821 +0000 UTC m=+838.246046825" watchObservedRunningTime="2026-07-08 23:01:03.222662022 +0000 UTC m=+838.247244067"
Jul 08 23:01:09.495081 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:01:09.495047    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:01:09.495629 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:01:09.495204    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:01:09.508591 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:01:09.508568    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:01:10.261323 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:01:10.261294    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hll64"
Jul 08 23:02:05.433326 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:05.433245    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 23:02:05.433935 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:05.433470    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 23:02:10.592097 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:10.592014    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75df5b66fd-xbmtk"]
Jul 08 23:02:10.595678 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:10.595658    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75df5b66fd-xbmtk"
Jul 08 23:02:10.603148 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:10.602800    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75df5b66fd-xbmtk"]
Jul 08 23:02:10.725144 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:10.725108    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpdtd\" (UniqueName: \"kubernetes.io/projected/13dc0fb8-1e25-44b9-9467-081366a2eab2-kube-api-access-cpdtd\") pod \"authorino-75df5b66fd-xbmtk\" (UID: \"13dc0fb8-1e25-44b9-9467-081366a2eab2\") " pod="kuadrant-system/authorino-75df5b66fd-xbmtk"
Jul 08 23:02:10.725420 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:10.725177    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/13dc0fb8-1e25-44b9-9467-081366a2eab2-tls-cert\") pod \"authorino-75df5b66fd-xbmtk\" (UID: \"13dc0fb8-1e25-44b9-9467-081366a2eab2\") " pod="kuadrant-system/authorino-75df5b66fd-xbmtk"
Jul 08 23:02:10.826259 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:10.826221    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpdtd\" (UniqueName: \"kubernetes.io/projected/13dc0fb8-1e25-44b9-9467-081366a2eab2-kube-api-access-cpdtd\") pod \"authorino-75df5b66fd-xbmtk\" (UID: \"13dc0fb8-1e25-44b9-9467-081366a2eab2\") " pod="kuadrant-system/authorino-75df5b66fd-xbmtk"
Jul 08 23:02:10.826478 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:10.826285    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/13dc0fb8-1e25-44b9-9467-081366a2eab2-tls-cert\") pod \"authorino-75df5b66fd-xbmtk\" (UID: \"13dc0fb8-1e25-44b9-9467-081366a2eab2\") " pod="kuadrant-system/authorino-75df5b66fd-xbmtk"
Jul 08 23:02:10.828794 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:10.828769    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/13dc0fb8-1e25-44b9-9467-081366a2eab2-tls-cert\") pod \"authorino-75df5b66fd-xbmtk\" (UID: \"13dc0fb8-1e25-44b9-9467-081366a2eab2\") " pod="kuadrant-system/authorino-75df5b66fd-xbmtk"
Jul 08 23:02:10.834323 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:10.834302    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpdtd\" (UniqueName: \"kubernetes.io/projected/13dc0fb8-1e25-44b9-9467-081366a2eab2-kube-api-access-cpdtd\") pod \"authorino-75df5b66fd-xbmtk\" (UID: \"13dc0fb8-1e25-44b9-9467-081366a2eab2\") " pod="kuadrant-system/authorino-75df5b66fd-xbmtk"
Jul 08 23:02:10.906028 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:10.905984    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75df5b66fd-xbmtk"
Jul 08 23:02:11.041545 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:11.041511    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75df5b66fd-xbmtk"]
Jul 08 23:02:11.042214 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:02:11.042191    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13dc0fb8_1e25_44b9_9467_081366a2eab2.slice/crio-cd9a10baa67ee4a45c3f0e879d05e81d2a8d31d33948ccb5523bebc3ba159134 WatchSource:0}: Error finding container cd9a10baa67ee4a45c3f0e879d05e81d2a8d31d33948ccb5523bebc3ba159134: Status 404 returned error can't find the container with id cd9a10baa67ee4a45c3f0e879d05e81d2a8d31d33948ccb5523bebc3ba159134
Jul 08 23:02:11.564472 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:11.564444    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75df5b66fd-xbmtk" event={"ID":"13dc0fb8-1e25-44b9-9467-081366a2eab2","Type":"ContainerStarted","Data":"cd9a10baa67ee4a45c3f0e879d05e81d2a8d31d33948ccb5523bebc3ba159134"}
Jul 08 23:02:12.572800 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:12.572758    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75df5b66fd-xbmtk" event={"ID":"13dc0fb8-1e25-44b9-9467-081366a2eab2","Type":"ContainerStarted","Data":"63dfd98545d3762cec253bad38084d888d5e7db5ec98baaca65ff01dffa1438f"}
Jul 08 23:02:12.589043 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:12.588977    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75df5b66fd-xbmtk" podStartSLOduration=2.125538315 podStartE2EDuration="2.588955416s" totalImagesPullingTime="463.417101ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:02:12.588283422 +0000 UTC m=+907.612865438" watchObservedRunningTime="2026-07-08 23:02:12.588955416 +0000 UTC m=+907.613537420"
Jul 08 23:02:12.614377 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:12.614324    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85bd858c6c-9nbn7"]
Jul 08 23:02:12.614618 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:12.614588    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-85bd858c6c-9nbn7" podUID="84bb1757-a6fa-4b67-a4e7-6d72e86025dc" containerName="authorino" containerID="cri-o://5eb8aced6ea2125a507750d2951a4d4f3cd939665ab94a2e7388282295532ff0" gracePeriod=30
Jul 08 23:02:12.876081 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:12.876049    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85bd858c6c-9nbn7"
Jul 08 23:02:13.046074 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:13.046039    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84bb1757-a6fa-4b67-a4e7-6d72e86025dc-tls-cert\") pod \"84bb1757-a6fa-4b67-a4e7-6d72e86025dc\" (UID: \"84bb1757-a6fa-4b67-a4e7-6d72e86025dc\") "
Jul 08 23:02:13.046250 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:13.046150    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76gvk\" (UniqueName: \"kubernetes.io/projected/84bb1757-a6fa-4b67-a4e7-6d72e86025dc-kube-api-access-76gvk\") pod \"84bb1757-a6fa-4b67-a4e7-6d72e86025dc\" (UID: \"84bb1757-a6fa-4b67-a4e7-6d72e86025dc\") "
Jul 08 23:02:13.048214 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:13.048186    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84bb1757-a6fa-4b67-a4e7-6d72e86025dc-kube-api-access-76gvk" (OuterVolumeSpecName: "kube-api-access-76gvk") pod "84bb1757-a6fa-4b67-a4e7-6d72e86025dc" (UID: "84bb1757-a6fa-4b67-a4e7-6d72e86025dc"). InnerVolumeSpecName "kube-api-access-76gvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:02:13.056984 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:13.056832    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84bb1757-a6fa-4b67-a4e7-6d72e86025dc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "84bb1757-a6fa-4b67-a4e7-6d72e86025dc" (UID: "84bb1757-a6fa-4b67-a4e7-6d72e86025dc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:02:13.147360 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:13.147322    2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84bb1757-a6fa-4b67-a4e7-6d72e86025dc-tls-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:02:13.147360 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:13.147352    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76gvk\" (UniqueName: \"kubernetes.io/projected/84bb1757-a6fa-4b67-a4e7-6d72e86025dc-kube-api-access-76gvk\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:02:13.579759 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:13.579724    2574 generic.go:356] "Generic (PLEG): container finished" podID="84bb1757-a6fa-4b67-a4e7-6d72e86025dc" containerID="5eb8aced6ea2125a507750d2951a4d4f3cd939665ab94a2e7388282295532ff0" exitCode=0
Jul 08 23:02:13.579759 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:13.579768    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85bd858c6c-9nbn7"
Jul 08 23:02:13.580323 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:13.579811    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85bd858c6c-9nbn7" event={"ID":"84bb1757-a6fa-4b67-a4e7-6d72e86025dc","Type":"ContainerDied","Data":"5eb8aced6ea2125a507750d2951a4d4f3cd939665ab94a2e7388282295532ff0"}
Jul 08 23:02:13.580323 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:13.579853    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85bd858c6c-9nbn7" event={"ID":"84bb1757-a6fa-4b67-a4e7-6d72e86025dc","Type":"ContainerDied","Data":"4254baff93905918b26735cc7b9836df6088d5e9b1657b474caa04999acb3ca7"}
Jul 08 23:02:13.580323 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:13.579876    2574 scope.go:117] "RemoveContainer" containerID="5eb8aced6ea2125a507750d2951a4d4f3cd939665ab94a2e7388282295532ff0"
Jul 08 23:02:13.589184 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:13.589161    2574 scope.go:117] "RemoveContainer" containerID="5eb8aced6ea2125a507750d2951a4d4f3cd939665ab94a2e7388282295532ff0"
Jul 08 23:02:13.589500 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:02:13.589473    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eb8aced6ea2125a507750d2951a4d4f3cd939665ab94a2e7388282295532ff0\": container with ID starting with 5eb8aced6ea2125a507750d2951a4d4f3cd939665ab94a2e7388282295532ff0 not found: ID does not exist" containerID="5eb8aced6ea2125a507750d2951a4d4f3cd939665ab94a2e7388282295532ff0"
Jul 08 23:02:13.589599 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:13.589514    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eb8aced6ea2125a507750d2951a4d4f3cd939665ab94a2e7388282295532ff0"} err="failed to get container status \"5eb8aced6ea2125a507750d2951a4d4f3cd939665ab94a2e7388282295532ff0\": rpc error: code = NotFound desc = could not find container \"5eb8aced6ea2125a507750d2951a4d4f3cd939665ab94a2e7388282295532ff0\": container with ID starting with 5eb8aced6ea2125a507750d2951a4d4f3cd939665ab94a2e7388282295532ff0 not found: ID does not exist"
Jul 08 23:02:13.596428 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:13.596403    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85bd858c6c-9nbn7"]
Jul 08 23:02:13.599561 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:13.599539    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-85bd858c6c-9nbn7"]
Jul 08 23:02:15.502431 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:02:15.502395    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84bb1757-a6fa-4b67-a4e7-6d72e86025dc" path="/var/lib/kubelet/pods/84bb1757-a6fa-4b67-a4e7-6d72e86025dc/volumes"
Jul 08 23:03:21.873098 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:21.873055    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-795d44945-rrvsl"]
Jul 08 23:03:21.873673 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:21.873310    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-795d44945-rrvsl" podUID="2b1eb47d-85c7-479d-a958-d8d6e8a11f2b" containerName="manager" containerID="cri-o://2cc6dadc60176bcae3bf433df3ba1542a279b53fea5f0d5171a643ba150afbdc" gracePeriod=30
Jul 08 23:03:22.120270 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:22.120245    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-795d44945-rrvsl"
Jul 08 23:03:22.161005 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:22.160917    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlcdp\" (UniqueName: \"kubernetes.io/projected/2b1eb47d-85c7-479d-a958-d8d6e8a11f2b-kube-api-access-mlcdp\") pod \"2b1eb47d-85c7-479d-a958-d8d6e8a11f2b\" (UID: \"2b1eb47d-85c7-479d-a958-d8d6e8a11f2b\") "
Jul 08 23:03:22.161170 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:22.161031    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b1eb47d-85c7-479d-a958-d8d6e8a11f2b-webhook-cert\") pod \"2b1eb47d-85c7-479d-a958-d8d6e8a11f2b\" (UID: \"2b1eb47d-85c7-479d-a958-d8d6e8a11f2b\") "
Jul 08 23:03:22.163028 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:22.162999    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b1eb47d-85c7-479d-a958-d8d6e8a11f2b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2b1eb47d-85c7-479d-a958-d8d6e8a11f2b" (UID: "2b1eb47d-85c7-479d-a958-d8d6e8a11f2b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:03:22.163152 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:22.163112    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b1eb47d-85c7-479d-a958-d8d6e8a11f2b-kube-api-access-mlcdp" (OuterVolumeSpecName: "kube-api-access-mlcdp") pod "2b1eb47d-85c7-479d-a958-d8d6e8a11f2b" (UID: "2b1eb47d-85c7-479d-a958-d8d6e8a11f2b"). InnerVolumeSpecName "kube-api-access-mlcdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:03:22.262487 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:22.262450    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b1eb47d-85c7-479d-a958-d8d6e8a11f2b-webhook-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:03:22.262487 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:22.262482    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlcdp\" (UniqueName: \"kubernetes.io/projected/2b1eb47d-85c7-479d-a958-d8d6e8a11f2b-kube-api-access-mlcdp\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:03:22.949751 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:22.949716    2574 generic.go:356] "Generic (PLEG): container finished" podID="2b1eb47d-85c7-479d-a958-d8d6e8a11f2b" containerID="2cc6dadc60176bcae3bf433df3ba1542a279b53fea5f0d5171a643ba150afbdc" exitCode=0
Jul 08 23:03:22.950178 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:22.949763    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-795d44945-rrvsl"
Jul 08 23:03:22.950178 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:22.949788    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-795d44945-rrvsl" event={"ID":"2b1eb47d-85c7-479d-a958-d8d6e8a11f2b","Type":"ContainerDied","Data":"2cc6dadc60176bcae3bf433df3ba1542a279b53fea5f0d5171a643ba150afbdc"}
Jul 08 23:03:22.950178 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:22.949852    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-795d44945-rrvsl" event={"ID":"2b1eb47d-85c7-479d-a958-d8d6e8a11f2b","Type":"ContainerDied","Data":"494fa437e30873d5e56141f18fd22af9dd182e615b486119ea749d2e7d5f16aa"}
Jul 08 23:03:22.950178 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:22.949880    2574 scope.go:117] "RemoveContainer" containerID="2cc6dadc60176bcae3bf433df3ba1542a279b53fea5f0d5171a643ba150afbdc"
Jul 08 23:03:22.959855 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:22.959836    2574 scope.go:117] "RemoveContainer" containerID="2cc6dadc60176bcae3bf433df3ba1542a279b53fea5f0d5171a643ba150afbdc"
Jul 08 23:03:22.960095 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:03:22.960080    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cc6dadc60176bcae3bf433df3ba1542a279b53fea5f0d5171a643ba150afbdc\": container with ID starting with 2cc6dadc60176bcae3bf433df3ba1542a279b53fea5f0d5171a643ba150afbdc not found: ID does not exist" containerID="2cc6dadc60176bcae3bf433df3ba1542a279b53fea5f0d5171a643ba150afbdc"
Jul 08 23:03:22.960153 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:22.960102    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cc6dadc60176bcae3bf433df3ba1542a279b53fea5f0d5171a643ba150afbdc"} err="failed to get container status \"2cc6dadc60176bcae3bf433df3ba1542a279b53fea5f0d5171a643ba150afbdc\": rpc error: code = NotFound desc = could not find container \"2cc6dadc60176bcae3bf433df3ba1542a279b53fea5f0d5171a643ba150afbdc\": container with ID starting with 2cc6dadc60176bcae3bf433df3ba1542a279b53fea5f0d5171a643ba150afbdc not found: ID does not exist"
Jul 08 23:03:22.971380 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:22.971354    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-795d44945-rrvsl"]
Jul 08 23:03:22.974424 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:22.974404    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-795d44945-rrvsl"]
Jul 08 23:03:23.502736 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.502705    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b1eb47d-85c7-479d-a958-d8d6e8a11f2b" path="/var/lib/kubelet/pods/2b1eb47d-85c7-479d-a958-d8d6e8a11f2b/volumes"
Jul 08 23:03:23.725519 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.725485    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-795d44945-w2s42"]
Jul 08 23:03:23.726047 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.726031    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b1eb47d-85c7-479d-a958-d8d6e8a11f2b" containerName="manager"
Jul 08 23:03:23.726098 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.726051    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b1eb47d-85c7-479d-a958-d8d6e8a11f2b" containerName="manager"
Jul 08 23:03:23.726098 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.726095    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84bb1757-a6fa-4b67-a4e7-6d72e86025dc" containerName="authorino"
Jul 08 23:03:23.726169 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.726104    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="84bb1757-a6fa-4b67-a4e7-6d72e86025dc" containerName="authorino"
Jul 08 23:03:23.726201 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.726186    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="84bb1757-a6fa-4b67-a4e7-6d72e86025dc" containerName="authorino"
Jul 08 23:03:23.726234 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.726199    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b1eb47d-85c7-479d-a958-d8d6e8a11f2b" containerName="manager"
Jul 08 23:03:23.731047 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.731027    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-795d44945-w2s42"
Jul 08 23:03:23.734800 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.734771    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-djf66\""
Jul 08 23:03:23.734935 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.734773    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 23:03:23.735250 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.735143    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 23:03:23.737122 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.737103    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-795d44945-w2s42"]
Jul 08 23:03:23.778095 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.778019    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v944\" (UniqueName: \"kubernetes.io/projected/f9e60fc3-7d05-45c1-a49a-377f22343f32-kube-api-access-8v944\") pod \"maas-controller-795d44945-w2s42\" (UID: \"f9e60fc3-7d05-45c1-a49a-377f22343f32\") " pod="opendatahub/maas-controller-795d44945-w2s42"
Jul 08 23:03:23.778095 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.778056    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9e60fc3-7d05-45c1-a49a-377f22343f32-webhook-cert\") pod \"maas-controller-795d44945-w2s42\" (UID: \"f9e60fc3-7d05-45c1-a49a-377f22343f32\") " pod="opendatahub/maas-controller-795d44945-w2s42"
Jul 08 23:03:23.879335 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.879305    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v944\" (UniqueName: \"kubernetes.io/projected/f9e60fc3-7d05-45c1-a49a-377f22343f32-kube-api-access-8v944\") pod \"maas-controller-795d44945-w2s42\" (UID: \"f9e60fc3-7d05-45c1-a49a-377f22343f32\") " pod="opendatahub/maas-controller-795d44945-w2s42"
Jul 08 23:03:23.879488 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.879347    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9e60fc3-7d05-45c1-a49a-377f22343f32-webhook-cert\") pod \"maas-controller-795d44945-w2s42\" (UID: \"f9e60fc3-7d05-45c1-a49a-377f22343f32\") " pod="opendatahub/maas-controller-795d44945-w2s42"
Jul 08 23:03:23.882117 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.882091    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9e60fc3-7d05-45c1-a49a-377f22343f32-webhook-cert\") pod \"maas-controller-795d44945-w2s42\" (UID: \"f9e60fc3-7d05-45c1-a49a-377f22343f32\") " pod="opendatahub/maas-controller-795d44945-w2s42"
Jul 08 23:03:23.887298 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:23.887272    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v944\" (UniqueName: \"kubernetes.io/projected/f9e60fc3-7d05-45c1-a49a-377f22343f32-kube-api-access-8v944\") pod \"maas-controller-795d44945-w2s42\" (UID: \"f9e60fc3-7d05-45c1-a49a-377f22343f32\") " pod="opendatahub/maas-controller-795d44945-w2s42"
Jul 08 23:03:24.042788 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:24.042672    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-795d44945-w2s42"
Jul 08 23:03:24.180041 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:24.179988    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-795d44945-w2s42"]
Jul 08 23:03:24.184262 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:03:24.184234    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e60fc3_7d05_45c1_a49a_377f22343f32.slice/crio-dc52f63e99ca133d0b8ba9ecae91c8eddb3056d7b237b4ae7a0653301071004f WatchSource:0}: Error finding container dc52f63e99ca133d0b8ba9ecae91c8eddb3056d7b237b4ae7a0653301071004f: Status 404 returned error can't find the container with id dc52f63e99ca133d0b8ba9ecae91c8eddb3056d7b237b4ae7a0653301071004f
Jul 08 23:03:24.964244 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:24.964217    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-795d44945-w2s42" event={"ID":"f9e60fc3-7d05-45c1-a49a-377f22343f32","Type":"ContainerStarted","Data":"dc52f63e99ca133d0b8ba9ecae91c8eddb3056d7b237b4ae7a0653301071004f"}
Jul 08 23:03:25.976197 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:25.976159    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-795d44945-w2s42" event={"ID":"f9e60fc3-7d05-45c1-a49a-377f22343f32","Type":"ContainerStarted","Data":"c308f16972a27660aabbe5a1e37eb5c671d40ca3e76cafcf8804cecd6a5d640d"}
Jul 08 23:03:25.976601 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:25.976308    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-795d44945-w2s42"
Jul 08 23:03:25.995240 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:25.995181    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-795d44945-w2s42" podStartSLOduration=2.26567928 podStartE2EDuration="2.995165727s" totalImagesPullingTime="729.486447ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:25.99291021 +0000 UTC m=+981.017492215" watchObservedRunningTime="2026-07-08 23:03:25.995165727 +0000 UTC m=+981.019747729"
Jul 08 23:03:36.986823 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:03:36.986743    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-795d44945-w2s42"
Jul 08 23:07:05.482391 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:07:05.482302    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 23:07:05.483014 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:07:05.482942    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 23:08:08.084340 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:08.084244    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"]
Jul 08 23:08:08.084951 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:08.084500    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt" podUID="96d109f3-a17c-4569-bf35-ed9f1a48e7cb" containerName="manager" containerID="cri-o://45870402565a3dd5562bc52558a24b7203323efc4b1422ea84be2179b44842f5" gracePeriod=10
Jul 08 23:08:12.234040 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:12.234013    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"
Jul 08 23:08:12.368159 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:12.368127    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnpgt\" (UniqueName: \"kubernetes.io/projected/96d109f3-a17c-4569-bf35-ed9f1a48e7cb-kube-api-access-wnpgt\") pod \"96d109f3-a17c-4569-bf35-ed9f1a48e7cb\" (UID: \"96d109f3-a17c-4569-bf35-ed9f1a48e7cb\") "
Jul 08 23:08:12.368349 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:12.368219    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96d109f3-a17c-4569-bf35-ed9f1a48e7cb-extensions-socket-volume\") pod \"96d109f3-a17c-4569-bf35-ed9f1a48e7cb\" (UID: \"96d109f3-a17c-4569-bf35-ed9f1a48e7cb\") "
Jul 08 23:08:12.368577 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:12.368554    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96d109f3-a17c-4569-bf35-ed9f1a48e7cb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "96d109f3-a17c-4569-bf35-ed9f1a48e7cb" (UID: "96d109f3-a17c-4569-bf35-ed9f1a48e7cb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:08:12.370217 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:12.370189    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96d109f3-a17c-4569-bf35-ed9f1a48e7cb-kube-api-access-wnpgt" (OuterVolumeSpecName: "kube-api-access-wnpgt") pod "96d109f3-a17c-4569-bf35-ed9f1a48e7cb" (UID: "96d109f3-a17c-4569-bf35-ed9f1a48e7cb"). InnerVolumeSpecName "kube-api-access-wnpgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:08:12.470014 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:12.469971    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96d109f3-a17c-4569-bf35-ed9f1a48e7cb-extensions-socket-volume\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:08:12.470014 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:12.470006    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnpgt\" (UniqueName: \"kubernetes.io/projected/96d109f3-a17c-4569-bf35-ed9f1a48e7cb-kube-api-access-wnpgt\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:08:12.490477 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:12.490443    2574 generic.go:356] "Generic (PLEG): container finished" podID="96d109f3-a17c-4569-bf35-ed9f1a48e7cb" containerID="45870402565a3dd5562bc52558a24b7203323efc4b1422ea84be2179b44842f5" exitCode=0
Jul 08 23:08:12.490663 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:12.490483    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt" event={"ID":"96d109f3-a17c-4569-bf35-ed9f1a48e7cb","Type":"ContainerDied","Data":"45870402565a3dd5562bc52558a24b7203323efc4b1422ea84be2179b44842f5"}
Jul 08 23:08:12.490663 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:12.490489    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"
Jul 08 23:08:12.490663 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:12.490536    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt" event={"ID":"96d109f3-a17c-4569-bf35-ed9f1a48e7cb","Type":"ContainerDied","Data":"171d09d21755b391b27a5561344c78cdc69d0d1f161a59fc3ca0b9ef86b4eaf7"}
Jul 08 23:08:12.490663 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:12.490563    2574 scope.go:117] "RemoveContainer" containerID="45870402565a3dd5562bc52558a24b7203323efc4b1422ea84be2179b44842f5"
Jul 08 23:08:12.501060 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:12.501044    2574 scope.go:117] "RemoveContainer" containerID="45870402565a3dd5562bc52558a24b7203323efc4b1422ea84be2179b44842f5"
Jul 08 23:08:12.501328 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:08:12.501310    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45870402565a3dd5562bc52558a24b7203323efc4b1422ea84be2179b44842f5\": container with ID starting with 45870402565a3dd5562bc52558a24b7203323efc4b1422ea84be2179b44842f5 not found: ID does not exist" containerID="45870402565a3dd5562bc52558a24b7203323efc4b1422ea84be2179b44842f5"
Jul 08 23:08:12.501366 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:12.501339    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45870402565a3dd5562bc52558a24b7203323efc4b1422ea84be2179b44842f5"} err="failed to get container status \"45870402565a3dd5562bc52558a24b7203323efc4b1422ea84be2179b44842f5\": rpc error: code = NotFound desc = could not find container \"45870402565a3dd5562bc52558a24b7203323efc4b1422ea84be2179b44842f5\": container with ID starting with 45870402565a3dd5562bc52558a24b7203323efc4b1422ea84be2179b44842f5 not found: ID does not exist"
Jul 08 23:08:12.515716 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:12.515669    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"]
Jul 08 23:08:12.519508 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:12.519485    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f9btt"]
Jul 08 23:08:13.502023 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:08:13.501992    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96d109f3-a17c-4569-bf35-ed9f1a48e7cb" path="/var/lib/kubelet/pods/96d109f3-a17c-4569-bf35-ed9f1a48e7cb/volumes"
Jul 08 23:09:09.187027 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.186989    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fng6d"]
Jul 08 23:09:09.187432 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.187355    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d109f3-a17c-4569-bf35-ed9f1a48e7cb" containerName="manager"
Jul 08 23:09:09.187432 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.187366    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d109f3-a17c-4569-bf35-ed9f1a48e7cb" containerName="manager"
Jul 08 23:09:09.187432 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.187417    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="96d109f3-a17c-4569-bf35-ed9f1a48e7cb" containerName="manager"
Jul 08 23:09:09.191450 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.191434    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fng6d"
Jul 08 23:09:09.194171 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.194151    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9wrlv\""
Jul 08 23:09:09.202002 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.201978    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fng6d"]
Jul 08 23:09:09.366733 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.366669    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkqch\" (UniqueName: \"kubernetes.io/projected/586ee5be-92ef-4c37-8028-b48c0a97833b-kube-api-access-rkqch\") pod \"kuadrant-operator-controller-manager-86878c769f-fng6d\" (UID: \"586ee5be-92ef-4c37-8028-b48c0a97833b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fng6d"
Jul 08 23:09:09.366926 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.366858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/586ee5be-92ef-4c37-8028-b48c0a97833b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fng6d\" (UID: \"586ee5be-92ef-4c37-8028-b48c0a97833b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fng6d"
Jul 08 23:09:09.468303 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.468223    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/586ee5be-92ef-4c37-8028-b48c0a97833b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fng6d\" (UID: \"586ee5be-92ef-4c37-8028-b48c0a97833b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fng6d"
Jul 08 23:09:09.468303 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.468261    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkqch\" (UniqueName: \"kubernetes.io/projected/586ee5be-92ef-4c37-8028-b48c0a97833b-kube-api-access-rkqch\") pod \"kuadrant-operator-controller-manager-86878c769f-fng6d\" (UID: \"586ee5be-92ef-4c37-8028-b48c0a97833b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fng6d"
Jul 08 23:09:09.468590 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.468571    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/586ee5be-92ef-4c37-8028-b48c0a97833b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fng6d\" (UID: \"586ee5be-92ef-4c37-8028-b48c0a97833b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fng6d"
Jul 08 23:09:09.478225 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.478192    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkqch\" (UniqueName: \"kubernetes.io/projected/586ee5be-92ef-4c37-8028-b48c0a97833b-kube-api-access-rkqch\") pod \"kuadrant-operator-controller-manager-86878c769f-fng6d\" (UID: \"586ee5be-92ef-4c37-8028-b48c0a97833b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fng6d"
Jul 08 23:09:09.502638 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.502612    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fng6d"
Jul 08 23:09:09.644024 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.644002    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fng6d"]
Jul 08 23:09:09.646582 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:09:09.646555    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod586ee5be_92ef_4c37_8028_b48c0a97833b.slice/crio-3de611a54569e5c6a5304e87116eaf4d53867d8f9b395087afcd06ddc4b14830 WatchSource:0}: Error finding container 3de611a54569e5c6a5304e87116eaf4d53867d8f9b395087afcd06ddc4b14830: Status 404 returned error can't find the container with id 3de611a54569e5c6a5304e87116eaf4d53867d8f9b395087afcd06ddc4b14830
Jul 08 23:09:09.785290 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.785195    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fng6d" event={"ID":"586ee5be-92ef-4c37-8028-b48c0a97833b","Type":"ContainerStarted","Data":"1adee9dea7d1124f3cc8dd9e0beed6f3c485efe7ccddc331eaa3cd43c20549f0"}
Jul 08 23:09:09.785290 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.785255    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fng6d" event={"ID":"586ee5be-92ef-4c37-8028-b48c0a97833b","Type":"ContainerStarted","Data":"3de611a54569e5c6a5304e87116eaf4d53867d8f9b395087afcd06ddc4b14830"}
Jul 08 23:09:09.785290 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.785279    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fng6d"
Jul 08 23:09:09.805400 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:09.805351    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fng6d" podStartSLOduration=0.805334625 podStartE2EDuration="805.334625ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:09:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:09:09.804052643 +0000 UTC m=+1324.828634644" watchObservedRunningTime="2026-07-08 23:09:09.805334625 +0000 UTC m=+1324.829916628"
Jul 08 23:09:20.792334 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:09:20.792301    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fng6d"
Jul 08 23:12:05.518089 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:12:05.518061    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 23:12:05.520737 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:12:05.518301    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 23:15:27.400204 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.400111    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"]
Jul 08 23:15:27.403413 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.403391    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.406044 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.406027    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-80b25501-openshift-default-dockercfg-xk9z9\""
Jul 08 23:15:27.417213 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.417191    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"]
Jul 08 23:15:27.481818 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.481781    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-data\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.482019 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.481831    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-credential-socket\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.482019 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.481918    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7566g\" (UniqueName: \"kubernetes.io/projected/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-kube-api-access-7566g\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.482019 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.481943    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-workload-socket\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.482019 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.481966    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-podinfo\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.482019 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.481987    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-token\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.482202 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.482065    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-envoy\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.482202 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.482100    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-workload-certs\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.482202 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.482120    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istiod-ca-cert\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.582774 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.582726    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-data\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.582979 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.582785    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-credential-socket\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.582979 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.582831    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7566g\" (UniqueName: \"kubernetes.io/projected/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-kube-api-access-7566g\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.582979 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.582851    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-workload-socket\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.582979 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.582917    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-podinfo\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.582979 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.582947    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-token\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.583267 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.582986    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-envoy\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.583267 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.583018    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-workload-certs\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.583267 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.583049    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istiod-ca-cert\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.583267 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.583154    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-data\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.583267 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.583209    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-credential-socket\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.583267 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.583254    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-workload-socket\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.583471 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.583405    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-workload-certs\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.583724 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.583677    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istiod-ca-cert\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.585203 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.585178    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-envoy\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.585427 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.585409    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-podinfo\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.590928 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.590904    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-token\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.591048 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.590995    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7566g\" (UniqueName: \"kubernetes.io/projected/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-kube-api-access-7566g\") pod \"e2e-ait-80b25501-openshift-default-6954888c89-2gckt\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") " pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.713510 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.713420    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:27.854728 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.854676    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"]
Jul 08 23:15:27.855553 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:15:27.855528    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fabee41_c0da_44cc_a771_7f36cb6dd9f0.slice/crio-af24a721321d04e6fca668b7cf047c922895f5e926943447676f26594fce634c WatchSource:0}: Error finding container af24a721321d04e6fca668b7cf047c922895f5e926943447676f26594fce634c: Status 404 returned error can't find the container with id af24a721321d04e6fca668b7cf047c922895f5e926943447676f26594fce634c
Jul 08 23:15:27.857741 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.857707    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:15:27.857828 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.857772    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:15:27.857828 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:27.857800    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:15:28.602438 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:28.602402    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"]
Jul 08 23:15:28.615035 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:28.615002    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"
Jul 08 23:15:28.616255 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:28.616226    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"]
Jul 08 23:15:28.618089 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:28.618065    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-80b25501-serving-cert\""
Jul 08 23:15:28.693700 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:28.693642    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hkzb\" (UniqueName: \"kubernetes.io/projected/920b7c12-34a0-4ac6-98e3-5423c78f34c4-kube-api-access-8hkzb\") pod \"maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf\" (UID: \"920b7c12-34a0-4ac6-98e3-5423c78f34c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"
Jul 08 23:15:28.693892 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:28.693722    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/920b7c12-34a0-4ac6-98e3-5423c78f34c4-openshift-service-ca\") pod \"maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf\" (UID: \"920b7c12-34a0-4ac6-98e3-5423c78f34c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"
Jul 08 23:15:28.693892 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:28.693783    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/920b7c12-34a0-4ac6-98e3-5423c78f34c4-maas-api-tls\") pod \"maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf\" (UID: \"920b7c12-34a0-4ac6-98e3-5423c78f34c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"
Jul 08 23:15:28.784574 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:28.784541    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt" event={"ID":"8fabee41-c0da-44cc-a771-7f36cb6dd9f0","Type":"ContainerStarted","Data":"759b7ba82e6f3db20dcbc2daf0ea3862c7b029e82f83e25b476b92f86e6a3ce9"}
Jul 08 23:15:28.784802 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:28.784597    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt" event={"ID":"8fabee41-c0da-44cc-a771-7f36cb6dd9f0","Type":"ContainerStarted","Data":"af24a721321d04e6fca668b7cf047c922895f5e926943447676f26594fce634c"}
Jul 08 23:15:28.795295 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:28.795245    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/920b7c12-34a0-4ac6-98e3-5423c78f34c4-maas-api-tls\") pod \"maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf\" (UID: \"920b7c12-34a0-4ac6-98e3-5423c78f34c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"
Jul 08 23:15:28.795497 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:28.795416    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hkzb\" (UniqueName: \"kubernetes.io/projected/920b7c12-34a0-4ac6-98e3-5423c78f34c4-kube-api-access-8hkzb\") pod \"maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf\" (UID: \"920b7c12-34a0-4ac6-98e3-5423c78f34c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"
Jul 08 23:15:28.795497 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:28.795478    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/920b7c12-34a0-4ac6-98e3-5423c78f34c4-openshift-service-ca\") pod \"maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf\" (UID: \"920b7c12-34a0-4ac6-98e3-5423c78f34c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"
Jul 08 23:15:28.796383 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:28.796354    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/920b7c12-34a0-4ac6-98e3-5423c78f34c4-openshift-service-ca\") pod \"maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf\" (UID: \"920b7c12-34a0-4ac6-98e3-5423c78f34c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"
Jul 08 23:15:28.797937 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:28.797908    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/920b7c12-34a0-4ac6-98e3-5423c78f34c4-maas-api-tls\") pod \"maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf\" (UID: \"920b7c12-34a0-4ac6-98e3-5423c78f34c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"
Jul 08 23:15:28.807301 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:28.807244    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hkzb\" (UniqueName: \"kubernetes.io/projected/920b7c12-34a0-4ac6-98e3-5423c78f34c4-kube-api-access-8hkzb\") pod \"maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf\" (UID: \"920b7c12-34a0-4ac6-98e3-5423c78f34c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"
Jul 08 23:15:28.810854 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:28.810789    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt" podStartSLOduration=1.8107681740000001 podStartE2EDuration="1.810768174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:15:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:15:28.807708916 +0000 UTC m=+1703.832290916" watchObservedRunningTime="2026-07-08 23:15:28.810768174 +0000 UTC m=+1703.835350179"
Jul 08 23:15:28.927617 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:28.927577    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"
Jul 08 23:15:29.065674 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:29.065647    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"]
Jul 08 23:15:29.066744 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:15:29.066723    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod920b7c12_34a0_4ac6_98e3_5423c78f34c4.slice/crio-36c11aac29b199cf32241c75f04a9732ed397f1908f1920e147babde3eae081a WatchSource:0}: Error finding container 36c11aac29b199cf32241c75f04a9732ed397f1908f1920e147babde3eae081a: Status 404 returned error can't find the container with id 36c11aac29b199cf32241c75f04a9732ed397f1908f1920e147babde3eae081a
Jul 08 23:15:29.068123 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:29.068100    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 23:15:29.714170 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:29.714127    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:29.719031 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:29.719006    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:29.794918 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:29.794817    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf" event={"ID":"920b7c12-34a0-4ac6-98e3-5423c78f34c4","Type":"ContainerStarted","Data":"6c8c97e8ac86fae3300733d4ca114e0912c76f13a43069d631d8f19b76a22ac6"}
Jul 08 23:15:29.794918 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:29.794881    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf" event={"ID":"920b7c12-34a0-4ac6-98e3-5423c78f34c4","Type":"ContainerStarted","Data":"36c11aac29b199cf32241c75f04a9732ed397f1908f1920e147babde3eae081a"}
Jul 08 23:15:29.795158 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:29.795057    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"
Jul 08 23:15:29.795158 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:29.795118    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:29.795983 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:29.795962    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:29.812337 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:29.812286    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf" podStartSLOduration=1.337910949 podStartE2EDuration="1.812272369s" totalImagesPullingTime="474.36142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:15:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:15:29.81038138 +0000 UTC m=+1704.834963394" watchObservedRunningTime="2026-07-08 23:15:29.812272369 +0000 UTC m=+1704.836854371"
Jul 08 23:15:33.767860 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:33.767820    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"]
Jul 08 23:15:33.768313 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:33.768064    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt" podUID="8fabee41-c0da-44cc-a771-7f36cb6dd9f0" containerName="istio-proxy" containerID="cri-o://759b7ba82e6f3db20dcbc2daf0ea3862c7b029e82f83e25b476b92f86e6a3ce9" gracePeriod=30
Jul 08 23:15:34.096784 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.096698    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"]
Jul 08 23:15:34.096955 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.096908    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf" podUID="920b7c12-34a0-4ac6-98e3-5423c78f34c4" containerName="maas-api" containerID="cri-o://6c8c97e8ac86fae3300733d4ca114e0912c76f13a43069d631d8f19b76a22ac6" gracePeriod=30
Jul 08 23:15:34.101878 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.101856    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"
Jul 08 23:15:34.384677 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.384650    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"
Jul 08 23:15:34.557300 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.557264    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hkzb\" (UniqueName: \"kubernetes.io/projected/920b7c12-34a0-4ac6-98e3-5423c78f34c4-kube-api-access-8hkzb\") pod \"920b7c12-34a0-4ac6-98e3-5423c78f34c4\" (UID: \"920b7c12-34a0-4ac6-98e3-5423c78f34c4\") "
Jul 08 23:15:34.557493 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.557394    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/920b7c12-34a0-4ac6-98e3-5423c78f34c4-openshift-service-ca\") pod \"920b7c12-34a0-4ac6-98e3-5423c78f34c4\" (UID: \"920b7c12-34a0-4ac6-98e3-5423c78f34c4\") "
Jul 08 23:15:34.557493 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.557414    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/920b7c12-34a0-4ac6-98e3-5423c78f34c4-maas-api-tls\") pod \"920b7c12-34a0-4ac6-98e3-5423c78f34c4\" (UID: \"920b7c12-34a0-4ac6-98e3-5423c78f34c4\") "
Jul 08 23:15:34.557771 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.557741    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/920b7c12-34a0-4ac6-98e3-5423c78f34c4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "920b7c12-34a0-4ac6-98e3-5423c78f34c4" (UID: "920b7c12-34a0-4ac6-98e3-5423c78f34c4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:15:34.559502 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.559479    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/920b7c12-34a0-4ac6-98e3-5423c78f34c4-kube-api-access-8hkzb" (OuterVolumeSpecName: "kube-api-access-8hkzb") pod "920b7c12-34a0-4ac6-98e3-5423c78f34c4" (UID: "920b7c12-34a0-4ac6-98e3-5423c78f34c4"). InnerVolumeSpecName "kube-api-access-8hkzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:15:34.559597 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.559563    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/920b7c12-34a0-4ac6-98e3-5423c78f34c4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "920b7c12-34a0-4ac6-98e3-5423c78f34c4" (UID: "920b7c12-34a0-4ac6-98e3-5423c78f34c4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:15:34.658834 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.658791    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/920b7c12-34a0-4ac6-98e3-5423c78f34c4-openshift-service-ca\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:34.658834 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.658829    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/920b7c12-34a0-4ac6-98e3-5423c78f34c4-maas-api-tls\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:34.658834 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.658839    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hkzb\" (UniqueName: \"kubernetes.io/projected/920b7c12-34a0-4ac6-98e3-5423c78f34c4-kube-api-access-8hkzb\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:34.823415 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.823383    2574 generic.go:356] "Generic (PLEG): container finished" podID="920b7c12-34a0-4ac6-98e3-5423c78f34c4" containerID="6c8c97e8ac86fae3300733d4ca114e0912c76f13a43069d631d8f19b76a22ac6" exitCode=0
Jul 08 23:15:34.823882 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.823426    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"
Jul 08 23:15:34.823882 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.823464    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf" event={"ID":"920b7c12-34a0-4ac6-98e3-5423c78f34c4","Type":"ContainerDied","Data":"6c8c97e8ac86fae3300733d4ca114e0912c76f13a43069d631d8f19b76a22ac6"}
Jul 08 23:15:34.823882 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.823514    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf" event={"ID":"920b7c12-34a0-4ac6-98e3-5423c78f34c4","Type":"ContainerDied","Data":"36c11aac29b199cf32241c75f04a9732ed397f1908f1920e147babde3eae081a"}
Jul 08 23:15:34.823882 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.823535    2574 scope.go:117] "RemoveContainer" containerID="6c8c97e8ac86fae3300733d4ca114e0912c76f13a43069d631d8f19b76a22ac6"
Jul 08 23:15:34.840595 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.840575    2574 scope.go:117] "RemoveContainer" containerID="6c8c97e8ac86fae3300733d4ca114e0912c76f13a43069d631d8f19b76a22ac6"
Jul 08 23:15:34.841171 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:15:34.841097    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c8c97e8ac86fae3300733d4ca114e0912c76f13a43069d631d8f19b76a22ac6\": container with ID starting with 6c8c97e8ac86fae3300733d4ca114e0912c76f13a43069d631d8f19b76a22ac6 not found: ID does not exist" containerID="6c8c97e8ac86fae3300733d4ca114e0912c76f13a43069d631d8f19b76a22ac6"
Jul 08 23:15:34.841171 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.841133    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c8c97e8ac86fae3300733d4ca114e0912c76f13a43069d631d8f19b76a22ac6"} err="failed to get container status \"6c8c97e8ac86fae3300733d4ca114e0912c76f13a43069d631d8f19b76a22ac6\": rpc error: code = NotFound desc = could not find container \"6c8c97e8ac86fae3300733d4ca114e0912c76f13a43069d631d8f19b76a22ac6\": container with ID starting with 6c8c97e8ac86fae3300733d4ca114e0912c76f13a43069d631d8f19b76a22ac6 not found: ID does not exist"
Jul 08 23:15:34.855917 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.855880    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"]
Jul 08 23:15:34.860162 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:34.860127    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-80b25501-fcfbb4bc4-2whbf"]
Jul 08 23:15:35.502739 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:35.502681    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="920b7c12-34a0-4ac6-98e3-5423c78f34c4" path="/var/lib/kubelet/pods/920b7c12-34a0-4ac6-98e3-5423c78f34c4/volumes"
Jul 08 23:15:39.860225 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:39.860187    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"]
Jul 08 23:15:39.860896 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:39.860876    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="920b7c12-34a0-4ac6-98e3-5423c78f34c4" containerName="maas-api"
Jul 08 23:15:39.860965 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:39.860900    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="920b7c12-34a0-4ac6-98e3-5423c78f34c4" containerName="maas-api"
Jul 08 23:15:39.861042 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:39.861029    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="920b7c12-34a0-4ac6-98e3-5423c78f34c4" containerName="maas-api"
Jul 08 23:15:39.865616 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:39.865594    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:39.868203 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:39.868178    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-d033301f-gw-openshift-default-dockercfg-wd47f\""
Jul 08 23:15:39.874128 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:39.874102    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"]
Jul 08 23:15:40.007005 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.006971    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-workload-certs\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.007005 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.007010    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-podinfo\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.007212 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.007031    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-token\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.007212 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.007054    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-envoy\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.007212 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.007134    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-credential-socket\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.007212 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.007160    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istiod-ca-cert\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.007212 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.007196    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2s4q\" (UniqueName: \"kubernetes.io/projected/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-kube-api-access-b2s4q\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.007372 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.007313    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-workload-socket\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.007372 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.007360    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-data\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.108429 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.108384    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-workload-socket\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.110835 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.108439    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-data\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.110835 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.108486    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-workload-certs\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.110835 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.108515    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-podinfo\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.110835 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.108622    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-token\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.110835 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.108677    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-envoy\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.110835 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.108777    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-credential-socket\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.110835 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.108816    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istiod-ca-cert\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.110835 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.108864    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-workload-socket\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.110835 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.108871    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2s4q\" (UniqueName: \"kubernetes.io/projected/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-kube-api-access-b2s4q\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.110835 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.108906    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-data\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.110835 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.109182    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-credential-socket\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.110835 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.109311    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-workload-certs\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.111389 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.109551    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istiod-ca-cert\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.111389 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.111036    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-envoy\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.111389 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.111131    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-podinfo\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.122261 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.122233    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2s4q\" (UniqueName: \"kubernetes.io/projected/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-kube-api-access-b2s4q\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.132037 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.132013    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-token\") pod \"e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") " pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.180129 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.180095    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:40.324256 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.324159    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"]
Jul 08 23:15:40.325847 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:15:40.325738    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec2d3ba_0d93_4d6e_bc4f_09b722e55807.slice/crio-c07233e80f9afc07f3b6cbd5f95b0fc439b8fb3a9e9577a40767eaa8dc8673cf WatchSource:0}: Error finding container c07233e80f9afc07f3b6cbd5f95b0fc439b8fb3a9e9577a40767eaa8dc8673cf: Status 404 returned error can't find the container with id c07233e80f9afc07f3b6cbd5f95b0fc439b8fb3a9e9577a40767eaa8dc8673cf
Jul 08 23:15:40.328218 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.328176    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:15:40.328328 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.328268    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:15:40.328328 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.328309    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:15:40.420798 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.420773    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:40.613025 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.612994    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7566g\" (UniqueName: \"kubernetes.io/projected/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-kube-api-access-7566g\") pod \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") "
Jul 08 23:15:40.613200 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.613038    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-workload-socket\") pod \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") "
Jul 08 23:15:40.613200 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.613101    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-envoy\") pod \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") "
Jul 08 23:15:40.613200 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.613118    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-workload-certs\") pod \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") "
Jul 08 23:15:40.613200 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.613140    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-data\") pod \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") "
Jul 08 23:15:40.613200 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.613164    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-podinfo\") pod \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") "
Jul 08 23:15:40.613486 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.613199    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istiod-ca-cert\") pod \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") "
Jul 08 23:15:40.613486 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.613269    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-credential-socket\") pod \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") "
Jul 08 23:15:40.613486 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.613300    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-token\") pod \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\" (UID: \"8fabee41-c0da-44cc-a771-7f36cb6dd9f0\") "
Jul 08 23:15:40.613486 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.613419    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8fabee41-c0da-44cc-a771-7f36cb6dd9f0" (UID: "8fabee41-c0da-44cc-a771-7f36cb6dd9f0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:15:40.613679 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.613630    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8fabee41-c0da-44cc-a771-7f36cb6dd9f0" (UID: "8fabee41-c0da-44cc-a771-7f36cb6dd9f0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:15:40.613679 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.613660    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8fabee41-c0da-44cc-a771-7f36cb6dd9f0" (UID: "8fabee41-c0da-44cc-a771-7f36cb6dd9f0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:15:40.613679 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.613670    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-workload-certs\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:40.613862 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.613785    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8fabee41-c0da-44cc-a771-7f36cb6dd9f0" (UID: "8fabee41-c0da-44cc-a771-7f36cb6dd9f0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:15:40.614047 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.614023    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-data" (OuterVolumeSpecName: "istio-data") pod "8fabee41-c0da-44cc-a771-7f36cb6dd9f0" (UID: "8fabee41-c0da-44cc-a771-7f36cb6dd9f0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:15:40.615506 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.615486    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-kube-api-access-7566g" (OuterVolumeSpecName: "kube-api-access-7566g") pod "8fabee41-c0da-44cc-a771-7f36cb6dd9f0" (UID: "8fabee41-c0da-44cc-a771-7f36cb6dd9f0"). InnerVolumeSpecName "kube-api-access-7566g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:15:40.615717 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.615698    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8fabee41-c0da-44cc-a771-7f36cb6dd9f0" (UID: "8fabee41-c0da-44cc-a771-7f36cb6dd9f0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:15:40.615787 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.615769    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-token" (OuterVolumeSpecName: "istio-token") pod "8fabee41-c0da-44cc-a771-7f36cb6dd9f0" (UID: "8fabee41-c0da-44cc-a771-7f36cb6dd9f0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:15:40.615895 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.615878    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8fabee41-c0da-44cc-a771-7f36cb6dd9f0" (UID: "8fabee41-c0da-44cc-a771-7f36cb6dd9f0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:15:40.714828 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.714737    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-envoy\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:40.714828 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.714769    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-data\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:40.714828 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.714781    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-podinfo\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:40.714828 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.714792    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istiod-ca-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:40.714828 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.714803    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-credential-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:40.714828 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.714814    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-istio-token\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:40.714828 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.714828    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7566g\" (UniqueName: \"kubernetes.io/projected/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-kube-api-access-7566g\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:40.715160 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.714841    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fabee41-c0da-44cc-a771-7f36cb6dd9f0-workload-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:40.868967 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.868927    2574 generic.go:356] "Generic (PLEG): container finished" podID="8fabee41-c0da-44cc-a771-7f36cb6dd9f0" containerID="759b7ba82e6f3db20dcbc2daf0ea3862c7b029e82f83e25b476b92f86e6a3ce9" exitCode=0
Jul 08 23:15:40.869453 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.868983    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"
Jul 08 23:15:40.869453 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.869019    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt" event={"ID":"8fabee41-c0da-44cc-a771-7f36cb6dd9f0","Type":"ContainerDied","Data":"759b7ba82e6f3db20dcbc2daf0ea3862c7b029e82f83e25b476b92f86e6a3ce9"}
Jul 08 23:15:40.869453 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.869074    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt" event={"ID":"8fabee41-c0da-44cc-a771-7f36cb6dd9f0","Type":"ContainerDied","Data":"af24a721321d04e6fca668b7cf047c922895f5e926943447676f26594fce634c"}
Jul 08 23:15:40.869453 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.869096    2574 scope.go:117] "RemoveContainer" containerID="759b7ba82e6f3db20dcbc2daf0ea3862c7b029e82f83e25b476b92f86e6a3ce9"
Jul 08 23:15:40.870757 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.870727    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw" event={"ID":"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807","Type":"ContainerStarted","Data":"35595419e10a0fd4161d0fd6485e972b69e63abc6e4b8185aada129de850b09d"}
Jul 08 23:15:40.870862 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.870776    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw" event={"ID":"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807","Type":"ContainerStarted","Data":"c07233e80f9afc07f3b6cbd5f95b0fc439b8fb3a9e9577a40767eaa8dc8673cf"}
Jul 08 23:15:40.882121 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.882100    2574 scope.go:117] "RemoveContainer" containerID="759b7ba82e6f3db20dcbc2daf0ea3862c7b029e82f83e25b476b92f86e6a3ce9"
Jul 08 23:15:40.882442 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:15:40.882422    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"759b7ba82e6f3db20dcbc2daf0ea3862c7b029e82f83e25b476b92f86e6a3ce9\": container with ID starting with 759b7ba82e6f3db20dcbc2daf0ea3862c7b029e82f83e25b476b92f86e6a3ce9 not found: ID does not exist" containerID="759b7ba82e6f3db20dcbc2daf0ea3862c7b029e82f83e25b476b92f86e6a3ce9"
Jul 08 23:15:40.882502 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.882450    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"759b7ba82e6f3db20dcbc2daf0ea3862c7b029e82f83e25b476b92f86e6a3ce9"} err="failed to get container status \"759b7ba82e6f3db20dcbc2daf0ea3862c7b029e82f83e25b476b92f86e6a3ce9\": rpc error: code = NotFound desc = could not find container \"759b7ba82e6f3db20dcbc2daf0ea3862c7b029e82f83e25b476b92f86e6a3ce9\": container with ID starting with 759b7ba82e6f3db20dcbc2daf0ea3862c7b029e82f83e25b476b92f86e6a3ce9 not found: ID does not exist"
Jul 08 23:15:40.893405 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.893359    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw" podStartSLOduration=1.893343995 podStartE2EDuration="1.893343995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:15:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:15:40.891570705 +0000 UTC m=+1715.916152707" watchObservedRunningTime="2026-07-08 23:15:40.893343995 +0000 UTC m=+1715.917925997"
Jul 08 23:15:40.906155 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.906125    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"]
Jul 08 23:15:40.909418 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:40.909395    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-80b25501-openshift-default-6954888c89-2gckt"]
Jul 08 23:15:41.180611 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.180575    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:41.185557 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.185529    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:41.283905 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.283862    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"]
Jul 08 23:15:41.284519 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.284498    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fabee41-c0da-44cc-a771-7f36cb6dd9f0" containerName="istio-proxy"
Jul 08 23:15:41.284566 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.284524    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fabee41-c0da-44cc-a771-7f36cb6dd9f0" containerName="istio-proxy"
Jul 08 23:15:41.284630 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.284619    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fabee41-c0da-44cc-a771-7f36cb6dd9f0" containerName="istio-proxy"
Jul 08 23:15:41.289424 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.289394    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"
Jul 08 23:15:41.291957 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.291935    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-d033301f-serving-cert\""
Jul 08 23:15:41.296556 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.296536    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"]
Jul 08 23:15:41.421583 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.421489    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46b69e17-7e88-422c-9451-8af1c74ca16f-openshift-service-ca\") pod \"maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz\" (UID: \"46b69e17-7e88-422c-9451-8af1c74ca16f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"
Jul 08 23:15:41.421583 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.421535    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46b69e17-7e88-422c-9451-8af1c74ca16f-maas-api-tls\") pod \"maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz\" (UID: \"46b69e17-7e88-422c-9451-8af1c74ca16f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"
Jul 08 23:15:41.421817 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.421624    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqpxk\" (UniqueName: \"kubernetes.io/projected/46b69e17-7e88-422c-9451-8af1c74ca16f-kube-api-access-bqpxk\") pod \"maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz\" (UID: \"46b69e17-7e88-422c-9451-8af1c74ca16f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"
Jul 08 23:15:41.502674 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.502639    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fabee41-c0da-44cc-a771-7f36cb6dd9f0" path="/var/lib/kubelet/pods/8fabee41-c0da-44cc-a771-7f36cb6dd9f0/volumes"
Jul 08 23:15:41.522907 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.522877    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46b69e17-7e88-422c-9451-8af1c74ca16f-openshift-service-ca\") pod \"maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz\" (UID: \"46b69e17-7e88-422c-9451-8af1c74ca16f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"
Jul 08 23:15:41.523054 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.522921    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46b69e17-7e88-422c-9451-8af1c74ca16f-maas-api-tls\") pod \"maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz\" (UID: \"46b69e17-7e88-422c-9451-8af1c74ca16f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"
Jul 08 23:15:41.523054 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.522953    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqpxk\" (UniqueName: \"kubernetes.io/projected/46b69e17-7e88-422c-9451-8af1c74ca16f-kube-api-access-bqpxk\") pod \"maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz\" (UID: \"46b69e17-7e88-422c-9451-8af1c74ca16f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"
Jul 08 23:15:41.523145 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:15:41.523093    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-serving-cert: secret "maas-api-e2e-migrate-d033301f-serving-cert" not found
Jul 08 23:15:41.523180 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:15:41.523156    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46b69e17-7e88-422c-9451-8af1c74ca16f-maas-api-tls podName:46b69e17-7e88-422c-9451-8af1c74ca16f nodeName:}" failed. No retries permitted until 2026-07-08 23:15:42.023137821 +0000 UTC m=+1717.047719802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/46b69e17-7e88-422c-9451-8af1c74ca16f-maas-api-tls") pod "maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz" (UID: "46b69e17-7e88-422c-9451-8af1c74ca16f") : secret "maas-api-e2e-migrate-d033301f-serving-cert" not found
Jul 08 23:15:41.523525 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.523506    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46b69e17-7e88-422c-9451-8af1c74ca16f-openshift-service-ca\") pod \"maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz\" (UID: \"46b69e17-7e88-422c-9451-8af1c74ca16f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"
Jul 08 23:15:41.531614 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.531587    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqpxk\" (UniqueName: \"kubernetes.io/projected/46b69e17-7e88-422c-9451-8af1c74ca16f-kube-api-access-bqpxk\") pod \"maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz\" (UID: \"46b69e17-7e88-422c-9451-8af1c74ca16f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"
Jul 08 23:15:41.877673 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.877644    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:41.878622 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:41.878601    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:42.031472 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:42.029904    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46b69e17-7e88-422c-9451-8af1c74ca16f-maas-api-tls\") pod \"maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz\" (UID: \"46b69e17-7e88-422c-9451-8af1c74ca16f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"
Jul 08 23:15:42.033490 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:42.033460    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46b69e17-7e88-422c-9451-8af1c74ca16f-maas-api-tls\") pod \"maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz\" (UID: \"46b69e17-7e88-422c-9451-8af1c74ca16f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"
Jul 08 23:15:42.201408 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:42.201310    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"
Jul 08 23:15:42.337292 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:42.337257    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"]
Jul 08 23:15:42.338785 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:15:42.338758    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b69e17_7e88_422c_9451_8af1c74ca16f.slice/crio-5fae2604664acd7ecc1bb9e8bb5d57cfc847b46ecb5b8b27df0ed4bc250229da WatchSource:0}: Error finding container 5fae2604664acd7ecc1bb9e8bb5d57cfc847b46ecb5b8b27df0ed4bc250229da: Status 404 returned error can't find the container with id 5fae2604664acd7ecc1bb9e8bb5d57cfc847b46ecb5b8b27df0ed4bc250229da
Jul 08 23:15:42.890889 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:42.890781    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz" event={"ID":"46b69e17-7e88-422c-9451-8af1c74ca16f","Type":"ContainerStarted","Data":"54a98a860dd7003355ccacefd18ee9c4e8ac2948588ca683205bfe6509ebd700"}
Jul 08 23:15:42.890889 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:42.890875    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz" event={"ID":"46b69e17-7e88-422c-9451-8af1c74ca16f","Type":"ContainerStarted","Data":"5fae2604664acd7ecc1bb9e8bb5d57cfc847b46ecb5b8b27df0ed4bc250229da"}
Jul 08 23:15:42.891334 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:42.891197    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"
Jul 08 23:15:42.907861 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:42.907813    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz" podStartSLOduration=1.626972724 podStartE2EDuration="1.907797519s" totalImagesPullingTime="280.824795ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:15:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:15:42.906548409 +0000 UTC m=+1717.931130407" watchObservedRunningTime="2026-07-08 23:15:42.907797519 +0000 UTC m=+1717.932379524"
Jul 08 23:15:45.833356 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:45.833314    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"]
Jul 08 23:15:45.833770 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:45.833494    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw" podUID="0ec2d3ba-0d93-4d6e-bc4f-09b722e55807" containerName="istio-proxy" containerID="cri-o://35595419e10a0fd4161d0fd6485e972b69e63abc6e4b8185aada129de850b09d" gracePeriod=30
Jul 08 23:15:45.976795 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:45.976492    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"]
Jul 08 23:15:45.978896 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:45.976819    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz" podUID="46b69e17-7e88-422c-9451-8af1c74ca16f" containerName="maas-api" containerID="cri-o://54a98a860dd7003355ccacefd18ee9c4e8ac2948588ca683205bfe6509ebd700" gracePeriod=30
Jul 08 23:15:46.224723 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.224670    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"
Jul 08 23:15:46.263745 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.263709    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46b69e17-7e88-422c-9451-8af1c74ca16f-maas-api-tls\") pod \"46b69e17-7e88-422c-9451-8af1c74ca16f\" (UID: \"46b69e17-7e88-422c-9451-8af1c74ca16f\") "
Jul 08 23:15:46.263939 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.263816    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46b69e17-7e88-422c-9451-8af1c74ca16f-openshift-service-ca\") pod \"46b69e17-7e88-422c-9451-8af1c74ca16f\" (UID: \"46b69e17-7e88-422c-9451-8af1c74ca16f\") "
Jul 08 23:15:46.263939 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.263847    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqpxk\" (UniqueName: \"kubernetes.io/projected/46b69e17-7e88-422c-9451-8af1c74ca16f-kube-api-access-bqpxk\") pod \"46b69e17-7e88-422c-9451-8af1c74ca16f\" (UID: \"46b69e17-7e88-422c-9451-8af1c74ca16f\") "
Jul 08 23:15:46.264180 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.264158    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46b69e17-7e88-422c-9451-8af1c74ca16f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "46b69e17-7e88-422c-9451-8af1c74ca16f" (UID: "46b69e17-7e88-422c-9451-8af1c74ca16f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:15:46.265854 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.265826    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46b69e17-7e88-422c-9451-8af1c74ca16f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "46b69e17-7e88-422c-9451-8af1c74ca16f" (UID: "46b69e17-7e88-422c-9451-8af1c74ca16f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:15:46.266014 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.265981    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46b69e17-7e88-422c-9451-8af1c74ca16f-kube-api-access-bqpxk" (OuterVolumeSpecName: "kube-api-access-bqpxk") pod "46b69e17-7e88-422c-9451-8af1c74ca16f" (UID: "46b69e17-7e88-422c-9451-8af1c74ca16f"). InnerVolumeSpecName "kube-api-access-bqpxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:15:46.364638 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.364544    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46b69e17-7e88-422c-9451-8af1c74ca16f-openshift-service-ca\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:46.364638 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.364576    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqpxk\" (UniqueName: \"kubernetes.io/projected/46b69e17-7e88-422c-9451-8af1c74ca16f-kube-api-access-bqpxk\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:46.364638 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.364591    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46b69e17-7e88-422c-9451-8af1c74ca16f-maas-api-tls\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:46.912516 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.912484    2574 generic.go:356] "Generic (PLEG): container finished" podID="46b69e17-7e88-422c-9451-8af1c74ca16f" containerID="54a98a860dd7003355ccacefd18ee9c4e8ac2948588ca683205bfe6509ebd700" exitCode=0
Jul 08 23:15:46.912921 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.912524    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"
Jul 08 23:15:46.912921 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.912571    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz" event={"ID":"46b69e17-7e88-422c-9451-8af1c74ca16f","Type":"ContainerDied","Data":"54a98a860dd7003355ccacefd18ee9c4e8ac2948588ca683205bfe6509ebd700"}
Jul 08 23:15:46.912921 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.912621    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz" event={"ID":"46b69e17-7e88-422c-9451-8af1c74ca16f","Type":"ContainerDied","Data":"5fae2604664acd7ecc1bb9e8bb5d57cfc847b46ecb5b8b27df0ed4bc250229da"}
Jul 08 23:15:46.912921 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.912645    2574 scope.go:117] "RemoveContainer" containerID="54a98a860dd7003355ccacefd18ee9c4e8ac2948588ca683205bfe6509ebd700"
Jul 08 23:15:46.925378 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.925343    2574 scope.go:117] "RemoveContainer" containerID="54a98a860dd7003355ccacefd18ee9c4e8ac2948588ca683205bfe6509ebd700"
Jul 08 23:15:46.925800 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:15:46.925764    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54a98a860dd7003355ccacefd18ee9c4e8ac2948588ca683205bfe6509ebd700\": container with ID starting with 54a98a860dd7003355ccacefd18ee9c4e8ac2948588ca683205bfe6509ebd700 not found: ID does not exist" containerID="54a98a860dd7003355ccacefd18ee9c4e8ac2948588ca683205bfe6509ebd700"
Jul 08 23:15:46.925908 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.925807    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54a98a860dd7003355ccacefd18ee9c4e8ac2948588ca683205bfe6509ebd700"} err="failed to get container status \"54a98a860dd7003355ccacefd18ee9c4e8ac2948588ca683205bfe6509ebd700\": rpc error: code = NotFound desc = could not find container \"54a98a860dd7003355ccacefd18ee9c4e8ac2948588ca683205bfe6509ebd700\": container with ID starting with 54a98a860dd7003355ccacefd18ee9c4e8ac2948588ca683205bfe6509ebd700 not found: ID does not exist"
Jul 08 23:15:46.937509 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.937478    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"]
Jul 08 23:15:46.939737 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:46.939711    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d033301f-84f8785db8-n7hfz"]
Jul 08 23:15:47.502410 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:47.502377    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46b69e17-7e88-422c-9451-8af1c74ca16f" path="/var/lib/kubelet/pods/46b69e17-7e88-422c-9451-8af1c74ca16f/volumes"
Jul 08 23:15:51.085524 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.085500    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:51.102730 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.102639    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-workload-certs\") pod \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") "
Jul 08 23:15:51.102730 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.102670    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-podinfo\") pod \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") "
Jul 08 23:15:51.102730 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.102712    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-token\") pod \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") "
Jul 08 23:15:51.102989 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.102735    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2s4q\" (UniqueName: \"kubernetes.io/projected/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-kube-api-access-b2s4q\") pod \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") "
Jul 08 23:15:51.102989 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.102817    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istiod-ca-cert\") pod \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") "
Jul 08 23:15:51.102989 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.102856    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-envoy\") pod \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") "
Jul 08 23:15:51.102989 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.102876    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-credential-socket\") pod \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") "
Jul 08 23:15:51.102989 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.102898    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-data\") pod \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") "
Jul 08 23:15:51.102989 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.102924    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807" (UID: "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:15:51.102989 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.102939    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-workload-socket\") pod \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\" (UID: \"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807\") "
Jul 08 23:15:51.103348 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.103156    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807" (UID: "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:15:51.103348 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.103238    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807" (UID: "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:15:51.103461 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.103373    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-workload-certs\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:51.103461 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.103384    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807" (UID: "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:15:51.103461 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.103391    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istiod-ca-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:51.103461 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.103455    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-credential-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:51.104082 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.104053    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-data" (OuterVolumeSpecName: "istio-data") pod "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807" (UID: "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:15:51.105052 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.105026    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807" (UID: "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:15:51.105052 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.105041    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-kube-api-access-b2s4q" (OuterVolumeSpecName: "kube-api-access-b2s4q") pod "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807" (UID: "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807"). InnerVolumeSpecName "kube-api-access-b2s4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:15:51.105266 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.105249    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807" (UID: "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:15:51.105323 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.105260    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-token" (OuterVolumeSpecName: "istio-token") pod "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807" (UID: "0ec2d3ba-0d93-4d6e-bc4f-09b722e55807"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:15:51.204793 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.204759    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-podinfo\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:51.204793 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.204802    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-token\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:51.205008 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.204812    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2s4q\" (UniqueName: \"kubernetes.io/projected/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-kube-api-access-b2s4q\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:51.205008 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.204825    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-envoy\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:51.205008 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.204838    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-istio-data\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:51.205008 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.204848    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807-workload-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:51.903230 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.903187    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"]
Jul 08 23:15:51.904172 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.904147    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec2d3ba-0d93-4d6e-bc4f-09b722e55807" containerName="istio-proxy"
Jul 08 23:15:51.904172 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.904170    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec2d3ba-0d93-4d6e-bc4f-09b722e55807" containerName="istio-proxy"
Jul 08 23:15:51.904353 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.904186    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46b69e17-7e88-422c-9451-8af1c74ca16f" containerName="maas-api"
Jul 08 23:15:51.904353 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.904194    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="46b69e17-7e88-422c-9451-8af1c74ca16f" containerName="maas-api"
Jul 08 23:15:51.904353 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.904316    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="46b69e17-7e88-422c-9451-8af1c74ca16f" containerName="maas-api"
Jul 08 23:15:51.904353 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.904332    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ec2d3ba-0d93-4d6e-bc4f-09b722e55807" containerName="istio-proxy"
Jul 08 23:15:51.908530 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.908511    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:51.911175 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.911155    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-63a927c1-openshift-default-dockercfg-cjqzb\""
Jul 08 23:15:51.921548 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.921517    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"]
Jul 08 23:15:51.941361 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.941289    2574 generic.go:356] "Generic (PLEG): container finished" podID="0ec2d3ba-0d93-4d6e-bc4f-09b722e55807" containerID="35595419e10a0fd4161d0fd6485e972b69e63abc6e4b8185aada129de850b09d" exitCode=0
Jul 08 23:15:51.941545 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.941358    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw" event={"ID":"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807","Type":"ContainerDied","Data":"35595419e10a0fd4161d0fd6485e972b69e63abc6e4b8185aada129de850b09d"}
Jul 08 23:15:51.941545 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.941340    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"
Jul 08 23:15:51.941545 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.941432    2574 scope.go:117] "RemoveContainer" containerID="35595419e10a0fd4161d0fd6485e972b69e63abc6e4b8185aada129de850b09d"
Jul 08 23:15:51.941545 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.941419    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw" event={"ID":"0ec2d3ba-0d93-4d6e-bc4f-09b722e55807","Type":"ContainerDied","Data":"c07233e80f9afc07f3b6cbd5f95b0fc439b8fb3a9e9577a40767eaa8dc8673cf"}
Jul 08 23:15:51.951148 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.950982    2574 scope.go:117] "RemoveContainer" containerID="35595419e10a0fd4161d0fd6485e972b69e63abc6e4b8185aada129de850b09d"
Jul 08 23:15:51.951259 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:15:51.951241    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35595419e10a0fd4161d0fd6485e972b69e63abc6e4b8185aada129de850b09d\": container with ID starting with 35595419e10a0fd4161d0fd6485e972b69e63abc6e4b8185aada129de850b09d not found: ID does not exist" containerID="35595419e10a0fd4161d0fd6485e972b69e63abc6e4b8185aada129de850b09d"
Jul 08 23:15:51.951319 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.951270    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35595419e10a0fd4161d0fd6485e972b69e63abc6e4b8185aada129de850b09d"} err="failed to get container status \"35595419e10a0fd4161d0fd6485e972b69e63abc6e4b8185aada129de850b09d\": rpc error: code = NotFound desc = could not find container \"35595419e10a0fd4161d0fd6485e972b69e63abc6e4b8185aada129de850b09d\": container with ID starting with 35595419e10a0fd4161d0fd6485e972b69e63abc6e4b8185aada129de850b09d not found: ID does not exist"
Jul 08 23:15:51.958787 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.958760    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"]
Jul 08 23:15:51.964553 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:51.964527    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-d033301f-gw-openshift-default-db4798bc5-f4lfw"]
Jul 08 23:15:52.012207 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.012175    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtjfr\" (UniqueName: \"kubernetes.io/projected/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-kube-api-access-jtjfr\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.012587 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.012260    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-podinfo\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.012587 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.012308    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-credential-socket\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.012587 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.012335    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-data\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.012587 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.012363    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-workload-certs\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.012587 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.012385    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-token\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.012587 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.012407    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istiod-ca-cert\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.012587 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.012520    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-workload-socket\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.012587 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.012599    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-envoy\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.113348 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.113310    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-workload-socket\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.113800 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.113377    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-envoy\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.113800 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.113433    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtjfr\" (UniqueName: \"kubernetes.io/projected/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-kube-api-access-jtjfr\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.113800 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.113475    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-podinfo\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.113800 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.113502    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-credential-socket\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.113800 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.113527    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-data\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.113800 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.113647    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-workload-certs\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.113800 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.113720    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-token\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.113800 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.113749    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istiod-ca-cert\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.114265 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.113858    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-workload-socket\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.114265 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.114020    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-workload-certs\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.114265 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.114040    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-credential-socket\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.114265 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.114078    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-data\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.114483 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.114362    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istiod-ca-cert\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.115633 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.115612    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-envoy\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.115959 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.115942    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-podinfo\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.121839 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.121811    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-token\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.122020 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.122001    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtjfr\" (UniqueName: \"kubernetes.io/projected/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-kube-api-access-jtjfr\") pod \"e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") " pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.219250 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.219152    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:52.383997 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.383972    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"]
Jul 08 23:15:52.385639 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:15:52.385610    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b0f760_80ee_4006_9cb6_ddb0aa65cd46.slice/crio-4c6f96927a40f5d1daae6beaac6064ccc30a9e7fcc2507d15c537e2c0846aac2 WatchSource:0}: Error finding container 4c6f96927a40f5d1daae6beaac6064ccc30a9e7fcc2507d15c537e2c0846aac2: Status 404 returned error can't find the container with id 4c6f96927a40f5d1daae6beaac6064ccc30a9e7fcc2507d15c537e2c0846aac2
Jul 08 23:15:52.388226 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.388193    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:15:52.388324 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.388255    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:15:52.388324 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.388281    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:15:52.948781 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.948740    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg" event={"ID":"52b0f760-80ee-4006-9cb6-ddb0aa65cd46","Type":"ContainerStarted","Data":"d3c19022dd98370772cc5d27844ab592ba766db6fa913870e91c5629149bf953"}
Jul 08 23:15:52.948960 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.948807    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg" event={"ID":"52b0f760-80ee-4006-9cb6-ddb0aa65cd46","Type":"ContainerStarted","Data":"4c6f96927a40f5d1daae6beaac6064ccc30a9e7fcc2507d15c537e2c0846aac2"}
Jul 08 23:15:52.969072 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:52.968999    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg" podStartSLOduration=1.9689842469999999 podStartE2EDuration="1.968984247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:15:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:15:52.968180917 +0000 UTC m=+1727.992762920" watchObservedRunningTime="2026-07-08 23:15:52.968984247 +0000 UTC m=+1727.993566249"
Jul 08 23:15:53.202007 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.201913    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"]
Jul 08 23:15:53.205515 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.205495    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"
Jul 08 23:15:53.208455 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.208427    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-63a927c1-serving-cert\""
Jul 08 23:15:53.216503 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.216478    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"]
Jul 08 23:15:53.219408 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.219381    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:53.224176 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.224151    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:53.224416 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.224394    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/315057c6-1524-480f-908e-765faacac10d-maas-api-tls\") pod \"maas-api-e2e-ait-63a927c1-5df4875499-prbxv\" (UID: \"315057c6-1524-480f-908e-765faacac10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"
Jul 08 23:15:53.224512 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.224455    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/315057c6-1524-480f-908e-765faacac10d-openshift-service-ca\") pod \"maas-api-e2e-ait-63a927c1-5df4875499-prbxv\" (UID: \"315057c6-1524-480f-908e-765faacac10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"
Jul 08 23:15:53.224572 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.224556    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w5bj\" (UniqueName: \"kubernetes.io/projected/315057c6-1524-480f-908e-765faacac10d-kube-api-access-2w5bj\") pod \"maas-api-e2e-ait-63a927c1-5df4875499-prbxv\" (UID: \"315057c6-1524-480f-908e-765faacac10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"
Jul 08 23:15:53.325657 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.325618    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w5bj\" (UniqueName: \"kubernetes.io/projected/315057c6-1524-480f-908e-765faacac10d-kube-api-access-2w5bj\") pod \"maas-api-e2e-ait-63a927c1-5df4875499-prbxv\" (UID: \"315057c6-1524-480f-908e-765faacac10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"
Jul 08 23:15:53.325869 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.325664    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/315057c6-1524-480f-908e-765faacac10d-maas-api-tls\") pod \"maas-api-e2e-ait-63a927c1-5df4875499-prbxv\" (UID: \"315057c6-1524-480f-908e-765faacac10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"
Jul 08 23:15:53.325869 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.325730    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/315057c6-1524-480f-908e-765faacac10d-openshift-service-ca\") pod \"maas-api-e2e-ait-63a927c1-5df4875499-prbxv\" (UID: \"315057c6-1524-480f-908e-765faacac10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"
Jul 08 23:15:53.325991 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:15:53.325866    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-serving-cert: secret "maas-api-e2e-ait-63a927c1-serving-cert" not found
Jul 08 23:15:53.325991 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:15:53.325943    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/315057c6-1524-480f-908e-765faacac10d-maas-api-tls podName:315057c6-1524-480f-908e-765faacac10d nodeName:}" failed. No retries permitted until 2026-07-08 23:15:53.825921557 +0000 UTC m=+1728.850503551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/315057c6-1524-480f-908e-765faacac10d-maas-api-tls") pod "maas-api-e2e-ait-63a927c1-5df4875499-prbxv" (UID: "315057c6-1524-480f-908e-765faacac10d") : secret "maas-api-e2e-ait-63a927c1-serving-cert" not found
Jul 08 23:15:53.326430 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.326409    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/315057c6-1524-480f-908e-765faacac10d-openshift-service-ca\") pod \"maas-api-e2e-ait-63a927c1-5df4875499-prbxv\" (UID: \"315057c6-1524-480f-908e-765faacac10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"
Jul 08 23:15:53.338241 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.338215    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w5bj\" (UniqueName: \"kubernetes.io/projected/315057c6-1524-480f-908e-765faacac10d-kube-api-access-2w5bj\") pod \"maas-api-e2e-ait-63a927c1-5df4875499-prbxv\" (UID: \"315057c6-1524-480f-908e-765faacac10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"
Jul 08 23:15:53.503250 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.503173    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ec2d3ba-0d93-4d6e-bc4f-09b722e55807" path="/var/lib/kubelet/pods/0ec2d3ba-0d93-4d6e-bc4f-09b722e55807/volumes"
Jul 08 23:15:53.831131 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.831040    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/315057c6-1524-480f-908e-765faacac10d-maas-api-tls\") pod \"maas-api-e2e-ait-63a927c1-5df4875499-prbxv\" (UID: \"315057c6-1524-480f-908e-765faacac10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"
Jul 08 23:15:53.833457 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.833422    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/315057c6-1524-480f-908e-765faacac10d-maas-api-tls\") pod \"maas-api-e2e-ait-63a927c1-5df4875499-prbxv\" (UID: \"315057c6-1524-480f-908e-765faacac10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"
Jul 08 23:15:53.955751 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.955721    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:53.956662 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:53.956641    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:15:54.118520 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:54.118485    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"
Jul 08 23:15:54.260807 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:54.260776    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"]
Jul 08 23:15:54.262133 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:15:54.262109    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod315057c6_1524_480f_908e_765faacac10d.slice/crio-728051f697e07e70c00de9819bcb666cc8088192f9292dd842ab31590a2ffb4f WatchSource:0}: Error finding container 728051f697e07e70c00de9819bcb666cc8088192f9292dd842ab31590a2ffb4f: Status 404 returned error can't find the container with id 728051f697e07e70c00de9819bcb666cc8088192f9292dd842ab31590a2ffb4f
Jul 08 23:15:54.963329 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:54.963284    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv" event={"ID":"315057c6-1524-480f-908e-765faacac10d","Type":"ContainerStarted","Data":"5812e5208e1688efad1717cc884152e4e5686bb7cde6d1a69ac35d6906092b45"}
Jul 08 23:15:54.963567 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:54.963443    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"
Jul 08 23:15:54.963567 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:54.963517    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv" event={"ID":"315057c6-1524-480f-908e-765faacac10d","Type":"ContainerStarted","Data":"728051f697e07e70c00de9819bcb666cc8088192f9292dd842ab31590a2ffb4f"}
Jul 08 23:15:54.981092 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:54.981038    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv" podStartSLOduration=1.634216709 podStartE2EDuration="1.98102279s" totalImagesPullingTime="346.806081ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:15:54.978673116 +0000 UTC m=+1730.003255138" watchObservedRunningTime="2026-07-08 23:15:54.98102279 +0000 UTC m=+1730.005604793"
Jul 08 23:15:58.508996 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.508961    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"]
Jul 08 23:15:58.509548 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.509228    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv" podUID="315057c6-1524-480f-908e-765faacac10d" containerName="maas-api" containerID="cri-o://5812e5208e1688efad1717cc884152e4e5686bb7cde6d1a69ac35d6906092b45" gracePeriod=30
Jul 08 23:15:58.763843 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.763777    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"
Jul 08 23:15:58.880735 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.880673    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/315057c6-1524-480f-908e-765faacac10d-maas-api-tls\") pod \"315057c6-1524-480f-908e-765faacac10d\" (UID: \"315057c6-1524-480f-908e-765faacac10d\") "
Jul 08 23:15:58.880735 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.880736    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w5bj\" (UniqueName: \"kubernetes.io/projected/315057c6-1524-480f-908e-765faacac10d-kube-api-access-2w5bj\") pod \"315057c6-1524-480f-908e-765faacac10d\" (UID: \"315057c6-1524-480f-908e-765faacac10d\") "
Jul 08 23:15:58.880950 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.880802    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/315057c6-1524-480f-908e-765faacac10d-openshift-service-ca\") pod \"315057c6-1524-480f-908e-765faacac10d\" (UID: \"315057c6-1524-480f-908e-765faacac10d\") "
Jul 08 23:15:58.881231 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.881205    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/315057c6-1524-480f-908e-765faacac10d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "315057c6-1524-480f-908e-765faacac10d" (UID: "315057c6-1524-480f-908e-765faacac10d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:15:58.882826 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.882802    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/315057c6-1524-480f-908e-765faacac10d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "315057c6-1524-480f-908e-765faacac10d" (UID: "315057c6-1524-480f-908e-765faacac10d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:15:58.882929 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.882911    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/315057c6-1524-480f-908e-765faacac10d-kube-api-access-2w5bj" (OuterVolumeSpecName: "kube-api-access-2w5bj") pod "315057c6-1524-480f-908e-765faacac10d" (UID: "315057c6-1524-480f-908e-765faacac10d"). InnerVolumeSpecName "kube-api-access-2w5bj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:15:58.981514 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.981475    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/315057c6-1524-480f-908e-765faacac10d-openshift-service-ca\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:58.981514 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.981504    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/315057c6-1524-480f-908e-765faacac10d-maas-api-tls\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:58.981514 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.981513    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w5bj\" (UniqueName: \"kubernetes.io/projected/315057c6-1524-480f-908e-765faacac10d-kube-api-access-2w5bj\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:15:58.984877 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.984846    2574 generic.go:356] "Generic (PLEG): container finished" podID="315057c6-1524-480f-908e-765faacac10d" containerID="5812e5208e1688efad1717cc884152e4e5686bb7cde6d1a69ac35d6906092b45" exitCode=0
Jul 08 23:15:58.984996 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.984892    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"
Jul 08 23:15:58.984996 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.984926    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv" event={"ID":"315057c6-1524-480f-908e-765faacac10d","Type":"ContainerDied","Data":"5812e5208e1688efad1717cc884152e4e5686bb7cde6d1a69ac35d6906092b45"}
Jul 08 23:15:58.984996 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.984980    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv" event={"ID":"315057c6-1524-480f-908e-765faacac10d","Type":"ContainerDied","Data":"728051f697e07e70c00de9819bcb666cc8088192f9292dd842ab31590a2ffb4f"}
Jul 08 23:15:58.985115 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.985001    2574 scope.go:117] "RemoveContainer" containerID="5812e5208e1688efad1717cc884152e4e5686bb7cde6d1a69ac35d6906092b45"
Jul 08 23:15:58.994545 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.994528    2574 scope.go:117] "RemoveContainer" containerID="5812e5208e1688efad1717cc884152e4e5686bb7cde6d1a69ac35d6906092b45"
Jul 08 23:15:58.994904 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:15:58.994885    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5812e5208e1688efad1717cc884152e4e5686bb7cde6d1a69ac35d6906092b45\": container with ID starting with 5812e5208e1688efad1717cc884152e4e5686bb7cde6d1a69ac35d6906092b45 not found: ID does not exist" containerID="5812e5208e1688efad1717cc884152e4e5686bb7cde6d1a69ac35d6906092b45"
Jul 08 23:15:58.994965 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:58.994915    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5812e5208e1688efad1717cc884152e4e5686bb7cde6d1a69ac35d6906092b45"} err="failed to get container status \"5812e5208e1688efad1717cc884152e4e5686bb7cde6d1a69ac35d6906092b45\": rpc error: code = NotFound desc = could not find container \"5812e5208e1688efad1717cc884152e4e5686bb7cde6d1a69ac35d6906092b45\": container with ID starting with 5812e5208e1688efad1717cc884152e4e5686bb7cde6d1a69ac35d6906092b45 not found: ID does not exist"
Jul 08 23:15:59.008764 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:59.008734    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"]
Jul 08 23:15:59.012322 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:59.012301    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-63a927c1-5df4875499-prbxv"]
Jul 08 23:15:59.502221 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:15:59.502188    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="315057c6-1524-480f-908e-765faacac10d" path="/var/lib/kubelet/pods/315057c6-1524-480f-908e-765faacac10d/volumes"
Jul 08 23:16:04.151022 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:04.150985    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"]
Jul 08 23:16:04.151452 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:04.151188    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg" podUID="52b0f760-80ee-4006-9cb6-ddb0aa65cd46" containerName="istio-proxy" containerID="cri-o://d3c19022dd98370772cc5d27844ab592ba766db6fa913870e91c5629149bf953" gracePeriod=30
Jul 08 23:16:08.958234 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:08.958195    2574 patch_prober.go:28] interesting pod/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 08 23:16:08.958607 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:08.958264    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg" podUID="52b0f760-80ee-4006-9cb6-ddb0aa65cd46" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 23:16:09.414148 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.414124    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:16:09.476539 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.476502    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-workload-certs\") pod \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") "
Jul 08 23:16:09.476539 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.476548    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-workload-socket\") pod \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") "
Jul 08 23:16:09.476801 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.476590    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtjfr\" (UniqueName: \"kubernetes.io/projected/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-kube-api-access-jtjfr\") pod \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") "
Jul 08 23:16:09.476801 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.476619    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-token\") pod \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") "
Jul 08 23:16:09.476801 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.476644    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istiod-ca-cert\") pod \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") "
Jul 08 23:16:09.476801 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.476717    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-credential-socket\") pod \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") "
Jul 08 23:16:09.476801 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.476760    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-podinfo\") pod \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") "
Jul 08 23:16:09.477074 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.476851    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-data\") pod \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") "
Jul 08 23:16:09.477074 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.476847    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "52b0f760-80ee-4006-9cb6-ddb0aa65cd46" (UID: "52b0f760-80ee-4006-9cb6-ddb0aa65cd46"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:16:09.477074 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.476876    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-envoy\") pod \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\" (UID: \"52b0f760-80ee-4006-9cb6-ddb0aa65cd46\") "
Jul 08 23:16:09.477074 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.476937    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "52b0f760-80ee-4006-9cb6-ddb0aa65cd46" (UID: "52b0f760-80ee-4006-9cb6-ddb0aa65cd46"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:16:09.477291 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.477199    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-data" (OuterVolumeSpecName: "istio-data") pod "52b0f760-80ee-4006-9cb6-ddb0aa65cd46" (UID: "52b0f760-80ee-4006-9cb6-ddb0aa65cd46"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:16:09.477291 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.477213    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "52b0f760-80ee-4006-9cb6-ddb0aa65cd46" (UID: "52b0f760-80ee-4006-9cb6-ddb0aa65cd46"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:16:09.477291 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.477261    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "52b0f760-80ee-4006-9cb6-ddb0aa65cd46" (UID: "52b0f760-80ee-4006-9cb6-ddb0aa65cd46"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:16:09.477291 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.477267    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-workload-certs\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:09.477291 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.477286    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-workload-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:09.478897 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.478867    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "52b0f760-80ee-4006-9cb6-ddb0aa65cd46" (UID: "52b0f760-80ee-4006-9cb6-ddb0aa65cd46"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:16:09.479024 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.478926    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-token" (OuterVolumeSpecName: "istio-token") pod "52b0f760-80ee-4006-9cb6-ddb0aa65cd46" (UID: "52b0f760-80ee-4006-9cb6-ddb0aa65cd46"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:16:09.479212 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.479195    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "52b0f760-80ee-4006-9cb6-ddb0aa65cd46" (UID: "52b0f760-80ee-4006-9cb6-ddb0aa65cd46"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:16:09.479273 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.479259    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-kube-api-access-jtjfr" (OuterVolumeSpecName: "kube-api-access-jtjfr") pod "52b0f760-80ee-4006-9cb6-ddb0aa65cd46" (UID: "52b0f760-80ee-4006-9cb6-ddb0aa65cd46"). InnerVolumeSpecName "kube-api-access-jtjfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:16:09.578518 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.578429    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtjfr\" (UniqueName: \"kubernetes.io/projected/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-kube-api-access-jtjfr\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:09.578518 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.578463    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-token\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:09.578518 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.578472    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istiod-ca-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:09.578518 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.578479    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-credential-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:09.578518 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.578487    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-podinfo\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:09.578518 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.578496    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-data\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:09.578518 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:09.578504    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b0f760-80ee-4006-9cb6-ddb0aa65cd46-istio-envoy\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:10.035726 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.035674    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"]
Jul 08 23:16:10.036316 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.036294    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b0f760-80ee-4006-9cb6-ddb0aa65cd46" containerName="istio-proxy"
Jul 08 23:16:10.036501 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.036486    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b0f760-80ee-4006-9cb6-ddb0aa65cd46" containerName="istio-proxy"
Jul 08 23:16:10.036630 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.036617    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315057c6-1524-480f-908e-765faacac10d" containerName="maas-api"
Jul 08 23:16:10.036737 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.036717    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="315057c6-1524-480f-908e-765faacac10d" containerName="maas-api"
Jul 08 23:16:10.036844 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.036831    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="315057c6-1524-480f-908e-765faacac10d" containerName="maas-api"
Jul 08 23:16:10.036905 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.036847    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="52b0f760-80ee-4006-9cb6-ddb0aa65cd46" containerName="istio-proxy"
Jul 08 23:16:10.040262 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.040243    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.043492 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.043470    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b0724d7b-openshift-default-dockercfg-gsgft\""
Jul 08 23:16:10.045884 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.045810    2574 generic.go:356] "Generic (PLEG): container finished" podID="52b0f760-80ee-4006-9cb6-ddb0aa65cd46" containerID="d3c19022dd98370772cc5d27844ab592ba766db6fa913870e91c5629149bf953" exitCode=0
Jul 08 23:16:10.046000 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.045941    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg" event={"ID":"52b0f760-80ee-4006-9cb6-ddb0aa65cd46","Type":"ContainerDied","Data":"d3c19022dd98370772cc5d27844ab592ba766db6fa913870e91c5629149bf953"}
Jul 08 23:16:10.046000 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.045989    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg" event={"ID":"52b0f760-80ee-4006-9cb6-ddb0aa65cd46","Type":"ContainerDied","Data":"4c6f96927a40f5d1daae6beaac6064ccc30a9e7fcc2507d15c537e2c0846aac2"}
Jul 08 23:16:10.046104 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.046034    2574 scope.go:117] "RemoveContainer" containerID="d3c19022dd98370772cc5d27844ab592ba766db6fa913870e91c5629149bf953"
Jul 08 23:16:10.046496 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.046481    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"
Jul 08 23:16:10.056189 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.056165    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"]
Jul 08 23:16:10.060730 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.060678    2574 scope.go:117] "RemoveContainer" containerID="d3c19022dd98370772cc5d27844ab592ba766db6fa913870e91c5629149bf953"
Jul 08 23:16:10.061062 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:16:10.061040    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3c19022dd98370772cc5d27844ab592ba766db6fa913870e91c5629149bf953\": container with ID starting with d3c19022dd98370772cc5d27844ab592ba766db6fa913870e91c5629149bf953 not found: ID does not exist" containerID="d3c19022dd98370772cc5d27844ab592ba766db6fa913870e91c5629149bf953"
Jul 08 23:16:10.061156 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.061078    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c19022dd98370772cc5d27844ab592ba766db6fa913870e91c5629149bf953"} err="failed to get container status \"d3c19022dd98370772cc5d27844ab592ba766db6fa913870e91c5629149bf953\": rpc error: code = NotFound desc = could not find container \"d3c19022dd98370772cc5d27844ab592ba766db6fa913870e91c5629149bf953\": container with ID starting with d3c19022dd98370772cc5d27844ab592ba766db6fa913870e91c5629149bf953 not found: ID does not exist"
Jul 08 23:16:10.087936 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.087901    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"]
Jul 08 23:16:10.094196 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.094172    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-63a927c1-openshift-default-6445f4ccc5-9bgdg"]
Jul 08 23:16:10.185362 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.185324    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssw6l\" (UniqueName: \"kubernetes.io/projected/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-kube-api-access-ssw6l\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.185540 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.185374    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-workload-socket\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.185540 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.185425    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-token\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.185540 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.185463    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istiod-ca-cert\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.185540 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.185526    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-data\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.185707 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.185564    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-credential-socket\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.185707 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.185594    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-workload-certs\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.185707 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.185662    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-envoy\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.185799 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.185678    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-podinfo\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.286867 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.286769    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-envoy\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.286867 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.286805    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-podinfo\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.286867 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.286855    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssw6l\" (UniqueName: \"kubernetes.io/projected/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-kube-api-access-ssw6l\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.287147 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.286884    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-workload-socket\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.287147 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.286900    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-token\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.287147 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.286917    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istiod-ca-cert\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.287147 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.286949    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-data\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.287147 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.286974    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-credential-socket\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.287147 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.287007    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-workload-certs\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.287449 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.287333    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-workload-socket\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.287449 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.287415    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-credential-socket\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.287556 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.287451    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-data\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.287556 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.287544    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-workload-certs\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.287673 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.287653    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istiod-ca-cert\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.289136 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.289114    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-envoy\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.289354 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.289335    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-podinfo\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.295643 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.295622    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssw6l\" (UniqueName: \"kubernetes.io/projected/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-kube-api-access-ssw6l\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.295727 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.295657    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-token\") pod \"e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") " pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.360773 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.360731    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:10.498473 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.498450    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"]
Jul 08 23:16:10.500228 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:16:10.500196    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8bb5fa_8ce4_419f_92cc_73a28f4bec40.slice/crio-c0a763d3e51587a3afbb9d1e5b778c07dbc9b63e6768bbe3843847f391ff75ae WatchSource:0}: Error finding container c0a763d3e51587a3afbb9d1e5b778c07dbc9b63e6768bbe3843847f391ff75ae: Status 404 returned error can't find the container with id c0a763d3e51587a3afbb9d1e5b778c07dbc9b63e6768bbe3843847f391ff75ae
Jul 08 23:16:10.502338 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.502305    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:16:10.502436 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.502372    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:16:10.502436 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:10.502405    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:16:11.054269 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.054235    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k" event={"ID":"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40","Type":"ContainerStarted","Data":"7c2ec1227f320ca3bc8352ffe62a700300753ce538423ebf6eeebe6734945b58"}
Jul 08 23:16:11.054745 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.054283    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k" event={"ID":"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40","Type":"ContainerStarted","Data":"c0a763d3e51587a3afbb9d1e5b778c07dbc9b63e6768bbe3843847f391ff75ae"}
Jul 08 23:16:11.074090 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.074042    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k" podStartSLOduration=1.074026548 podStartE2EDuration="1.074026548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:16:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:16:11.07245021 +0000 UTC m=+1746.097032224" watchObservedRunningTime="2026-07-08 23:16:11.074026548 +0000 UTC m=+1746.098608549"
Jul 08 23:16:11.311023 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.310934    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"]
Jul 08 23:16:11.315090 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.315070    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"
Jul 08 23:16:11.317757 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.317739    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-b0724d7b-serving-cert\""
Jul 08 23:16:11.324798 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.324773    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"]
Jul 08 23:16:11.361535 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.361503    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:11.366328 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.366302    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:11.398052 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.398020    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwt8g\" (UniqueName: \"kubernetes.io/projected/052db682-f576-4bc6-a89c-963f362f6472-kube-api-access-zwt8g\") pod \"maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p\" (UID: \"052db682-f576-4bc6-a89c-963f362f6472\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"
Jul 08 23:16:11.398232 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.398069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/052db682-f576-4bc6-a89c-963f362f6472-openshift-service-ca\") pod \"maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p\" (UID: \"052db682-f576-4bc6-a89c-963f362f6472\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"
Jul 08 23:16:11.398232 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.398096    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/052db682-f576-4bc6-a89c-963f362f6472-maas-api-tls\") pod \"maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p\" (UID: \"052db682-f576-4bc6-a89c-963f362f6472\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"
Jul 08 23:16:11.499020 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.498991    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/052db682-f576-4bc6-a89c-963f362f6472-maas-api-tls\") pod \"maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p\" (UID: \"052db682-f576-4bc6-a89c-963f362f6472\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"
Jul 08 23:16:11.499217 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.499081    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwt8g\" (UniqueName: \"kubernetes.io/projected/052db682-f576-4bc6-a89c-963f362f6472-kube-api-access-zwt8g\") pod \"maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p\" (UID: \"052db682-f576-4bc6-a89c-963f362f6472\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"
Jul 08 23:16:11.499217 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.499115    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/052db682-f576-4bc6-a89c-963f362f6472-openshift-service-ca\") pod \"maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p\" (UID: \"052db682-f576-4bc6-a89c-963f362f6472\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"
Jul 08 23:16:11.499217 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:16:11.499131    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-serving-cert: secret "maas-api-e2e-derive-b0724d7b-serving-cert" not found
Jul 08 23:16:11.499217 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:16:11.499200    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/052db682-f576-4bc6-a89c-963f362f6472-maas-api-tls podName:052db682-f576-4bc6-a89c-963f362f6472 nodeName:}" failed. No retries permitted until 2026-07-08 23:16:11.999182634 +0000 UTC m=+1747.023764615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/052db682-f576-4bc6-a89c-963f362f6472-maas-api-tls") pod "maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p" (UID: "052db682-f576-4bc6-a89c-963f362f6472") : secret "maas-api-e2e-derive-b0724d7b-serving-cert" not found
Jul 08 23:16:11.499752 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.499735    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/052db682-f576-4bc6-a89c-963f362f6472-openshift-service-ca\") pod \"maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p\" (UID: \"052db682-f576-4bc6-a89c-963f362f6472\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"
Jul 08 23:16:11.502924 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.502901    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52b0f760-80ee-4006-9cb6-ddb0aa65cd46" path="/var/lib/kubelet/pods/52b0f760-80ee-4006-9cb6-ddb0aa65cd46/volumes"
Jul 08 23:16:11.508807 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:11.508784    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwt8g\" (UniqueName: \"kubernetes.io/projected/052db682-f576-4bc6-a89c-963f362f6472-kube-api-access-zwt8g\") pod \"maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p\" (UID: \"052db682-f576-4bc6-a89c-963f362f6472\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"
Jul 08 23:16:12.004512 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:12.004474    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/052db682-f576-4bc6-a89c-963f362f6472-maas-api-tls\") pod \"maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p\" (UID: \"052db682-f576-4bc6-a89c-963f362f6472\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"
Jul 08 23:16:12.007591 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:12.007558    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/052db682-f576-4bc6-a89c-963f362f6472-maas-api-tls\") pod \"maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p\" (UID: \"052db682-f576-4bc6-a89c-963f362f6472\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"
Jul 08 23:16:12.060740 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:12.060704    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:12.062011 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:12.061992    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:12.227136 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:12.226976    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"
Jul 08 23:16:12.387600 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:12.387572    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"]
Jul 08 23:16:12.388855 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:16:12.388825    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod052db682_f576_4bc6_a89c_963f362f6472.slice/crio-15f9d9fa25717d9f449e5c3ebef0847e9ea9ee1ba93fe9b537494139b76ea525 WatchSource:0}: Error finding container 15f9d9fa25717d9f449e5c3ebef0847e9ea9ee1ba93fe9b537494139b76ea525: Status 404 returned error can't find the container with id 15f9d9fa25717d9f449e5c3ebef0847e9ea9ee1ba93fe9b537494139b76ea525
Jul 08 23:16:13.067013 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:13.066918    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p" event={"ID":"052db682-f576-4bc6-a89c-963f362f6472","Type":"ContainerStarted","Data":"1c53792d8bb4fd24fc0d42b3710b8abdaf31421f581a790068023259e640c16c"}
Jul 08 23:16:13.067383 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:13.067159    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"
Jul 08 23:16:13.067383 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:13.067205    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p" event={"ID":"052db682-f576-4bc6-a89c-963f362f6472","Type":"ContainerStarted","Data":"15f9d9fa25717d9f449e5c3ebef0847e9ea9ee1ba93fe9b537494139b76ea525"}
Jul 08 23:16:13.086470 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:13.086414    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p" podStartSLOduration=1.778179556 podStartE2EDuration="2.086396046s" totalImagesPullingTime="308.21649ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:16:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:16:13.08426047 +0000 UTC m=+1748.108842473" watchObservedRunningTime="2026-07-08 23:16:13.086396046 +0000 UTC m=+1748.110978050"
Jul 08 23:16:15.811887 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:15.811848    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"]
Jul 08 23:16:15.812358 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:15.812037    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k" podUID="1f8bb5fa-8ce4-419f-92cc-73a28f4bec40" containerName="istio-proxy" containerID="cri-o://7c2ec1227f320ca3bc8352ffe62a700300753ce538423ebf6eeebe6734945b58" gracePeriod=30
Jul 08 23:16:16.023673 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:16.023631    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"]
Jul 08 23:16:16.030521 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:16.030110    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p" podUID="052db682-f576-4bc6-a89c-963f362f6472" containerName="maas-api" containerID="cri-o://1c53792d8bb4fd24fc0d42b3710b8abdaf31421f581a790068023259e640c16c" gracePeriod=30
Jul 08 23:16:16.309853 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:16.309829    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"
Jul 08 23:16:16.451852 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:16.450950    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/052db682-f576-4bc6-a89c-963f362f6472-maas-api-tls\") pod \"052db682-f576-4bc6-a89c-963f362f6472\" (UID: \"052db682-f576-4bc6-a89c-963f362f6472\") "
Jul 08 23:16:16.451852 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:16.451033    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/052db682-f576-4bc6-a89c-963f362f6472-openshift-service-ca\") pod \"052db682-f576-4bc6-a89c-963f362f6472\" (UID: \"052db682-f576-4bc6-a89c-963f362f6472\") "
Jul 08 23:16:16.451852 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:16.451127    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwt8g\" (UniqueName: \"kubernetes.io/projected/052db682-f576-4bc6-a89c-963f362f6472-kube-api-access-zwt8g\") pod \"052db682-f576-4bc6-a89c-963f362f6472\" (UID: \"052db682-f576-4bc6-a89c-963f362f6472\") "
Jul 08 23:16:16.452819 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:16.452792    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/052db682-f576-4bc6-a89c-963f362f6472-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "052db682-f576-4bc6-a89c-963f362f6472" (UID: "052db682-f576-4bc6-a89c-963f362f6472"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:16:16.454144 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:16.454109    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/052db682-f576-4bc6-a89c-963f362f6472-kube-api-access-zwt8g" (OuterVolumeSpecName: "kube-api-access-zwt8g") pod "052db682-f576-4bc6-a89c-963f362f6472" (UID: "052db682-f576-4bc6-a89c-963f362f6472"). InnerVolumeSpecName "kube-api-access-zwt8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:16:16.455097 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:16.455075    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/052db682-f576-4bc6-a89c-963f362f6472-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "052db682-f576-4bc6-a89c-963f362f6472" (UID: "052db682-f576-4bc6-a89c-963f362f6472"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:16:16.552589 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:16.552546    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/052db682-f576-4bc6-a89c-963f362f6472-maas-api-tls\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:16.552589 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:16.552594    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/052db682-f576-4bc6-a89c-963f362f6472-openshift-service-ca\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:16.552812 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:16.552610    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwt8g\" (UniqueName: \"kubernetes.io/projected/052db682-f576-4bc6-a89c-963f362f6472-kube-api-access-zwt8g\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:17.088704 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:17.088643    2574 generic.go:356] "Generic (PLEG): container finished" podID="052db682-f576-4bc6-a89c-963f362f6472" containerID="1c53792d8bb4fd24fc0d42b3710b8abdaf31421f581a790068023259e640c16c" exitCode=0
Jul 08 23:16:17.089197 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:17.088715    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"
Jul 08 23:16:17.089197 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:17.088732    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p" event={"ID":"052db682-f576-4bc6-a89c-963f362f6472","Type":"ContainerDied","Data":"1c53792d8bb4fd24fc0d42b3710b8abdaf31421f581a790068023259e640c16c"}
Jul 08 23:16:17.089197 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:17.088801    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p" event={"ID":"052db682-f576-4bc6-a89c-963f362f6472","Type":"ContainerDied","Data":"15f9d9fa25717d9f449e5c3ebef0847e9ea9ee1ba93fe9b537494139b76ea525"}
Jul 08 23:16:17.089197 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:17.088834    2574 scope.go:117] "RemoveContainer" containerID="1c53792d8bb4fd24fc0d42b3710b8abdaf31421f581a790068023259e640c16c"
Jul 08 23:16:17.098265 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:17.098250    2574 scope.go:117] "RemoveContainer" containerID="1c53792d8bb4fd24fc0d42b3710b8abdaf31421f581a790068023259e640c16c"
Jul 08 23:16:17.098507 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:16:17.098490    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c53792d8bb4fd24fc0d42b3710b8abdaf31421f581a790068023259e640c16c\": container with ID starting with 1c53792d8bb4fd24fc0d42b3710b8abdaf31421f581a790068023259e640c16c not found: ID does not exist" containerID="1c53792d8bb4fd24fc0d42b3710b8abdaf31421f581a790068023259e640c16c"
Jul 08 23:16:17.098553 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:17.098515    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c53792d8bb4fd24fc0d42b3710b8abdaf31421f581a790068023259e640c16c"} err="failed to get container status \"1c53792d8bb4fd24fc0d42b3710b8abdaf31421f581a790068023259e640c16c\": rpc error: code = NotFound desc = could not find container \"1c53792d8bb4fd24fc0d42b3710b8abdaf31421f581a790068023259e640c16c\": container with ID starting with 1c53792d8bb4fd24fc0d42b3710b8abdaf31421f581a790068023259e640c16c not found: ID does not exist"
Jul 08 23:16:17.110501 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:17.110477    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"]
Jul 08 23:16:17.118373 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:17.118339    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b0724d7b-677c7b4c74-9db6p"]
Jul 08 23:16:17.502436 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:17.502402    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="052db682-f576-4bc6-a89c-963f362f6472" path="/var/lib/kubelet/pods/052db682-f576-4bc6-a89c-963f362f6472/volumes"
Jul 08 23:16:22.358895 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.358871    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:22.508376 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.508338    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-credential-socket\") pod \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") "
Jul 08 23:16:22.508376 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.508378    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-podinfo\") pod \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") "
Jul 08 23:16:22.508639 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.508462    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssw6l\" (UniqueName: \"kubernetes.io/projected/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-kube-api-access-ssw6l\") pod \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") "
Jul 08 23:16:22.508639 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.508487    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-envoy\") pod \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") "
Jul 08 23:16:22.508639 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.508607    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-workload-socket\") pod \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") "
Jul 08 23:16:22.508848 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.508638    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40" (UID: "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:16:22.508848 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.508651    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-workload-certs\") pod \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") "
Jul 08 23:16:22.508848 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.508715    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istiod-ca-cert\") pod \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") "
Jul 08 23:16:22.508848 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.508742    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-data\") pod \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") "
Jul 08 23:16:22.509048 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.508862    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-token\") pod \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\" (UID: \"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40\") "
Jul 08 23:16:22.509048 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.508913    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40" (UID: "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:16:22.509048 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.508915    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40" (UID: "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:16:22.509203 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.509064    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40" (UID: "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:16:22.509203 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.509150    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-credential-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:22.509203 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.509169    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-workload-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:22.509203 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.509183    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-workload-certs\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:22.509203 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.509196    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istiod-ca-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:22.509644 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.509617    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-data" (OuterVolumeSpecName: "istio-data") pod "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40" (UID: "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:16:22.510832 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.510805    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40" (UID: "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:16:22.510832 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.510825    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40" (UID: "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:16:22.510975 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.510901    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-token" (OuterVolumeSpecName: "istio-token") pod "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40" (UID: "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:16:22.510975 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.510899    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-kube-api-access-ssw6l" (OuterVolumeSpecName: "kube-api-access-ssw6l") pod "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40" (UID: "1f8bb5fa-8ce4-419f-92cc-73a28f4bec40"). InnerVolumeSpecName "kube-api-access-ssw6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:16:22.609746 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.609674    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-token\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:22.609746 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.609746    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-podinfo\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:22.609957 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.609763    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssw6l\" (UniqueName: \"kubernetes.io/projected/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-kube-api-access-ssw6l\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:22.609957 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.609777    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-envoy\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:22.609957 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:22.609791    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40-istio-data\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:16:23.125274 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:23.125239    2574 generic.go:356] "Generic (PLEG): container finished" podID="1f8bb5fa-8ce4-419f-92cc-73a28f4bec40" containerID="7c2ec1227f320ca3bc8352ffe62a700300753ce538423ebf6eeebe6734945b58" exitCode=0
Jul 08 23:16:23.125496 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:23.125285    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"
Jul 08 23:16:23.125496 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:23.125327    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k" event={"ID":"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40","Type":"ContainerDied","Data":"7c2ec1227f320ca3bc8352ffe62a700300753ce538423ebf6eeebe6734945b58"}
Jul 08 23:16:23.125496 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:23.125380    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k" event={"ID":"1f8bb5fa-8ce4-419f-92cc-73a28f4bec40","Type":"ContainerDied","Data":"c0a763d3e51587a3afbb9d1e5b778c07dbc9b63e6768bbe3843847f391ff75ae"}
Jul 08 23:16:23.125496 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:23.125405    2574 scope.go:117] "RemoveContainer" containerID="7c2ec1227f320ca3bc8352ffe62a700300753ce538423ebf6eeebe6734945b58"
Jul 08 23:16:23.136457 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:23.136429    2574 scope.go:117] "RemoveContainer" containerID="7c2ec1227f320ca3bc8352ffe62a700300753ce538423ebf6eeebe6734945b58"
Jul 08 23:16:23.136761 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:16:23.136737    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c2ec1227f320ca3bc8352ffe62a700300753ce538423ebf6eeebe6734945b58\": container with ID starting with 7c2ec1227f320ca3bc8352ffe62a700300753ce538423ebf6eeebe6734945b58 not found: ID does not exist" containerID="7c2ec1227f320ca3bc8352ffe62a700300753ce538423ebf6eeebe6734945b58"
Jul 08 23:16:23.136826 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:23.136769    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c2ec1227f320ca3bc8352ffe62a700300753ce538423ebf6eeebe6734945b58"} err="failed to get container status \"7c2ec1227f320ca3bc8352ffe62a700300753ce538423ebf6eeebe6734945b58\": rpc error: code = NotFound desc = could not find container \"7c2ec1227f320ca3bc8352ffe62a700300753ce538423ebf6eeebe6734945b58\": container with ID starting with 7c2ec1227f320ca3bc8352ffe62a700300753ce538423ebf6eeebe6734945b58 not found: ID does not exist"
Jul 08 23:16:23.148348 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:23.148320    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"]
Jul 08 23:16:23.152011 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:23.151988    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b0724d7b-openshift-default-5bb7864459-sbq2k"]
Jul 08 23:16:23.502348 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:16:23.502251    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f8bb5fa-8ce4-419f-92cc-73a28f4bec40" path="/var/lib/kubelet/pods/1f8bb5fa-8ce4-419f-92cc-73a28f4bec40/volumes"
Jul 08 23:17:05.549942 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:05.549915    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 23:17:05.551715 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:05.551678    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 23:17:56.588751 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.588714    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"]
Jul 08 23:17:56.589226 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.589109    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="052db682-f576-4bc6-a89c-963f362f6472" containerName="maas-api"
Jul 08 23:17:56.589226 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.589121    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="052db682-f576-4bc6-a89c-963f362f6472" containerName="maas-api"
Jul 08 23:17:56.589226 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.589131    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f8bb5fa-8ce4-419f-92cc-73a28f4bec40" containerName="istio-proxy"
Jul 08 23:17:56.589226 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.589136    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f8bb5fa-8ce4-419f-92cc-73a28f4bec40" containerName="istio-proxy"
Jul 08 23:17:56.589226 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.589215    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f8bb5fa-8ce4-419f-92cc-73a28f4bec40" containerName="istio-proxy"
Jul 08 23:17:56.589226 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.589223    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="052db682-f576-4bc6-a89c-963f362f6472" containerName="maas-api"
Jul 08 23:17:56.592372 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.592355    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.594979 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.594959    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ce61a4d8-openshift-default-dockercfg-jtfrm\""
Jul 08 23:17:56.603577 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.603550    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"]
Jul 08 23:17:56.691565 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.691530    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv8sj\" (UniqueName: \"kubernetes.io/projected/bc0cba71-e205-4b50-8d45-50f430088abd-kube-api-access-lv8sj\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.691565 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.691569    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-workload-certs\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.691847 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.691681    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-istio-envoy\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.691847 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.691746    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-workload-socket\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.691847 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.691766    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-istio-data\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.691847 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.691819    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-credential-socket\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.692073 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.691854    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0cba71-e205-4b50-8d45-50f430088abd-istio-token\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.692073 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.691873    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0cba71-e205-4b50-8d45-50f430088abd-istio-podinfo\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.692073 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.691895    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0cba71-e205-4b50-8d45-50f430088abd-istiod-ca-cert\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.793179 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.793120    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv8sj\" (UniqueName: \"kubernetes.io/projected/bc0cba71-e205-4b50-8d45-50f430088abd-kube-api-access-lv8sj\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.793179 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.793177    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-workload-certs\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.793452 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.793219    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-istio-envoy\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.793452 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.793258    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-workload-socket\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.793452 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.793276    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-istio-data\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.793612 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.793455    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-credential-socket\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.793612 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.793500    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0cba71-e205-4b50-8d45-50f430088abd-istio-token\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.793612 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.793526    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0cba71-e205-4b50-8d45-50f430088abd-istio-podinfo\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.793612 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.793558    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0cba71-e205-4b50-8d45-50f430088abd-istiod-ca-cert\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.793873 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.793640    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-workload-certs\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.793873 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.793833    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-workload-socket\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.793968 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.793867    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-istio-data\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.794142 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.794118    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-credential-socket\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.794275 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.794260    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0cba71-e205-4b50-8d45-50f430088abd-istiod-ca-cert\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.795596 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.795571    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-istio-envoy\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.795809 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.795792    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0cba71-e205-4b50-8d45-50f430088abd-istio-podinfo\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.801918 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.801888    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv8sj\" (UniqueName: \"kubernetes.io/projected/bc0cba71-e205-4b50-8d45-50f430088abd-kube-api-access-lv8sj\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.802113 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.802090    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0cba71-e205-4b50-8d45-50f430088abd-istio-token\") pod \"e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") " pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:56.904223 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:56.904187    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:57.058992 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:57.058962    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"]
Jul 08 23:17:57.060256 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:17:57.060232    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0cba71_e205_4b50_8d45_50f430088abd.slice/crio-2f6802566278818c6fd5c1f87a099a7a1d388d49f153d702b92b481a0ce9d98c WatchSource:0}: Error finding container 2f6802566278818c6fd5c1f87a099a7a1d388d49f153d702b92b481a0ce9d98c: Status 404 returned error can't find the container with id 2f6802566278818c6fd5c1f87a099a7a1d388d49f153d702b92b481a0ce9d98c
Jul 08 23:17:57.062481 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:57.062453    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:17:57.062558 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:57.062529    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:17:57.062600 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:57.062561    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:17:57.615372 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:57.615334    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2" event={"ID":"bc0cba71-e205-4b50-8d45-50f430088abd","Type":"ContainerStarted","Data":"56d3b1de400a64671036336fc49ebf90acaf522fcd209eaabee38215ecd925cd"}
Jul 08 23:17:57.615987 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:57.615393    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2" event={"ID":"bc0cba71-e205-4b50-8d45-50f430088abd","Type":"ContainerStarted","Data":"2f6802566278818c6fd5c1f87a099a7a1d388d49f153d702b92b481a0ce9d98c"}
Jul 08 23:17:57.635401 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:57.635348    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2" podStartSLOduration=1.635331271 podStartE2EDuration="1.635331271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:17:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:17:57.633167811 +0000 UTC m=+1852.657749816" watchObservedRunningTime="2026-07-08 23:17:57.635331271 +0000 UTC m=+1852.659913343"
Jul 08 23:17:57.904567 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:57.904530    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:58.910030 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:58.910001    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:59.596052 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:59.596007    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"]
Jul 08 23:17:59.599559 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:59.599535    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"
Jul 08 23:17:59.602478 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:59.602450    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ce61a4d8-serving-cert\""
Jul 08 23:17:59.611756 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:59.611729    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"]
Jul 08 23:17:59.621889 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:59.621858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-openshift-service-ca\") pod \"maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr\" (UID: \"264de90e-e6d2-4ee9-bdc7-8650a1d36a22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"
Jul 08 23:17:59.622090 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:59.621952    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj872\" (UniqueName: \"kubernetes.io/projected/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-kube-api-access-gj872\") pod \"maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr\" (UID: \"264de90e-e6d2-4ee9-bdc7-8650a1d36a22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"
Jul 08 23:17:59.622090 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:59.621980    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-maas-api-tls\") pod \"maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr\" (UID: \"264de90e-e6d2-4ee9-bdc7-8650a1d36a22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"
Jul 08 23:17:59.627588 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:59.627554    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:59.628708 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:59.628671    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:17:59.722469 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:59.722435    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj872\" (UniqueName: \"kubernetes.io/projected/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-kube-api-access-gj872\") pod \"maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr\" (UID: \"264de90e-e6d2-4ee9-bdc7-8650a1d36a22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"
Jul 08 23:17:59.722469 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:59.722470    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-maas-api-tls\") pod \"maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr\" (UID: \"264de90e-e6d2-4ee9-bdc7-8650a1d36a22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"
Jul 08 23:17:59.722719 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:59.722516    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-openshift-service-ca\") pod \"maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr\" (UID: \"264de90e-e6d2-4ee9-bdc7-8650a1d36a22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"
Jul 08 23:17:59.722719 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:17:59.722711    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-serving-cert: secret "maas-api-e2e-mt-ce61a4d8-serving-cert" not found
Jul 08 23:17:59.722851 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:17:59.722779    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-maas-api-tls podName:264de90e-e6d2-4ee9-bdc7-8650a1d36a22 nodeName:}" failed. No retries permitted until 2026-07-08 23:18:00.22275546 +0000 UTC m=+1855.247337448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-maas-api-tls") pod "maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr" (UID: "264de90e-e6d2-4ee9-bdc7-8650a1d36a22") : secret "maas-api-e2e-mt-ce61a4d8-serving-cert" not found
Jul 08 23:17:59.723188 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:59.723160    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-openshift-service-ca\") pod \"maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr\" (UID: \"264de90e-e6d2-4ee9-bdc7-8650a1d36a22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"
Jul 08 23:17:59.746140 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:17:59.746105    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj872\" (UniqueName: \"kubernetes.io/projected/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-kube-api-access-gj872\") pod \"maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr\" (UID: \"264de90e-e6d2-4ee9-bdc7-8650a1d36a22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"
Jul 08 23:18:00.226875 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:00.226841    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-maas-api-tls\") pod \"maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr\" (UID: \"264de90e-e6d2-4ee9-bdc7-8650a1d36a22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"
Jul 08 23:18:00.229671 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:00.229633    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-maas-api-tls\") pod \"maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr\" (UID: \"264de90e-e6d2-4ee9-bdc7-8650a1d36a22\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"
Jul 08 23:18:00.510826 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:00.510720    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"
Jul 08 23:18:00.658804 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:00.658756    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"]
Jul 08 23:18:00.661953 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:18:00.661923    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264de90e_e6d2_4ee9_bdc7_8650a1d36a22.slice/crio-7bbbcfc00bb929f2c09cbc1cc7e50bbe9f4e88ba48a49cebc9e9e1ef1233af80 WatchSource:0}: Error finding container 7bbbcfc00bb929f2c09cbc1cc7e50bbe9f4e88ba48a49cebc9e9e1ef1233af80: Status 404 returned error can't find the container with id 7bbbcfc00bb929f2c09cbc1cc7e50bbe9f4e88ba48a49cebc9e9e1ef1233af80
Jul 08 23:18:01.640515 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:01.640468    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr" event={"ID":"264de90e-e6d2-4ee9-bdc7-8650a1d36a22","Type":"ContainerStarted","Data":"b03fff2c9048c5c96cdef7d97d7e771f1d7c095dcd632391488071d4e5ced2ba"}
Jul 08 23:18:01.641012 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:01.640537    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr" event={"ID":"264de90e-e6d2-4ee9-bdc7-8650a1d36a22","Type":"ContainerStarted","Data":"7bbbcfc00bb929f2c09cbc1cc7e50bbe9f4e88ba48a49cebc9e9e1ef1233af80"}
Jul 08 23:18:01.641012 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:01.640778    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"
Jul 08 23:18:01.657170 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:01.657119    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr" podStartSLOduration=2.235885474 podStartE2EDuration="2.657099396s" totalImagesPullingTime="421.213922ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:18:01.655795088 +0000 UTC m=+1856.680377092" watchObservedRunningTime="2026-07-08 23:18:01.657099396 +0000 UTC m=+1856.681681399"
Jul 08 23:18:07.652538 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:07.652506    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"
Jul 08 23:18:10.703838 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:10.703749    2574 generic.go:356] "Generic (PLEG): container finished" podID="bc0cba71-e205-4b50-8d45-50f430088abd" containerID="56d3b1de400a64671036336fc49ebf90acaf522fcd209eaabee38215ecd925cd" exitCode=0
Jul 08 23:18:10.703838 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:10.703823    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2" event={"ID":"bc0cba71-e205-4b50-8d45-50f430088abd","Type":"ContainerDied","Data":"56d3b1de400a64671036336fc49ebf90acaf522fcd209eaabee38215ecd925cd"}
Jul 08 23:18:10.704300 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:10.704244    2574 scope.go:117] "RemoveContainer" containerID="56d3b1de400a64671036336fc49ebf90acaf522fcd209eaabee38215ecd925cd"
Jul 08 23:18:10.705275 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:10.705250    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:18:10.705343 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:10.705318    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:18:10.705435 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:10.705367    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:18:11.446645 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.446603    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"]
Jul 08 23:18:11.446935 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.446881    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr" podUID="264de90e-e6d2-4ee9-bdc7-8650a1d36a22" containerName="maas-api" containerID="cri-o://b03fff2c9048c5c96cdef7d97d7e771f1d7c095dcd632391488071d4e5ced2ba" gracePeriod=30
Jul 08 23:18:11.712444 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.712413    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2" event={"ID":"bc0cba71-e205-4b50-8d45-50f430088abd","Type":"ContainerStarted","Data":"4d9ea96212899ebef5c0317400e48bab72690cb6041ae06569aec8d4292df866"}
Jul 08 23:18:11.713822 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.713798    2574 generic.go:356] "Generic (PLEG): container finished" podID="264de90e-e6d2-4ee9-bdc7-8650a1d36a22" containerID="b03fff2c9048c5c96cdef7d97d7e771f1d7c095dcd632391488071d4e5ced2ba" exitCode=0
Jul 08 23:18:11.713926 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.713855    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr" event={"ID":"264de90e-e6d2-4ee9-bdc7-8650a1d36a22","Type":"ContainerDied","Data":"b03fff2c9048c5c96cdef7d97d7e771f1d7c095dcd632391488071d4e5ced2ba"}
Jul 08 23:18:11.758205 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.758173    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"
Jul 08 23:18:11.844710 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.844069    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-maas-api-tls\") pod \"264de90e-e6d2-4ee9-bdc7-8650a1d36a22\" (UID: \"264de90e-e6d2-4ee9-bdc7-8650a1d36a22\") "
Jul 08 23:18:11.844710 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.844133    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-openshift-service-ca\") pod \"264de90e-e6d2-4ee9-bdc7-8650a1d36a22\" (UID: \"264de90e-e6d2-4ee9-bdc7-8650a1d36a22\") "
Jul 08 23:18:11.844710 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.844190    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj872\" (UniqueName: \"kubernetes.io/projected/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-kube-api-access-gj872\") pod \"264de90e-e6d2-4ee9-bdc7-8650a1d36a22\" (UID: \"264de90e-e6d2-4ee9-bdc7-8650a1d36a22\") "
Jul 08 23:18:11.845857 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.845827    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "264de90e-e6d2-4ee9-bdc7-8650a1d36a22" (UID: "264de90e-e6d2-4ee9-bdc7-8650a1d36a22"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:18:11.853910 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.853841    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "264de90e-e6d2-4ee9-bdc7-8650a1d36a22" (UID: "264de90e-e6d2-4ee9-bdc7-8650a1d36a22"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:18:11.853910 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.853853    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-kube-api-access-gj872" (OuterVolumeSpecName: "kube-api-access-gj872") pod "264de90e-e6d2-4ee9-bdc7-8650a1d36a22" (UID: "264de90e-e6d2-4ee9-bdc7-8650a1d36a22"). InnerVolumeSpecName "kube-api-access-gj872". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:18:11.905198 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.905155    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:18:11.906422 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.906393    2574 patch_prober.go:28] interesting pod/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 08 23:18:11.906513 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.906443    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2" podUID="bc0cba71-e205-4b50-8d45-50f430088abd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 08 23:18:11.945480 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.945436    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj872\" (UniqueName: \"kubernetes.io/projected/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-kube-api-access-gj872\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:18:11.945480 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.945480    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-maas-api-tls\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:18:11.945778 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:11.945498    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/264de90e-e6d2-4ee9-bdc7-8650a1d36a22-openshift-service-ca\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:18:12.720262 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:12.720235    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"
Jul 08 23:18:12.720671 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:12.720275    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr" event={"ID":"264de90e-e6d2-4ee9-bdc7-8650a1d36a22","Type":"ContainerDied","Data":"7bbbcfc00bb929f2c09cbc1cc7e50bbe9f4e88ba48a49cebc9e9e1ef1233af80"}
Jul 08 23:18:12.720671 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:12.720332    2574 scope.go:117] "RemoveContainer" containerID="b03fff2c9048c5c96cdef7d97d7e771f1d7c095dcd632391488071d4e5ced2ba"
Jul 08 23:18:12.756499 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:12.756455    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"]
Jul 08 23:18:12.760554 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:12.760522    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ce61a4d8-54c76b545d-fdjzr"]
Jul 08 23:18:12.905136 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:12.905090    2574 patch_prober.go:28] interesting pod/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 08 23:18:12.905319 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:12.905153    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2" podUID="bc0cba71-e205-4b50-8d45-50f430088abd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 08 23:18:13.502771 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:13.502738    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="264de90e-e6d2-4ee9-bdc7-8650a1d36a22" path="/var/lib/kubelet/pods/264de90e-e6d2-4ee9-bdc7-8650a1d36a22/volumes"
Jul 08 23:18:13.904619 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:13.904584    2574 patch_prober.go:28] interesting pod/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 08 23:18:13.905040 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:13.904643    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2" podUID="bc0cba71-e205-4b50-8d45-50f430088abd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 08 23:18:14.627840 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:14.627792    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:18:14.905417 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:14.905321    2574 patch_prober.go:28] interesting pod/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 08 23:18:14.905417 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:14.905384    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2" podUID="bc0cba71-e205-4b50-8d45-50f430088abd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 08 23:18:15.909184 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:15.909152    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:18:15.910337 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:15.910317    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:18:17.273936 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:17.273903    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"]
Jul 08 23:18:17.756204 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:17.756161    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2" podUID="bc0cba71-e205-4b50-8d45-50f430088abd" containerName="istio-proxy" containerID="cri-o://4d9ea96212899ebef5c0317400e48bab72690cb6041ae06569aec8d4292df866" gracePeriod=30
Jul 08 23:18:23.017293 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.017263    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:18:23.154860 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.154818    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lv8sj\" (UniqueName: \"kubernetes.io/projected/bc0cba71-e205-4b50-8d45-50f430088abd-kube-api-access-lv8sj\") pod \"bc0cba71-e205-4b50-8d45-50f430088abd\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") "
Jul 08 23:18:23.154860 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.154868    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0cba71-e205-4b50-8d45-50f430088abd-istio-token\") pod \"bc0cba71-e205-4b50-8d45-50f430088abd\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") "
Jul 08 23:18:23.155085 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.154923    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-istio-envoy\") pod \"bc0cba71-e205-4b50-8d45-50f430088abd\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") "
Jul 08 23:18:23.155085 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.154949    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-credential-socket\") pod \"bc0cba71-e205-4b50-8d45-50f430088abd\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") "
Jul 08 23:18:23.155085 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.154978    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0cba71-e205-4b50-8d45-50f430088abd-istio-podinfo\") pod \"bc0cba71-e205-4b50-8d45-50f430088abd\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") "
Jul 08 23:18:23.155085 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.155031    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-istio-data\") pod \"bc0cba71-e205-4b50-8d45-50f430088abd\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") "
Jul 08 23:18:23.155085 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.155056    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0cba71-e205-4b50-8d45-50f430088abd-istiod-ca-cert\") pod \"bc0cba71-e205-4b50-8d45-50f430088abd\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") "
Jul 08 23:18:23.155349 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.155086    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-workload-socket\") pod \"bc0cba71-e205-4b50-8d45-50f430088abd\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") "
Jul 08 23:18:23.155349 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.155114    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-workload-certs\") pod \"bc0cba71-e205-4b50-8d45-50f430088abd\" (UID: \"bc0cba71-e205-4b50-8d45-50f430088abd\") "
Jul 08 23:18:23.155349 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.155300    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc0cba71-e205-4b50-8d45-50f430088abd" (UID: "bc0cba71-e205-4b50-8d45-50f430088abd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:18:23.155538 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.155508    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-credential-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:18:23.155538 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.155511    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc0cba71-e205-4b50-8d45-50f430088abd" (UID: "bc0cba71-e205-4b50-8d45-50f430088abd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:18:23.155751 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.155718    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc0cba71-e205-4b50-8d45-50f430088abd" (UID: "bc0cba71-e205-4b50-8d45-50f430088abd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:18:23.155751 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.155732    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc0cba71-e205-4b50-8d45-50f430088abd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc0cba71-e205-4b50-8d45-50f430088abd" (UID: "bc0cba71-e205-4b50-8d45-50f430088abd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:18:23.156136 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.156108    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc0cba71-e205-4b50-8d45-50f430088abd" (UID: "bc0cba71-e205-4b50-8d45-50f430088abd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:18:23.157122 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.157102    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc0cba71-e205-4b50-8d45-50f430088abd-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc0cba71-e205-4b50-8d45-50f430088abd" (UID: "bc0cba71-e205-4b50-8d45-50f430088abd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:18:23.157215 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.157132    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc0cba71-e205-4b50-8d45-50f430088abd-kube-api-access-lv8sj" (OuterVolumeSpecName: "kube-api-access-lv8sj") pod "bc0cba71-e205-4b50-8d45-50f430088abd" (UID: "bc0cba71-e205-4b50-8d45-50f430088abd"). InnerVolumeSpecName "kube-api-access-lv8sj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:18:23.157422 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.157405    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc0cba71-e205-4b50-8d45-50f430088abd" (UID: "bc0cba71-e205-4b50-8d45-50f430088abd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:18:23.157645 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.157613    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc0cba71-e205-4b50-8d45-50f430088abd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc0cba71-e205-4b50-8d45-50f430088abd" (UID: "bc0cba71-e205-4b50-8d45-50f430088abd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:18:23.256452 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.256408    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-istio-envoy\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:18:23.256452 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.256443    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0cba71-e205-4b50-8d45-50f430088abd-istio-podinfo\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:18:23.256452 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.256456    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-istio-data\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:18:23.256452 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.256464    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0cba71-e205-4b50-8d45-50f430088abd-istiod-ca-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:18:23.256772 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.256472    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-workload-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:18:23.256772 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.256479    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0cba71-e205-4b50-8d45-50f430088abd-workload-certs\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:18:23.256772 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.256487    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv8sj\" (UniqueName: \"kubernetes.io/projected/bc0cba71-e205-4b50-8d45-50f430088abd-kube-api-access-lv8sj\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:18:23.256772 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.256497    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0cba71-e205-4b50-8d45-50f430088abd-istio-token\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:18:23.788862 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.788760    2574 generic.go:356] "Generic (PLEG): container finished" podID="bc0cba71-e205-4b50-8d45-50f430088abd" containerID="4d9ea96212899ebef5c0317400e48bab72690cb6041ae06569aec8d4292df866" exitCode=0
Jul 08 23:18:23.788862 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.788815    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"
Jul 08 23:18:23.788862 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.788850    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2" event={"ID":"bc0cba71-e205-4b50-8d45-50f430088abd","Type":"ContainerDied","Data":"4d9ea96212899ebef5c0317400e48bab72690cb6041ae06569aec8d4292df866"}
Jul 08 23:18:23.789128 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.788910    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2" event={"ID":"bc0cba71-e205-4b50-8d45-50f430088abd","Type":"ContainerDied","Data":"2f6802566278818c6fd5c1f87a099a7a1d388d49f153d702b92b481a0ce9d98c"}
Jul 08 23:18:23.789128 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.788940    2574 scope.go:117] "RemoveContainer" containerID="4d9ea96212899ebef5c0317400e48bab72690cb6041ae06569aec8d4292df866"
Jul 08 23:18:23.801567 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.800991    2574 scope.go:117] "RemoveContainer" containerID="56d3b1de400a64671036336fc49ebf90acaf522fcd209eaabee38215ecd925cd"
Jul 08 23:18:23.809156 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.809130    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"]
Jul 08 23:18:23.810228 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.810214    2574 scope.go:117] "RemoveContainer" containerID="4d9ea96212899ebef5c0317400e48bab72690cb6041ae06569aec8d4292df866"
Jul 08 23:18:23.810489 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:18:23.810468    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d9ea96212899ebef5c0317400e48bab72690cb6041ae06569aec8d4292df866\": container with ID starting with 4d9ea96212899ebef5c0317400e48bab72690cb6041ae06569aec8d4292df866 not found: ID does not exist" containerID="4d9ea96212899ebef5c0317400e48bab72690cb6041ae06569aec8d4292df866"
Jul 08 23:18:23.810537 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.810500    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d9ea96212899ebef5c0317400e48bab72690cb6041ae06569aec8d4292df866"} err="failed to get container status \"4d9ea96212899ebef5c0317400e48bab72690cb6041ae06569aec8d4292df866\": rpc error: code = NotFound desc = could not find container \"4d9ea96212899ebef5c0317400e48bab72690cb6041ae06569aec8d4292df866\": container with ID starting with 4d9ea96212899ebef5c0317400e48bab72690cb6041ae06569aec8d4292df866 not found: ID does not exist"
Jul 08 23:18:23.810537 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.810519    2574 scope.go:117] "RemoveContainer" containerID="56d3b1de400a64671036336fc49ebf90acaf522fcd209eaabee38215ecd925cd"
Jul 08 23:18:23.810821 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:18:23.810799    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56d3b1de400a64671036336fc49ebf90acaf522fcd209eaabee38215ecd925cd\": container with ID starting with 56d3b1de400a64671036336fc49ebf90acaf522fcd209eaabee38215ecd925cd not found: ID does not exist" containerID="56d3b1de400a64671036336fc49ebf90acaf522fcd209eaabee38215ecd925cd"
Jul 08 23:18:23.810888 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.810827    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56d3b1de400a64671036336fc49ebf90acaf522fcd209eaabee38215ecd925cd"} err="failed to get container status \"56d3b1de400a64671036336fc49ebf90acaf522fcd209eaabee38215ecd925cd\": rpc error: code = NotFound desc = could not find container \"56d3b1de400a64671036336fc49ebf90acaf522fcd209eaabee38215ecd925cd\": container with ID starting with 56d3b1de400a64671036336fc49ebf90acaf522fcd209eaabee38215ecd925cd not found: ID does not exist"
Jul 08 23:18:23.815139 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:23.815115    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ce61a4d8-openshift-default-689d5668c9-nxph2"]
Jul 08 23:18:25.502936 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:25.502895    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc0cba71-e205-4b50-8d45-50f430088abd" path="/var/lib/kubelet/pods/bc0cba71-e205-4b50-8d45-50f430088abd/volumes"
Jul 08 23:18:36.384682 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.384600    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"]
Jul 08 23:18:36.385122 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.384978    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="264de90e-e6d2-4ee9-bdc7-8650a1d36a22" containerName="maas-api"
Jul 08 23:18:36.385122 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.384989    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="264de90e-e6d2-4ee9-bdc7-8650a1d36a22" containerName="maas-api"
Jul 08 23:18:36.385122 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.385002    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc0cba71-e205-4b50-8d45-50f430088abd" containerName="istio-proxy"
Jul 08 23:18:36.385122 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.385008    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc0cba71-e205-4b50-8d45-50f430088abd" containerName="istio-proxy"
Jul 08 23:18:36.385122 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.385017    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc0cba71-e205-4b50-8d45-50f430088abd" containerName="istio-proxy"
Jul 08 23:18:36.385122 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.385022    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc0cba71-e205-4b50-8d45-50f430088abd" containerName="istio-proxy"
Jul 08 23:18:36.385122 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.385093    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc0cba71-e205-4b50-8d45-50f430088abd" containerName="istio-proxy"
Jul 08 23:18:36.385122 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.385100    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="264de90e-e6d2-4ee9-bdc7-8650a1d36a22" containerName="maas-api"
Jul 08 23:18:36.385122 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.385108    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc0cba71-e205-4b50-8d45-50f430088abd" containerName="istio-proxy"
Jul 08 23:18:36.388128 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.388107    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.390812 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.390793    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5d2c4024-openshift-default-dockercfg-hp4gf\""
Jul 08 23:18:36.399563 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.399537    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"]
Jul 08 23:18:36.478216 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.478177    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc2vq\" (UniqueName: \"kubernetes.io/projected/96d11667-fb65-4900-b626-e7b509bf47dd-kube-api-access-tc2vq\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.478216 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.478218    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96d11667-fb65-4900-b626-e7b509bf47dd-istio-token\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.478492 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.478247    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-workload-certs\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.478492 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.478276    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-credential-socket\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.478492 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.478331    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-istio-envoy\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.478492 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.478431    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96d11667-fb65-4900-b626-e7b509bf47dd-istiod-ca-cert\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.478492 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.478469    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96d11667-fb65-4900-b626-e7b509bf47dd-istio-podinfo\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.478721 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.478506    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-workload-socket\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.478721 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.478556    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-istio-data\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.579397 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.579349    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96d11667-fb65-4900-b626-e7b509bf47dd-istiod-ca-cert\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.579397 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.579399    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96d11667-fb65-4900-b626-e7b509bf47dd-istio-podinfo\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.579664 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.579438    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-workload-socket\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.579664 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.579481    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-istio-data\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.579664 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.579542    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc2vq\" (UniqueName: \"kubernetes.io/projected/96d11667-fb65-4900-b626-e7b509bf47dd-kube-api-access-tc2vq\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.579664 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.579568    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96d11667-fb65-4900-b626-e7b509bf47dd-istio-token\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.579664 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.579593    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-workload-certs\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.579664 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.579621    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-credential-socket\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.579664 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.579663    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-istio-envoy\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.580117 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.580009    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-istio-data\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.580117 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.580025    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-workload-socket\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.580117 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.580060    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-workload-certs\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.580272 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.580241    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96d11667-fb65-4900-b626-e7b509bf47dd-istiod-ca-cert\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.580272 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.580241    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-credential-socket\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.582083 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.582062    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-istio-envoy\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.582227 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.582203    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96d11667-fb65-4900-b626-e7b509bf47dd-istio-podinfo\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.587984 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.587958    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc2vq\" (UniqueName: \"kubernetes.io/projected/96d11667-fb65-4900-b626-e7b509bf47dd-kube-api-access-tc2vq\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.588129 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.588021    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96d11667-fb65-4900-b626-e7b509bf47dd-istio-token\") pod \"e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") " pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.698997 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.698907    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:36.846865 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.846836    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"]
Jul 08 23:18:36.848845 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:18:36.848819    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d11667_fb65_4900_b626_e7b509bf47dd.slice/crio-7f7b6c197b76ab0388b655542364b31ea13e0918a47b3a69076bb872eaf33ec2 WatchSource:0}: Error finding container 7f7b6c197b76ab0388b655542364b31ea13e0918a47b3a69076bb872eaf33ec2: Status 404 returned error can't find the container with id 7f7b6c197b76ab0388b655542364b31ea13e0918a47b3a69076bb872eaf33ec2
Jul 08 23:18:36.851279 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.851243    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:18:36.851363 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.851314    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:18:36.851363 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.851342    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:18:36.860510 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:36.860481    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt" event={"ID":"96d11667-fb65-4900-b626-e7b509bf47dd","Type":"ContainerStarted","Data":"7f7b6c197b76ab0388b655542364b31ea13e0918a47b3a69076bb872eaf33ec2"}
Jul 08 23:18:37.867111 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:37.867079    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt" event={"ID":"96d11667-fb65-4900-b626-e7b509bf47dd","Type":"ContainerStarted","Data":"7f54bc70476343c14dfc0ca39ba76e29141f85f929f4ec9dc19c85daa0740527"}
Jul 08 23:18:37.887983 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:37.887930    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt" podStartSLOduration=1.88791215 podStartE2EDuration="1.88791215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:18:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:18:37.885980899 +0000 UTC m=+1892.910562906" watchObservedRunningTime="2026-07-08 23:18:37.88791215 +0000 UTC m=+1892.912494188"
Jul 08 23:18:38.699120 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:38.699071    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:38.704202 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:38.704171    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:38.872524 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:38.872487    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:38.873355 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:38.873332    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:39.845898 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:39.845863    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"]
Jul 08 23:18:39.850466 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:39.850436    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"
Jul 08 23:18:39.853914 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:39.853892    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5d2c4024-serving-cert\""
Jul 08 23:18:39.860595 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:39.860566    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"]
Jul 08 23:18:40.011596 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:40.011559    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1622df64-36f3-46bf-9f3f-ca9eebbbf722-openshift-service-ca\") pod \"maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v\" (UID: \"1622df64-36f3-46bf-9f3f-ca9eebbbf722\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"
Jul 08 23:18:40.012068 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:40.011605    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1622df64-36f3-46bf-9f3f-ca9eebbbf722-maas-api-tls\") pod \"maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v\" (UID: \"1622df64-36f3-46bf-9f3f-ca9eebbbf722\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"
Jul 08 23:18:40.012068 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:40.011887    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n799b\" (UniqueName: \"kubernetes.io/projected/1622df64-36f3-46bf-9f3f-ca9eebbbf722-kube-api-access-n799b\") pod \"maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v\" (UID: \"1622df64-36f3-46bf-9f3f-ca9eebbbf722\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"
Jul 08 23:18:40.113112 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:40.113006    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n799b\" (UniqueName: \"kubernetes.io/projected/1622df64-36f3-46bf-9f3f-ca9eebbbf722-kube-api-access-n799b\") pod \"maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v\" (UID: \"1622df64-36f3-46bf-9f3f-ca9eebbbf722\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"
Jul 08 23:18:40.113112 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:40.113098    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1622df64-36f3-46bf-9f3f-ca9eebbbf722-openshift-service-ca\") pod \"maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v\" (UID: \"1622df64-36f3-46bf-9f3f-ca9eebbbf722\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"
Jul 08 23:18:40.113392 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:40.113137    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1622df64-36f3-46bf-9f3f-ca9eebbbf722-maas-api-tls\") pod \"maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v\" (UID: \"1622df64-36f3-46bf-9f3f-ca9eebbbf722\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"
Jul 08 23:18:40.113392 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:18:40.113278    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-serving-cert: secret "maas-api-e2e-mt-5d2c4024-serving-cert" not found
Jul 08 23:18:40.113392 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:18:40.113349    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1622df64-36f3-46bf-9f3f-ca9eebbbf722-maas-api-tls podName:1622df64-36f3-46bf-9f3f-ca9eebbbf722 nodeName:}" failed. No retries permitted until 2026-07-08 23:18:40.613326484 +0000 UTC m=+1895.637908485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1622df64-36f3-46bf-9f3f-ca9eebbbf722-maas-api-tls") pod "maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v" (UID: "1622df64-36f3-46bf-9f3f-ca9eebbbf722") : secret "maas-api-e2e-mt-5d2c4024-serving-cert" not found
Jul 08 23:18:40.113785 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:40.113766    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1622df64-36f3-46bf-9f3f-ca9eebbbf722-openshift-service-ca\") pod \"maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v\" (UID: \"1622df64-36f3-46bf-9f3f-ca9eebbbf722\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"
Jul 08 23:18:40.135100 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:40.135069    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n799b\" (UniqueName: \"kubernetes.io/projected/1622df64-36f3-46bf-9f3f-ca9eebbbf722-kube-api-access-n799b\") pod \"maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v\" (UID: \"1622df64-36f3-46bf-9f3f-ca9eebbbf722\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"
Jul 08 23:18:40.619049 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:40.619014    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1622df64-36f3-46bf-9f3f-ca9eebbbf722-maas-api-tls\") pod \"maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v\" (UID: \"1622df64-36f3-46bf-9f3f-ca9eebbbf722\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"
Jul 08 23:18:40.621505 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:40.621472    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1622df64-36f3-46bf-9f3f-ca9eebbbf722-maas-api-tls\") pod \"maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v\" (UID: \"1622df64-36f3-46bf-9f3f-ca9eebbbf722\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"
Jul 08 23:18:40.763133 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:40.763089    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"
Jul 08 23:18:40.910347 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:40.910322    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"]
Jul 08 23:18:40.912665 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:18:40.912628    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1622df64_36f3_46bf_9f3f_ca9eebbbf722.slice/crio-d990c5e44f0ab076224e37f9920cb7baf9e8c99c1b49b0a8b0e7fa9afa65a8b2 WatchSource:0}: Error finding container d990c5e44f0ab076224e37f9920cb7baf9e8c99c1b49b0a8b0e7fa9afa65a8b2: Status 404 returned error can't find the container with id d990c5e44f0ab076224e37f9920cb7baf9e8c99c1b49b0a8b0e7fa9afa65a8b2
Jul 08 23:18:41.891592 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:41.891553    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v" event={"ID":"1622df64-36f3-46bf-9f3f-ca9eebbbf722","Type":"ContainerStarted","Data":"cf615c55c1fff5ada7c97c55742db0a9e4839af8cfb85109f038174e3433e510"}
Jul 08 23:18:41.892111 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:41.891613    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v" event={"ID":"1622df64-36f3-46bf-9f3f-ca9eebbbf722","Type":"ContainerStarted","Data":"d990c5e44f0ab076224e37f9920cb7baf9e8c99c1b49b0a8b0e7fa9afa65a8b2"}
Jul 08 23:18:41.892111 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:41.891661    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"
Jul 08 23:18:41.910168 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:41.910118    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v" podStartSLOduration=2.511379584 podStartE2EDuration="2.910100552s" totalImagesPullingTime="398.720968ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:18:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:18:41.908834641 +0000 UTC m=+1896.933416658" watchObservedRunningTime="2026-07-08 23:18:41.910100552 +0000 UTC m=+1896.934682563"
Jul 08 23:18:47.903161 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:47.903126    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"
Jul 08 23:18:54.223094 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:54.223056    2574 patch_prober.go:28] interesting pod/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": read tcp 10.133.0.2:38038->10.133.0.65:15021: read: connection reset by peer" start-of-body=
Jul 08 23:18:54.223526 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:54.223145    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt" podUID="96d11667-fb65-4900-b626-e7b509bf47dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": read tcp 10.133.0.2:38038->10.133.0.65:15021: read: connection reset by peer"
Jul 08 23:18:54.973020 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:54.972987    2574 generic.go:356] "Generic (PLEG): container finished" podID="96d11667-fb65-4900-b626-e7b509bf47dd" containerID="7f54bc70476343c14dfc0ca39ba76e29141f85f929f4ec9dc19c85daa0740527" exitCode=0
Jul 08 23:18:54.973205 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:54.973064    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt" event={"ID":"96d11667-fb65-4900-b626-e7b509bf47dd","Type":"ContainerDied","Data":"7f54bc70476343c14dfc0ca39ba76e29141f85f929f4ec9dc19c85daa0740527"}
Jul 08 23:18:54.973547 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:54.973522    2574 scope.go:117] "RemoveContainer" containerID="7f54bc70476343c14dfc0ca39ba76e29141f85f929f4ec9dc19c85daa0740527"
Jul 08 23:18:54.974647 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:54.974618    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:18:54.974722 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:54.974702    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:18:54.974765 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:54.974738    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:18:55.980470 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:55.980437    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt" event={"ID":"96d11667-fb65-4900-b626-e7b509bf47dd","Type":"ContainerStarted","Data":"efd1513d557eb350fd6eb6d37f292f185619ce443874094859bd47442aba5ebd"}
Jul 08 23:18:56.699340 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:56.699299    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:18:56.699526 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:56.699493    2574 patch_prober.go:28] interesting pod/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 08 23:18:56.699577 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:56.699546    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt" podUID="96d11667-fb65-4900-b626-e7b509bf47dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 08 23:18:57.699654 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:57.699613    2574 patch_prober.go:28] interesting pod/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 08 23:18:57.700098 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:57.699678    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt" podUID="96d11667-fb65-4900-b626-e7b509bf47dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 08 23:18:58.700231 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:58.700189    2574 patch_prober.go:28] interesting pod/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 08 23:18:58.700644 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:58.700248    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt" podUID="96d11667-fb65-4900-b626-e7b509bf47dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 08 23:18:59.700274 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:59.700238    2574 patch_prober.go:28] interesting pod/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 08 23:18:59.700679 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:18:59.700297    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt" podUID="96d11667-fb65-4900-b626-e7b509bf47dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 08 23:19:00.703042 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:00.703010    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:19:00.703444 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:00.703282    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:19:00.703973 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:00.703953    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:19:27.211630 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:27.211588    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"]
Jul 08 23:19:27.212273 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:27.211881    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v" podUID="1622df64-36f3-46bf-9f3f-ca9eebbbf722" containerName="maas-api" containerID="cri-o://cf615c55c1fff5ada7c97c55742db0a9e4839af8cfb85109f038174e3433e510" gracePeriod=30
Jul 08 23:19:27.470313 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:27.470247    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"
Jul 08 23:19:27.574501 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:27.574469    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n799b\" (UniqueName: \"kubernetes.io/projected/1622df64-36f3-46bf-9f3f-ca9eebbbf722-kube-api-access-n799b\") pod \"1622df64-36f3-46bf-9f3f-ca9eebbbf722\" (UID: \"1622df64-36f3-46bf-9f3f-ca9eebbbf722\") "
Jul 08 23:19:27.574696 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:27.574529    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1622df64-36f3-46bf-9f3f-ca9eebbbf722-maas-api-tls\") pod \"1622df64-36f3-46bf-9f3f-ca9eebbbf722\" (UID: \"1622df64-36f3-46bf-9f3f-ca9eebbbf722\") "
Jul 08 23:19:27.574696 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:27.574633    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1622df64-36f3-46bf-9f3f-ca9eebbbf722-openshift-service-ca\") pod \"1622df64-36f3-46bf-9f3f-ca9eebbbf722\" (UID: \"1622df64-36f3-46bf-9f3f-ca9eebbbf722\") "
Jul 08 23:19:27.575007 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:27.574977    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1622df64-36f3-46bf-9f3f-ca9eebbbf722-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1622df64-36f3-46bf-9f3f-ca9eebbbf722" (UID: "1622df64-36f3-46bf-9f3f-ca9eebbbf722"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:19:27.576625 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:27.576594    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1622df64-36f3-46bf-9f3f-ca9eebbbf722-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1622df64-36f3-46bf-9f3f-ca9eebbbf722" (UID: "1622df64-36f3-46bf-9f3f-ca9eebbbf722"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:19:27.576738 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:27.576648    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1622df64-36f3-46bf-9f3f-ca9eebbbf722-kube-api-access-n799b" (OuterVolumeSpecName: "kube-api-access-n799b") pod "1622df64-36f3-46bf-9f3f-ca9eebbbf722" (UID: "1622df64-36f3-46bf-9f3f-ca9eebbbf722"). InnerVolumeSpecName "kube-api-access-n799b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:19:27.675290 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:27.675252    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1622df64-36f3-46bf-9f3f-ca9eebbbf722-openshift-service-ca\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:19:27.675290 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:27.675283    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n799b\" (UniqueName: \"kubernetes.io/projected/1622df64-36f3-46bf-9f3f-ca9eebbbf722-kube-api-access-n799b\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:19:27.675290 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:27.675294    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1622df64-36f3-46bf-9f3f-ca9eebbbf722-maas-api-tls\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:19:28.159647 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:28.159612    2574 generic.go:356] "Generic (PLEG): container finished" podID="1622df64-36f3-46bf-9f3f-ca9eebbbf722" containerID="cf615c55c1fff5ada7c97c55742db0a9e4839af8cfb85109f038174e3433e510" exitCode=0
Jul 08 23:19:28.159883 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:28.159654    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"
Jul 08 23:19:28.159883 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:28.159717    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v" event={"ID":"1622df64-36f3-46bf-9f3f-ca9eebbbf722","Type":"ContainerDied","Data":"cf615c55c1fff5ada7c97c55742db0a9e4839af8cfb85109f038174e3433e510"}
Jul 08 23:19:28.159883 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:28.159777    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v" event={"ID":"1622df64-36f3-46bf-9f3f-ca9eebbbf722","Type":"ContainerDied","Data":"d990c5e44f0ab076224e37f9920cb7baf9e8c99c1b49b0a8b0e7fa9afa65a8b2"}
Jul 08 23:19:28.159883 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:28.159818    2574 scope.go:117] "RemoveContainer" containerID="cf615c55c1fff5ada7c97c55742db0a9e4839af8cfb85109f038174e3433e510"
Jul 08 23:19:28.169450 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:28.169432    2574 scope.go:117] "RemoveContainer" containerID="cf615c55c1fff5ada7c97c55742db0a9e4839af8cfb85109f038174e3433e510"
Jul 08 23:19:28.169765 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:19:28.169743    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf615c55c1fff5ada7c97c55742db0a9e4839af8cfb85109f038174e3433e510\": container with ID starting with cf615c55c1fff5ada7c97c55742db0a9e4839af8cfb85109f038174e3433e510 not found: ID does not exist" containerID="cf615c55c1fff5ada7c97c55742db0a9e4839af8cfb85109f038174e3433e510"
Jul 08 23:19:28.169842 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:28.169774    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf615c55c1fff5ada7c97c55742db0a9e4839af8cfb85109f038174e3433e510"} err="failed to get container status \"cf615c55c1fff5ada7c97c55742db0a9e4839af8cfb85109f038174e3433e510\": rpc error: code = NotFound desc = could not find container \"cf615c55c1fff5ada7c97c55742db0a9e4839af8cfb85109f038174e3433e510\": container with ID starting with cf615c55c1fff5ada7c97c55742db0a9e4839af8cfb85109f038174e3433e510 not found: ID does not exist"
Jul 08 23:19:28.181554 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:28.181521    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"]
Jul 08 23:19:28.185558 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:28.185532    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d2c4024-5f5d899b46-9kv4v"]
Jul 08 23:19:29.502882 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:19:29.502852    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1622df64-36f3-46bf-9f3f-ca9eebbbf722" path="/var/lib/kubelet/pods/1622df64-36f3-46bf-9f3f-ca9eebbbf722/volumes"
Jul 08 23:20:26.247280 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:26.247240    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"]
Jul 08 23:20:26.466972 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:26.466924    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt" podUID="96d11667-fb65-4900-b626-e7b509bf47dd" containerName="istio-proxy" containerID="cri-o://efd1513d557eb350fd6eb6d37f292f185619ce443874094859bd47442aba5ebd" gracePeriod=30
Jul 08 23:20:30.705941 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:30.705900    2574 patch_prober.go:28] interesting pod/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 23:20:30.706348 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:30.705955    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt" podUID="96d11667-fb65-4900-b626-e7b509bf47dd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 23:20:31.728098 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.728031    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:20:31.779335 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.779299    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-istio-envoy\") pod \"96d11667-fb65-4900-b626-e7b509bf47dd\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") "
Jul 08 23:20:31.779554 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.779365    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96d11667-fb65-4900-b626-e7b509bf47dd-istiod-ca-cert\") pod \"96d11667-fb65-4900-b626-e7b509bf47dd\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") "
Jul 08 23:20:31.779554 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.779395    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96d11667-fb65-4900-b626-e7b509bf47dd-istio-podinfo\") pod \"96d11667-fb65-4900-b626-e7b509bf47dd\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") "
Jul 08 23:20:31.779554 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.779428    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc2vq\" (UniqueName: \"kubernetes.io/projected/96d11667-fb65-4900-b626-e7b509bf47dd-kube-api-access-tc2vq\") pod \"96d11667-fb65-4900-b626-e7b509bf47dd\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") "
Jul 08 23:20:31.779554 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.779479    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-workload-socket\") pod \"96d11667-fb65-4900-b626-e7b509bf47dd\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") "
Jul 08 23:20:31.779554 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.779512    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96d11667-fb65-4900-b626-e7b509bf47dd-istio-token\") pod \"96d11667-fb65-4900-b626-e7b509bf47dd\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") "
Jul 08 23:20:31.779554 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.779535    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-istio-data\") pod \"96d11667-fb65-4900-b626-e7b509bf47dd\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") "
Jul 08 23:20:31.779917 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.779576    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-workload-certs\") pod \"96d11667-fb65-4900-b626-e7b509bf47dd\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") "
Jul 08 23:20:31.779917 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.779602    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-credential-socket\") pod \"96d11667-fb65-4900-b626-e7b509bf47dd\" (UID: \"96d11667-fb65-4900-b626-e7b509bf47dd\") "
Jul 08 23:20:31.779917 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.779882    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96d11667-fb65-4900-b626-e7b509bf47dd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "96d11667-fb65-4900-b626-e7b509bf47dd" (UID: "96d11667-fb65-4900-b626-e7b509bf47dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:20:31.780084 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.780016    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96d11667-fb65-4900-b626-e7b509bf47dd-istiod-ca-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:20:31.780203 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.780077    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "96d11667-fb65-4900-b626-e7b509bf47dd" (UID: "96d11667-fb65-4900-b626-e7b509bf47dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:20:31.780203 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.780189    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "96d11667-fb65-4900-b626-e7b509bf47dd" (UID: "96d11667-fb65-4900-b626-e7b509bf47dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:20:31.780363 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.780338    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-istio-data" (OuterVolumeSpecName: "istio-data") pod "96d11667-fb65-4900-b626-e7b509bf47dd" (UID: "96d11667-fb65-4900-b626-e7b509bf47dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:20:31.780363 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.780353    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "96d11667-fb65-4900-b626-e7b509bf47dd" (UID: "96d11667-fb65-4900-b626-e7b509bf47dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:20:31.781833 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.781799    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "96d11667-fb65-4900-b626-e7b509bf47dd" (UID: "96d11667-fb65-4900-b626-e7b509bf47dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:20:31.782354 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.782327    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/96d11667-fb65-4900-b626-e7b509bf47dd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "96d11667-fb65-4900-b626-e7b509bf47dd" (UID: "96d11667-fb65-4900-b626-e7b509bf47dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:20:31.782613 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.782591    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96d11667-fb65-4900-b626-e7b509bf47dd-istio-token" (OuterVolumeSpecName: "istio-token") pod "96d11667-fb65-4900-b626-e7b509bf47dd" (UID: "96d11667-fb65-4900-b626-e7b509bf47dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:20:31.782992 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.782962    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96d11667-fb65-4900-b626-e7b509bf47dd-kube-api-access-tc2vq" (OuterVolumeSpecName: "kube-api-access-tc2vq") pod "96d11667-fb65-4900-b626-e7b509bf47dd" (UID: "96d11667-fb65-4900-b626-e7b509bf47dd"). InnerVolumeSpecName "kube-api-access-tc2vq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:20:31.881003 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.880955    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-istio-envoy\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:20:31.881003 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.880993    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96d11667-fb65-4900-b626-e7b509bf47dd-istio-podinfo\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:20:31.881003 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.881009    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc2vq\" (UniqueName: \"kubernetes.io/projected/96d11667-fb65-4900-b626-e7b509bf47dd-kube-api-access-tc2vq\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:20:31.881267 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.881022    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-workload-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:20:31.881267 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.881035    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96d11667-fb65-4900-b626-e7b509bf47dd-istio-token\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:20:31.881267 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.881048    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-istio-data\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:20:31.881267 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.881059    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-workload-certs\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:20:31.881267 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:31.881070    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d11667-fb65-4900-b626-e7b509bf47dd-credential-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:20:32.500907 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:32.500876    2574 generic.go:356] "Generic (PLEG): container finished" podID="96d11667-fb65-4900-b626-e7b509bf47dd" containerID="efd1513d557eb350fd6eb6d37f292f185619ce443874094859bd47442aba5ebd" exitCode=0
Jul 08 23:20:32.501115 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:32.500942    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"
Jul 08 23:20:32.501115 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:32.500964    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt" event={"ID":"96d11667-fb65-4900-b626-e7b509bf47dd","Type":"ContainerDied","Data":"efd1513d557eb350fd6eb6d37f292f185619ce443874094859bd47442aba5ebd"}
Jul 08 23:20:32.501115 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:32.501030    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt" event={"ID":"96d11667-fb65-4900-b626-e7b509bf47dd","Type":"ContainerDied","Data":"7f7b6c197b76ab0388b655542364b31ea13e0918a47b3a69076bb872eaf33ec2"}
Jul 08 23:20:32.501115 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:32.501061    2574 scope.go:117] "RemoveContainer" containerID="efd1513d557eb350fd6eb6d37f292f185619ce443874094859bd47442aba5ebd"
Jul 08 23:20:32.510109 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:32.510089    2574 scope.go:117] "RemoveContainer" containerID="7f54bc70476343c14dfc0ca39ba76e29141f85f929f4ec9dc19c85daa0740527"
Jul 08 23:20:32.520540 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:32.520522    2574 scope.go:117] "RemoveContainer" containerID="efd1513d557eb350fd6eb6d37f292f185619ce443874094859bd47442aba5ebd"
Jul 08 23:20:32.520885 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:20:32.520865    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efd1513d557eb350fd6eb6d37f292f185619ce443874094859bd47442aba5ebd\": container with ID starting with efd1513d557eb350fd6eb6d37f292f185619ce443874094859bd47442aba5ebd not found: ID does not exist" containerID="efd1513d557eb350fd6eb6d37f292f185619ce443874094859bd47442aba5ebd"
Jul 08 23:20:32.520959 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:32.520894    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efd1513d557eb350fd6eb6d37f292f185619ce443874094859bd47442aba5ebd"} err="failed to get container status \"efd1513d557eb350fd6eb6d37f292f185619ce443874094859bd47442aba5ebd\": rpc error: code = NotFound desc = could not find container \"efd1513d557eb350fd6eb6d37f292f185619ce443874094859bd47442aba5ebd\": container with ID starting with efd1513d557eb350fd6eb6d37f292f185619ce443874094859bd47442aba5ebd not found: ID does not exist"
Jul 08 23:20:32.520959 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:32.520913    2574 scope.go:117] "RemoveContainer" containerID="7f54bc70476343c14dfc0ca39ba76e29141f85f929f4ec9dc19c85daa0740527"
Jul 08 23:20:32.521185 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:20:32.521167    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f54bc70476343c14dfc0ca39ba76e29141f85f929f4ec9dc19c85daa0740527\": container with ID starting with 7f54bc70476343c14dfc0ca39ba76e29141f85f929f4ec9dc19c85daa0740527 not found: ID does not exist" containerID="7f54bc70476343c14dfc0ca39ba76e29141f85f929f4ec9dc19c85daa0740527"
Jul 08 23:20:32.521237 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:32.521189    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f54bc70476343c14dfc0ca39ba76e29141f85f929f4ec9dc19c85daa0740527"} err="failed to get container status \"7f54bc70476343c14dfc0ca39ba76e29141f85f929f4ec9dc19c85daa0740527\": rpc error: code = NotFound desc = could not find container \"7f54bc70476343c14dfc0ca39ba76e29141f85f929f4ec9dc19c85daa0740527\": container with ID starting with 7f54bc70476343c14dfc0ca39ba76e29141f85f929f4ec9dc19c85daa0740527 not found: ID does not exist"
Jul 08 23:20:32.527980 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:32.527955    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"]
Jul 08 23:20:32.533130 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:32.533106    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5d2c4024-openshift-default-66f8b9fdff-hrkwt"]
Jul 08 23:20:33.502628 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:20:33.502593    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96d11667-fb65-4900-b626-e7b509bf47dd" path="/var/lib/kubelet/pods/96d11667-fb65-4900-b626-e7b509bf47dd/volumes"
Jul 08 23:21:19.998590 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:19.998556    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"]
Jul 08 23:21:19.999361 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:19.999063    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1622df64-36f3-46bf-9f3f-ca9eebbbf722" containerName="maas-api"
Jul 08 23:21:19.999361 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:19.999078    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1622df64-36f3-46bf-9f3f-ca9eebbbf722" containerName="maas-api"
Jul 08 23:21:19.999361 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:19.999087    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d11667-fb65-4900-b626-e7b509bf47dd" containerName="istio-proxy"
Jul 08 23:21:19.999361 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:19.999092    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d11667-fb65-4900-b626-e7b509bf47dd" containerName="istio-proxy"
Jul 08 23:21:19.999361 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:19.999105    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d11667-fb65-4900-b626-e7b509bf47dd" containerName="istio-proxy"
Jul 08 23:21:19.999361 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:19.999112    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d11667-fb65-4900-b626-e7b509bf47dd" containerName="istio-proxy"
Jul 08 23:21:19.999361 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:19.999185    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="96d11667-fb65-4900-b626-e7b509bf47dd" containerName="istio-proxy"
Jul 08 23:21:19.999361 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:19.999193    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="96d11667-fb65-4900-b626-e7b509bf47dd" containerName="istio-proxy"
Jul 08 23:21:19.999361 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:19.999201    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1622df64-36f3-46bf-9f3f-ca9eebbbf722" containerName="maas-api"
Jul 08 23:21:20.002298 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.002281    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.005120 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.005092    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-0a82e7-openshift-default-dockercfg-pfp4j\""
Jul 08 23:21:20.012400 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.012372    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"]
Jul 08 23:21:20.124200 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.124162    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-envoy\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.124200 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.124210    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9329335a-ae20-4a2c-b940-2d8436f5f0de-istiod-ca-cert\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.124474 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.124272    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-podinfo\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.124474 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.124304    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-workload-certs\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.124474 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.124355    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-workload-socket\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.124589 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.124517    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-credential-socket\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.124589 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.124569    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ct8x\" (UniqueName: \"kubernetes.io/projected/9329335a-ae20-4a2c-b940-2d8436f5f0de-kube-api-access-6ct8x\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.124658 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.124604    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-token\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.124658 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.124647    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-data\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.225437 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.225394    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-credential-socket\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.225610 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.225445    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ct8x\" (UniqueName: \"kubernetes.io/projected/9329335a-ae20-4a2c-b940-2d8436f5f0de-kube-api-access-6ct8x\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.225610 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.225476    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-token\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.225610 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.225512    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-data\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.225610 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.225539    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-envoy\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.225610 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.225563    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9329335a-ae20-4a2c-b940-2d8436f5f0de-istiod-ca-cert\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.226215 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.226175    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-podinfo\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.226215 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.225881    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-credential-socket\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.226215 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.225973    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-data\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.226435 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.226327    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-workload-certs\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.226435 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.226373    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-workload-socket\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.226654 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.226618    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9329335a-ae20-4a2c-b940-2d8436f5f0de-istiod-ca-cert\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.226654 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.226643    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-workload-certs\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.226833 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.226756    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-workload-socket\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.228158 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.228132    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-envoy\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.228719 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.228675    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-podinfo\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.240134 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.240101    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-token\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.240306 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.240279    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ct8x\" (UniqueName: \"kubernetes.io/projected/9329335a-ae20-4a2c-b940-2d8436f5f0de-kube-api-access-6ct8x\") pod \"e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") " pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.314050 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.313959    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:20.466459 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.466425    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"]
Jul 08 23:21:20.467935 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:21:20.467911    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9329335a_ae20_4a2c_b940_2d8436f5f0de.slice/crio-baf2126df41e099fd426051d06ae456576ef5eb6a10a833fd969a334fba1406a WatchSource:0}: Error finding container baf2126df41e099fd426051d06ae456576ef5eb6a10a833fd969a334fba1406a: Status 404 returned error can't find the container with id baf2126df41e099fd426051d06ae456576ef5eb6a10a833fd969a334fba1406a
Jul 08 23:21:20.470633 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.470596    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:21:20.470725 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.470670    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:21:20.470774 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.470738    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:21:20.747345 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.747309    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk" event={"ID":"9329335a-ae20-4a2c-b940-2d8436f5f0de","Type":"ContainerStarted","Data":"5b9a003a7aadb9d4afbc233fdde3209d467f1fcd64150c2fa7c5b069ec413ff9"}
Jul 08 23:21:20.747518 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.747364    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk" event={"ID":"9329335a-ae20-4a2c-b940-2d8436f5f0de","Type":"ContainerStarted","Data":"baf2126df41e099fd426051d06ae456576ef5eb6a10a833fd969a334fba1406a"}
Jul 08 23:21:20.768151 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:20.768094    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk" podStartSLOduration=1.7680770099999998 podStartE2EDuration="1.76807701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:21:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:21:20.766081468 +0000 UTC m=+2055.790663477" watchObservedRunningTime="2026-07-08 23:21:20.76807701 +0000 UTC m=+2055.792659013"
Jul 08 23:21:21.314742 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:21.314679    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:21.320185 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:21.320157    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:21.752194 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:21.752160    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:21.753370 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:21.753336    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:27.725196 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.725098    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"]
Jul 08 23:21:27.729204 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.729169    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.732208 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.732178    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a78f59-openshift-default-dockercfg-gp4vk\""
Jul 08 23:21:27.740327 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.740298    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"]
Jul 08 23:21:27.803529 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.803484    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-workload-certs\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.803733 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.803552    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-podinfo\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.803733 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.803617    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncqcz\" (UniqueName: \"kubernetes.io/projected/ee4737a5-9b3d-48b7-b126-7188bcd596d9-kube-api-access-ncqcz\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.803733 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.803649    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-data\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.803733 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.803677    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-envoy\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.803733 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.803719    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istiod-ca-cert\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.803937 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.803764    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-credential-socket\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.803937 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.803802    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-workload-socket\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.803937 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.803819    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-token\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.904619 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.904577    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-podinfo\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.904619 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.904625    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncqcz\" (UniqueName: \"kubernetes.io/projected/ee4737a5-9b3d-48b7-b126-7188bcd596d9-kube-api-access-ncqcz\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.904922 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.904652    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-data\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.904922 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.904712    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-envoy\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.904922 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.904742    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istiod-ca-cert\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.904922 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.904767    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-credential-socket\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.904922 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.904808    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-workload-socket\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.904922 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.904828    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-token\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.904922 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.904904    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-workload-certs\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.905244 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.905140    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-data\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.905438 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.905414    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-workload-socket\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.905529 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.905475    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-credential-socket\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.905529 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.905486    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-workload-certs\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.905605 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.905524    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istiod-ca-cert\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.907013 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.906987    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-envoy\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.907355 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.907334    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-podinfo\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.912821 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.912797    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-token\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:27.913090 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:27.913070    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncqcz\" (UniqueName: \"kubernetes.io/projected/ee4737a5-9b3d-48b7-b126-7188bcd596d9-kube-api-access-ncqcz\") pod \"e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") " pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:28.042745 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:28.042623    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:28.204647 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:28.204520    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"]
Jul 08 23:21:28.207032 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:21:28.207002    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4737a5_9b3d_48b7_b126_7188bcd596d9.slice/crio-cf7225c32687bf553286e8a9388e5c5374982a7ac8252a65700fa3be9ab975f2 WatchSource:0}: Error finding container cf7225c32687bf553286e8a9388e5c5374982a7ac8252a65700fa3be9ab975f2: Status 404 returned error can't find the container with id cf7225c32687bf553286e8a9388e5c5374982a7ac8252a65700fa3be9ab975f2
Jul 08 23:21:28.209219 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:28.209187    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:21:28.209307 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:28.209261    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:21:28.209307 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:28.209289    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:21:28.792350 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:28.792313    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg" event={"ID":"ee4737a5-9b3d-48b7-b126-7188bcd596d9","Type":"ContainerStarted","Data":"ede1a8523d2d040a6792f5115bc03c4c11a8b1e7586bcfc68722d02cebfaff7e"}
Jul 08 23:21:28.792824 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:28.792371    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg" event={"ID":"ee4737a5-9b3d-48b7-b126-7188bcd596d9","Type":"ContainerStarted","Data":"cf7225c32687bf553286e8a9388e5c5374982a7ac8252a65700fa3be9ab975f2"}
Jul 08 23:21:28.815086 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:28.815026    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg" podStartSLOduration=1.8150100679999999 podStartE2EDuration="1.815010068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:21:28.811605251 +0000 UTC m=+2063.836187286" watchObservedRunningTime="2026-07-08 23:21:28.815010068 +0000 UTC m=+2063.839592072"
Jul 08 23:21:29.043754 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:29.043638    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:29.048887 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:29.048856    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:29.798076 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:29.798042    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:29.799247 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:29.799230    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:37.793952 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:37.793848    2574 patch_prober.go:28] interesting pod/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 23:21:37.794325 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:37.793941    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk" podUID="9329335a-ae20-4a2c-b940-2d8436f5f0de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 23:21:38.851167 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:38.851130    2574 generic.go:356] "Generic (PLEG): container finished" podID="9329335a-ae20-4a2c-b940-2d8436f5f0de" containerID="5b9a003a7aadb9d4afbc233fdde3209d467f1fcd64150c2fa7c5b069ec413ff9" exitCode=0
Jul 08 23:21:38.851594 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:38.851201    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk" event={"ID":"9329335a-ae20-4a2c-b940-2d8436f5f0de","Type":"ContainerDied","Data":"5b9a003a7aadb9d4afbc233fdde3209d467f1fcd64150c2fa7c5b069ec413ff9"}
Jul 08 23:21:38.851637 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:38.851625    2574 scope.go:117] "RemoveContainer" containerID="5b9a003a7aadb9d4afbc233fdde3209d467f1fcd64150c2fa7c5b069ec413ff9"
Jul 08 23:21:38.852762 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:38.852734    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:21:38.852823 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:38.852812    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:21:38.852872 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:38.852858    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:21:39.861422 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:39.861388    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk" event={"ID":"9329335a-ae20-4a2c-b940-2d8436f5f0de","Type":"ContainerStarted","Data":"427641323dc9bf2bf88b073040eec95f46df94731c309feb23d029849b17d225"}
Jul 08 23:21:40.315274 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:40.315202    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:40.315459 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:40.315300    2574 patch_prober.go:28] interesting pod/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 08 23:21:40.315459 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:40.315344    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk" podUID="9329335a-ae20-4a2c-b940-2d8436f5f0de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 08 23:21:41.314998 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:41.314960    2574 patch_prober.go:28] interesting pod/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 08 23:21:41.315405 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:41.315012    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk" podUID="9329335a-ae20-4a2c-b940-2d8436f5f0de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 08 23:21:42.315133 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:42.315098    2574 patch_prober.go:28] interesting pod/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 08 23:21:42.315547 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:42.315149    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk" podUID="9329335a-ae20-4a2c-b940-2d8436f5f0de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 08 23:21:43.314639 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:43.314607    2574 patch_prober.go:28] interesting pod/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 08 23:21:43.314836 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:43.314656    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk" podUID="9329335a-ae20-4a2c-b940-2d8436f5f0de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 08 23:21:44.317825 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:44.317792    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:44.318232 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:44.318083    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:44.318724 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:44.318682    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:21:45.840886 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:45.840841    2574 patch_prober.go:28] interesting pod/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 23:21:45.841277 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:45.840902    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg" podUID="ee4737a5-9b3d-48b7-b126-7188bcd596d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 23:21:46.909470 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:46.909383    2574 generic.go:356] "Generic (PLEG): container finished" podID="ee4737a5-9b3d-48b7-b126-7188bcd596d9" containerID="ede1a8523d2d040a6792f5115bc03c4c11a8b1e7586bcfc68722d02cebfaff7e" exitCode=0
Jul 08 23:21:46.910014 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:46.909459    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg" event={"ID":"ee4737a5-9b3d-48b7-b126-7188bcd596d9","Type":"ContainerDied","Data":"ede1a8523d2d040a6792f5115bc03c4c11a8b1e7586bcfc68722d02cebfaff7e"}
Jul 08 23:21:46.910014 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:46.910002    2574 scope.go:117] "RemoveContainer" containerID="ede1a8523d2d040a6792f5115bc03c4c11a8b1e7586bcfc68722d02cebfaff7e"
Jul 08 23:21:46.911065 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:46.911033    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:21:46.911161 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:46.911103    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:21:46.911161 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:46.911135    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:21:47.916886 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:47.916850    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg" event={"ID":"ee4737a5-9b3d-48b7-b126-7188bcd596d9","Type":"ContainerStarted","Data":"06679f0d3603b174ff4e9c405d83917cc7b53f1b74de8c32e31e3dc444be5faf"}
Jul 08 23:21:48.043603 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:48.043569    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:48.044021 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:48.043848    2574 patch_prober.go:28] interesting pod/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 08 23:21:48.044221 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:48.044195    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg" podUID="ee4737a5-9b3d-48b7-b126-7188bcd596d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 08 23:21:49.043337 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:49.043299    2574 patch_prober.go:28] interesting pod/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 08 23:21:49.043964 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:49.043931    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg" podUID="ee4737a5-9b3d-48b7-b126-7188bcd596d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 08 23:21:50.043633 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:50.043589    2574 patch_prober.go:28] interesting pod/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 08 23:21:50.044344 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:50.044306    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg" podUID="ee4737a5-9b3d-48b7-b126-7188bcd596d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 08 23:21:51.043730 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:51.043665    2574 patch_prober.go:28] interesting pod/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 08 23:21:51.044350 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:51.043754    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg" podUID="ee4737a5-9b3d-48b7-b126-7188bcd596d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 08 23:21:52.046444 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:52.046414    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:52.046860 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:52.046803    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:21:52.047480 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:21:52.047460    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:22:05.584519 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:22:05.584490    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 23:22:05.587275 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:22:05.587250    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 23:23:33.082946 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:33.082913    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"]
Jul 08 23:23:33.083475 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:33.083166    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk" podUID="9329335a-ae20-4a2c-b940-2d8436f5f0de" containerName="istio-proxy" containerID="cri-o://427641323dc9bf2bf88b073040eec95f46df94731c309feb23d029849b17d225" gracePeriod=30
Jul 08 23:23:38.342271 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.342210    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:23:38.403654 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.403624    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-workload-socket\") pod \"9329335a-ae20-4a2c-b940-2d8436f5f0de\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") "
Jul 08 23:23:38.403654 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.403661    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-envoy\") pod \"9329335a-ae20-4a2c-b940-2d8436f5f0de\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") "
Jul 08 23:23:38.403991 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.403680    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-data\") pod \"9329335a-ae20-4a2c-b940-2d8436f5f0de\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") "
Jul 08 23:23:38.403991 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.403732    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ct8x\" (UniqueName: \"kubernetes.io/projected/9329335a-ae20-4a2c-b940-2d8436f5f0de-kube-api-access-6ct8x\") pod \"9329335a-ae20-4a2c-b940-2d8436f5f0de\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") "
Jul 08 23:23:38.403991 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.403788    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-credential-socket\") pod \"9329335a-ae20-4a2c-b940-2d8436f5f0de\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") "
Jul 08 23:23:38.403991 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.403812    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-workload-certs\") pod \"9329335a-ae20-4a2c-b940-2d8436f5f0de\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") "
Jul 08 23:23:38.403991 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.403843    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9329335a-ae20-4a2c-b940-2d8436f5f0de-istiod-ca-cert\") pod \"9329335a-ae20-4a2c-b940-2d8436f5f0de\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") "
Jul 08 23:23:38.403991 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.403871    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-podinfo\") pod \"9329335a-ae20-4a2c-b940-2d8436f5f0de\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") "
Jul 08 23:23:38.403991 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.403908    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-token\") pod \"9329335a-ae20-4a2c-b940-2d8436f5f0de\" (UID: \"9329335a-ae20-4a2c-b940-2d8436f5f0de\") "
Jul 08 23:23:38.404379 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.403976    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9329335a-ae20-4a2c-b940-2d8436f5f0de" (UID: "9329335a-ae20-4a2c-b940-2d8436f5f0de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:23:38.404379 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.404082    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9329335a-ae20-4a2c-b940-2d8436f5f0de" (UID: "9329335a-ae20-4a2c-b940-2d8436f5f0de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:23:38.404379 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.404298    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-workload-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:38.404379 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.404320    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-credential-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:38.404379 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.404378    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9329335a-ae20-4a2c-b940-2d8436f5f0de-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9329335a-ae20-4a2c-b940-2d8436f5f0de" (UID: "9329335a-ae20-4a2c-b940-2d8436f5f0de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:23:38.404625 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.404229    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9329335a-ae20-4a2c-b940-2d8436f5f0de" (UID: "9329335a-ae20-4a2c-b940-2d8436f5f0de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:23:38.404792 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.404759    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-data" (OuterVolumeSpecName: "istio-data") pod "9329335a-ae20-4a2c-b940-2d8436f5f0de" (UID: "9329335a-ae20-4a2c-b940-2d8436f5f0de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:23:38.406141 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.406118    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9329335a-ae20-4a2c-b940-2d8436f5f0de" (UID: "9329335a-ae20-4a2c-b940-2d8436f5f0de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:23:38.406141 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.406129    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-token" (OuterVolumeSpecName: "istio-token") pod "9329335a-ae20-4a2c-b940-2d8436f5f0de" (UID: "9329335a-ae20-4a2c-b940-2d8436f5f0de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:23:38.406306 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.406285    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9329335a-ae20-4a2c-b940-2d8436f5f0de-kube-api-access-6ct8x" (OuterVolumeSpecName: "kube-api-access-6ct8x") pod "9329335a-ae20-4a2c-b940-2d8436f5f0de" (UID: "9329335a-ae20-4a2c-b940-2d8436f5f0de"). InnerVolumeSpecName "kube-api-access-6ct8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:23:38.406384 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.406360    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9329335a-ae20-4a2c-b940-2d8436f5f0de" (UID: "9329335a-ae20-4a2c-b940-2d8436f5f0de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:23:38.504871 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.504825    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-workload-certs\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:38.504871 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.504858    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9329335a-ae20-4a2c-b940-2d8436f5f0de-istiod-ca-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:38.504871 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.504867    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-podinfo\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:38.504871 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.504874    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-token\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:38.504871 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.504882    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-envoy\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:38.505207 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.504889    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9329335a-ae20-4a2c-b940-2d8436f5f0de-istio-data\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:38.505207 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.504897    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ct8x\" (UniqueName: \"kubernetes.io/projected/9329335a-ae20-4a2c-b940-2d8436f5f0de-kube-api-access-6ct8x\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:38.522560 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.522530    2574 generic.go:356] "Generic (PLEG): container finished" podID="9329335a-ae20-4a2c-b940-2d8436f5f0de" containerID="427641323dc9bf2bf88b073040eec95f46df94731c309feb23d029849b17d225" exitCode=0
Jul 08 23:23:38.522776 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.522579    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk" event={"ID":"9329335a-ae20-4a2c-b940-2d8436f5f0de","Type":"ContainerDied","Data":"427641323dc9bf2bf88b073040eec95f46df94731c309feb23d029849b17d225"}
Jul 08 23:23:38.522776 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.522599    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"
Jul 08 23:23:38.522776 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.522632    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk" event={"ID":"9329335a-ae20-4a2c-b940-2d8436f5f0de","Type":"ContainerDied","Data":"baf2126df41e099fd426051d06ae456576ef5eb6a10a833fd969a334fba1406a"}
Jul 08 23:23:38.522776 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.522663    2574 scope.go:117] "RemoveContainer" containerID="427641323dc9bf2bf88b073040eec95f46df94731c309feb23d029849b17d225"
Jul 08 23:23:38.535594 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.535558    2574 scope.go:117] "RemoveContainer" containerID="5b9a003a7aadb9d4afbc233fdde3209d467f1fcd64150c2fa7c5b069ec413ff9"
Jul 08 23:23:38.545628 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.545605    2574 scope.go:117] "RemoveContainer" containerID="427641323dc9bf2bf88b073040eec95f46df94731c309feb23d029849b17d225"
Jul 08 23:23:38.546066 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:23:38.546039    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"427641323dc9bf2bf88b073040eec95f46df94731c309feb23d029849b17d225\": container with ID starting with 427641323dc9bf2bf88b073040eec95f46df94731c309feb23d029849b17d225 not found: ID does not exist" containerID="427641323dc9bf2bf88b073040eec95f46df94731c309feb23d029849b17d225"
Jul 08 23:23:38.546168 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.546076    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427641323dc9bf2bf88b073040eec95f46df94731c309feb23d029849b17d225"} err="failed to get container status \"427641323dc9bf2bf88b073040eec95f46df94731c309feb23d029849b17d225\": rpc error: code = NotFound desc = could not find container \"427641323dc9bf2bf88b073040eec95f46df94731c309feb23d029849b17d225\": container with ID starting with 427641323dc9bf2bf88b073040eec95f46df94731c309feb23d029849b17d225 not found: ID does not exist"
Jul 08 23:23:38.546168 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.546105    2574 scope.go:117] "RemoveContainer" containerID="5b9a003a7aadb9d4afbc233fdde3209d467f1fcd64150c2fa7c5b069ec413ff9"
Jul 08 23:23:38.546431 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:23:38.546410    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b9a003a7aadb9d4afbc233fdde3209d467f1fcd64150c2fa7c5b069ec413ff9\": container with ID starting with 5b9a003a7aadb9d4afbc233fdde3209d467f1fcd64150c2fa7c5b069ec413ff9 not found: ID does not exist" containerID="5b9a003a7aadb9d4afbc233fdde3209d467f1fcd64150c2fa7c5b069ec413ff9"
Jul 08 23:23:38.546529 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.546434    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b9a003a7aadb9d4afbc233fdde3209d467f1fcd64150c2fa7c5b069ec413ff9"} err="failed to get container status \"5b9a003a7aadb9d4afbc233fdde3209d467f1fcd64150c2fa7c5b069ec413ff9\": rpc error: code = NotFound desc = could not find container \"5b9a003a7aadb9d4afbc233fdde3209d467f1fcd64150c2fa7c5b069ec413ff9\": container with ID starting with 5b9a003a7aadb9d4afbc233fdde3209d467f1fcd64150c2fa7c5b069ec413ff9 not found: ID does not exist"
Jul 08 23:23:38.548651 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.548630    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"]
Jul 08 23:23:38.552244 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:38.552219    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-0a82e7-openshift-default-5dd6cf9df9-57wmk"]
Jul 08 23:23:39.503091 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:39.503055    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9329335a-ae20-4a2c-b940-2d8436f5f0de" path="/var/lib/kubelet/pods/9329335a-ae20-4a2c-b940-2d8436f5f0de/volumes"
Jul 08 23:23:39.959944 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:39.959912    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"]
Jul 08 23:23:39.960166 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:39.960143    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg" podUID="ee4737a5-9b3d-48b7-b126-7188bcd596d9" containerName="istio-proxy" containerID="cri-o://06679f0d3603b174ff4e9c405d83917cc7b53f1b74de8c32e31e3dc444be5faf" gracePeriod=30
Jul 08 23:23:40.823497 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.823460    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"]
Jul 08 23:23:40.824102 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.824074    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9329335a-ae20-4a2c-b940-2d8436f5f0de" containerName="istio-proxy"
Jul 08 23:23:40.824102 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.824099    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9329335a-ae20-4a2c-b940-2d8436f5f0de" containerName="istio-proxy"
Jul 08 23:23:40.824262 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.824118    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9329335a-ae20-4a2c-b940-2d8436f5f0de" containerName="istio-proxy"
Jul 08 23:23:40.824262 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.824126    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9329335a-ae20-4a2c-b940-2d8436f5f0de" containerName="istio-proxy"
Jul 08 23:23:40.824262 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.824228    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9329335a-ae20-4a2c-b940-2d8436f5f0de" containerName="istio-proxy"
Jul 08 23:23:40.824262 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.824240    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9329335a-ae20-4a2c-b940-2d8436f5f0de" containerName="istio-proxy"
Jul 08 23:23:40.827429 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.827409    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:40.830146 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.830128    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a50ce6-openshift-default-dockercfg-w4nzg\""
Jul 08 23:23:40.838823 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.838799    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"]
Jul 08 23:23:40.928497 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.928460    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7838e881-32ab-46e7-8687-362a3b18cc02-istio-token\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:40.928709 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.928597    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-workload-socket\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:40.928709 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.928642    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-istio-data\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:40.928844 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.928716    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-credential-socket\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:40.928844 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.928740    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcq65\" (UniqueName: \"kubernetes.io/projected/7838e881-32ab-46e7-8687-362a3b18cc02-kube-api-access-wcq65\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:40.928844 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.928771    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7838e881-32ab-46e7-8687-362a3b18cc02-istio-podinfo\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:40.928844 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.928807    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-istio-envoy\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:40.929047 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.928871    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7838e881-32ab-46e7-8687-362a3b18cc02-istiod-ca-cert\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:40.929047 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:40.928929    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-workload-certs\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.030083 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.030043    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-workload-certs\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.030282 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.030101    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7838e881-32ab-46e7-8687-362a3b18cc02-istio-token\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.030282 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.030125    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-workload-socket\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.030282 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.030146    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-istio-data\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.030282 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.030198    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-credential-socket\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.030282 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.030220    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcq65\" (UniqueName: \"kubernetes.io/projected/7838e881-32ab-46e7-8687-362a3b18cc02-kube-api-access-wcq65\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.030282 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.030246    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7838e881-32ab-46e7-8687-362a3b18cc02-istio-podinfo\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.030282 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.030276    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-istio-envoy\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.030676 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.030323    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7838e881-32ab-46e7-8687-362a3b18cc02-istiod-ca-cert\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.030676 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.030517    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-workload-certs\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.030676 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.030587    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-istio-data\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.030871 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.030808    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-workload-socket\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.030871 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.030839    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-credential-socket\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.031069 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.031046    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7838e881-32ab-46e7-8687-362a3b18cc02-istiod-ca-cert\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.032952 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.032927    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-istio-envoy\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.033427 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.033403    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7838e881-32ab-46e7-8687-362a3b18cc02-istio-podinfo\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.038661 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.038632    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7838e881-32ab-46e7-8687-362a3b18cc02-istio-token\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.039103 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.039080    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcq65\" (UniqueName: \"kubernetes.io/projected/7838e881-32ab-46e7-8687-362a3b18cc02-kube-api-access-wcq65\") pod \"e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") " pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.138819 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.138777    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:41.287550 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.287391    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"]
Jul 08 23:23:41.290115 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:23:41.290086    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7838e881_32ab_46e7_8687_362a3b18cc02.slice/crio-79df8f5f4a4356fec4648e3df92bfd44a7027567d390cddecf1bf887f7d11e8d WatchSource:0}: Error finding container 79df8f5f4a4356fec4648e3df92bfd44a7027567d390cddecf1bf887f7d11e8d: Status 404 returned error can't find the container with id 79df8f5f4a4356fec4648e3df92bfd44a7027567d390cddecf1bf887f7d11e8d
Jul 08 23:23:41.292771 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.292732    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:23:41.292873 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.292817    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:23:41.292873 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.292860    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:23:41.545797 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.545677    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n" event={"ID":"7838e881-32ab-46e7-8687-362a3b18cc02","Type":"ContainerStarted","Data":"f7a38af1b5d312ee32fddd40fd9f46b9c3e7048d79cbd69580e76049c15dff80"}
Jul 08 23:23:41.545797 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.545751    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n" event={"ID":"7838e881-32ab-46e7-8687-362a3b18cc02","Type":"ContainerStarted","Data":"79df8f5f4a4356fec4648e3df92bfd44a7027567d390cddecf1bf887f7d11e8d"}
Jul 08 23:23:41.566057 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:41.565997    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n" podStartSLOduration=1.565973216 podStartE2EDuration="1.565973216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:23:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:23:41.563520189 +0000 UTC m=+2196.588102195" watchObservedRunningTime="2026-07-08 23:23:41.565973216 +0000 UTC m=+2196.590555218"
Jul 08 23:23:42.139133 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:42.139097    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:42.144358 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:42.144331    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:42.551606 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:42.551525    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:42.552487 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:42.552470    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:23:45.213970 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.213940    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:23:45.274046 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.273946    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istiod-ca-cert\") pod \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") "
Jul 08 23:23:45.274046 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.273997    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-workload-socket\") pod \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") "
Jul 08 23:23:45.274046 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.274027    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncqcz\" (UniqueName: \"kubernetes.io/projected/ee4737a5-9b3d-48b7-b126-7188bcd596d9-kube-api-access-ncqcz\") pod \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") "
Jul 08 23:23:45.274046 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.274044    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-envoy\") pod \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") "
Jul 08 23:23:45.274367 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.274069    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-podinfo\") pod \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") "
Jul 08 23:23:45.274367 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.274159    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-data\") pod \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") "
Jul 08 23:23:45.274367 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.274184    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-workload-certs\") pod \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") "
Jul 08 23:23:45.274367 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.274313    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-token\") pod \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") "
Jul 08 23:23:45.274586 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.274364    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee4737a5-9b3d-48b7-b126-7188bcd596d9" (UID: "ee4737a5-9b3d-48b7-b126-7188bcd596d9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:23:45.274586 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.274379    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-credential-socket\") pod \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\" (UID: \"ee4737a5-9b3d-48b7-b126-7188bcd596d9\") "
Jul 08 23:23:45.274586 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.274426    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee4737a5-9b3d-48b7-b126-7188bcd596d9" (UID: "ee4737a5-9b3d-48b7-b126-7188bcd596d9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:23:45.274586 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.274546    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee4737a5-9b3d-48b7-b126-7188bcd596d9" (UID: "ee4737a5-9b3d-48b7-b126-7188bcd596d9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:23:45.274835 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.274791    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-credential-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:45.274835 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.274814    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istiod-ca-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:45.274835 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.274829    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-workload-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:45.275005 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.274953    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee4737a5-9b3d-48b7-b126-7188bcd596d9" (UID: "ee4737a5-9b3d-48b7-b126-7188bcd596d9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:23:45.275185 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.275153    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee4737a5-9b3d-48b7-b126-7188bcd596d9" (UID: "ee4737a5-9b3d-48b7-b126-7188bcd596d9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:23:45.276490 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.276464    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee4737a5-9b3d-48b7-b126-7188bcd596d9" (UID: "ee4737a5-9b3d-48b7-b126-7188bcd596d9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:23:45.276490 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.276479    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee4737a5-9b3d-48b7-b126-7188bcd596d9-kube-api-access-ncqcz" (OuterVolumeSpecName: "kube-api-access-ncqcz") pod "ee4737a5-9b3d-48b7-b126-7188bcd596d9" (UID: "ee4737a5-9b3d-48b7-b126-7188bcd596d9"). InnerVolumeSpecName "kube-api-access-ncqcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:23:45.276670 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.276647    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee4737a5-9b3d-48b7-b126-7188bcd596d9" (UID: "ee4737a5-9b3d-48b7-b126-7188bcd596d9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:23:45.276791 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.276777    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee4737a5-9b3d-48b7-b126-7188bcd596d9" (UID: "ee4737a5-9b3d-48b7-b126-7188bcd596d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:23:45.375333 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.375288    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncqcz\" (UniqueName: \"kubernetes.io/projected/ee4737a5-9b3d-48b7-b126-7188bcd596d9-kube-api-access-ncqcz\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:45.375333 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.375325    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-envoy\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:45.375333 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.375333    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-podinfo\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:45.375333 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.375341    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-data\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:45.375333 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.375348    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee4737a5-9b3d-48b7-b126-7188bcd596d9-workload-certs\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:45.375633 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.375356    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee4737a5-9b3d-48b7-b126-7188bcd596d9-istio-token\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:23:45.569520 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.569433    2574 generic.go:356] "Generic (PLEG): container finished" podID="ee4737a5-9b3d-48b7-b126-7188bcd596d9" containerID="06679f0d3603b174ff4e9c405d83917cc7b53f1b74de8c32e31e3dc444be5faf" exitCode=0
Jul 08 23:23:45.569520 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.569480    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"
Jul 08 23:23:45.569520 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.569511    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg" event={"ID":"ee4737a5-9b3d-48b7-b126-7188bcd596d9","Type":"ContainerDied","Data":"06679f0d3603b174ff4e9c405d83917cc7b53f1b74de8c32e31e3dc444be5faf"}
Jul 08 23:23:45.569785 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.569565    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg" event={"ID":"ee4737a5-9b3d-48b7-b126-7188bcd596d9","Type":"ContainerDied","Data":"cf7225c32687bf553286e8a9388e5c5374982a7ac8252a65700fa3be9ab975f2"}
Jul 08 23:23:45.569785 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.569587    2574 scope.go:117] "RemoveContainer" containerID="06679f0d3603b174ff4e9c405d83917cc7b53f1b74de8c32e31e3dc444be5faf"
Jul 08 23:23:45.579129 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.579108    2574 scope.go:117] "RemoveContainer" containerID="ede1a8523d2d040a6792f5115bc03c4c11a8b1e7586bcfc68722d02cebfaff7e"
Jul 08 23:23:45.587738 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.587719    2574 scope.go:117] "RemoveContainer" containerID="06679f0d3603b174ff4e9c405d83917cc7b53f1b74de8c32e31e3dc444be5faf"
Jul 08 23:23:45.588000 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:23:45.587982    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06679f0d3603b174ff4e9c405d83917cc7b53f1b74de8c32e31e3dc444be5faf\": container with ID starting with 06679f0d3603b174ff4e9c405d83917cc7b53f1b74de8c32e31e3dc444be5faf not found: ID does not exist" containerID="06679f0d3603b174ff4e9c405d83917cc7b53f1b74de8c32e31e3dc444be5faf"
Jul 08 23:23:45.588077 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.588009    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06679f0d3603b174ff4e9c405d83917cc7b53f1b74de8c32e31e3dc444be5faf"} err="failed to get container status \"06679f0d3603b174ff4e9c405d83917cc7b53f1b74de8c32e31e3dc444be5faf\": rpc error: code = NotFound desc = could not find container \"06679f0d3603b174ff4e9c405d83917cc7b53f1b74de8c32e31e3dc444be5faf\": container with ID starting with 06679f0d3603b174ff4e9c405d83917cc7b53f1b74de8c32e31e3dc444be5faf not found: ID does not exist"
Jul 08 23:23:45.588077 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.588032    2574 scope.go:117] "RemoveContainer" containerID="ede1a8523d2d040a6792f5115bc03c4c11a8b1e7586bcfc68722d02cebfaff7e"
Jul 08 23:23:45.588304 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:23:45.588286    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ede1a8523d2d040a6792f5115bc03c4c11a8b1e7586bcfc68722d02cebfaff7e\": container with ID starting with ede1a8523d2d040a6792f5115bc03c4c11a8b1e7586bcfc68722d02cebfaff7e not found: ID does not exist" containerID="ede1a8523d2d040a6792f5115bc03c4c11a8b1e7586bcfc68722d02cebfaff7e"
Jul 08 23:23:45.588361 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.588314    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ede1a8523d2d040a6792f5115bc03c4c11a8b1e7586bcfc68722d02cebfaff7e"} err="failed to get container status \"ede1a8523d2d040a6792f5115bc03c4c11a8b1e7586bcfc68722d02cebfaff7e\": rpc error: code = NotFound desc = could not find container \"ede1a8523d2d040a6792f5115bc03c4c11a8b1e7586bcfc68722d02cebfaff7e\": container with ID starting with ede1a8523d2d040a6792f5115bc03c4c11a8b1e7586bcfc68722d02cebfaff7e not found: ID does not exist"
Jul 08 23:23:45.592010 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.591978    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"]
Jul 08 23:23:45.598565 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:45.598535    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a78f59-openshift-default-79d7cbd879-4vglg"]
Jul 08 23:23:47.502101 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:47.502070    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee4737a5-9b3d-48b7-b126-7188bcd596d9" path="/var/lib/kubelet/pods/ee4737a5-9b3d-48b7-b126-7188bcd596d9/volumes"
Jul 08 23:23:48.634594 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.634557    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"]
Jul 08 23:23:48.635130 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.635114    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee4737a5-9b3d-48b7-b126-7188bcd596d9" containerName="istio-proxy"
Jul 08 23:23:48.635176 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.635134    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4737a5-9b3d-48b7-b126-7188bcd596d9" containerName="istio-proxy"
Jul 08 23:23:48.635262 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.635251    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee4737a5-9b3d-48b7-b126-7188bcd596d9" containerName="istio-proxy"
Jul 08 23:23:48.635302 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.635266    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee4737a5-9b3d-48b7-b126-7188bcd596d9" containerName="istio-proxy"
Jul 08 23:23:48.641347 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.641321    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.643988 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.643967    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-52eefd-openshift-default-dockercfg-rp8dp\""
Jul 08 23:23:48.650996 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.650971    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"]
Jul 08 23:23:48.707030 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.706987    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-podinfo\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.707202 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.707052    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-token\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.707202 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.707115    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-credential-socket\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.707202 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.707186    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-data\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.707312 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.707216    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-envoy\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.707312 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.707241    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-workload-socket\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.707312 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.707273    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-workload-certs\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.707410 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.707314    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9l66\" (UniqueName: \"kubernetes.io/projected/8fe52774-abad-4f97-b9ba-b40cb1a3b324-kube-api-access-z9l66\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.707410 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.707365    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istiod-ca-cert\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.808166 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.808128    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istiod-ca-cert\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.808372 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.808185    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-podinfo\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.808372 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.808244    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-token\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.808372 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.808305    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-credential-socket\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.808372 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.808358    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-data\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.808635 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.808382    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-envoy\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.808635 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.808449    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-workload-socket\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.808635 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.808488    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-workload-certs\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.808635 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.808515    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9l66\" (UniqueName: \"kubernetes.io/projected/8fe52774-abad-4f97-b9ba-b40cb1a3b324-kube-api-access-z9l66\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.808895 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.808795    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-credential-socket\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.809100 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.809049    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-data\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.809100 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.809082    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-workload-socket\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.809239 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.809098    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-workload-certs\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.809239 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.809103    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istiod-ca-cert\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.816246 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.816210    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-podinfo\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.817577 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.817178    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9l66\" (UniqueName: \"kubernetes.io/projected/8fe52774-abad-4f97-b9ba-b40cb1a3b324-kube-api-access-z9l66\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.817577 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.817396    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-token\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.817970 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.817848    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-envoy\") pod \"e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") " pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:48.952735 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:48.952606    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:49.096370 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:49.096338    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"]
Jul 08 23:23:49.098512 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:23:49.098482    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe52774_abad_4f97_b9ba_b40cb1a3b324.slice/crio-61455711fff20d5514eb3f9e1d2dc000fbfaad484d3a123b0a88eaf96dbfdddb WatchSource:0}: Error finding container 61455711fff20d5514eb3f9e1d2dc000fbfaad484d3a123b0a88eaf96dbfdddb: Status 404 returned error can't find the container with id 61455711fff20d5514eb3f9e1d2dc000fbfaad484d3a123b0a88eaf96dbfdddb
Jul 08 23:23:49.100595 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:49.100555    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:23:49.100682 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:49.100632    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:23:49.100682 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:49.100659    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:23:49.593731 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:49.593680    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8" event={"ID":"8fe52774-abad-4f97-b9ba-b40cb1a3b324","Type":"ContainerStarted","Data":"9a16744ed02438945a02345b04c45b3fb3df3c77204c5fa5f3340e1d31f331a5"}
Jul 08 23:23:49.593928 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:49.593759    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8" event={"ID":"8fe52774-abad-4f97-b9ba-b40cb1a3b324","Type":"ContainerStarted","Data":"61455711fff20d5514eb3f9e1d2dc000fbfaad484d3a123b0a88eaf96dbfdddb"}
Jul 08 23:23:49.614164 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:49.614106    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8" podStartSLOduration=1.614090416 podStartE2EDuration="1.614090416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:23:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:23:49.610947303 +0000 UTC m=+2204.635529308" watchObservedRunningTime="2026-07-08 23:23:49.614090416 +0000 UTC m=+2204.638672420"
Jul 08 23:23:49.952786 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:49.952746    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:50.958271 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:50.958241    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:51.604905 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:51.604872    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:51.605973 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:51.605947    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:23:58.593862 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:58.593824    2574 patch_prober.go:28] interesting pod/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 23:23:58.594307 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:58.593897    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n" podUID="7838e881-32ab-46e7-8687-362a3b18cc02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 23:23:59.654609 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:59.654577    2574 generic.go:356] "Generic (PLEG): container finished" podID="7838e881-32ab-46e7-8687-362a3b18cc02" containerID="f7a38af1b5d312ee32fddd40fd9f46b9c3e7048d79cbd69580e76049c15dff80" exitCode=0
Jul 08 23:23:59.655147 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:59.654648    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n" event={"ID":"7838e881-32ab-46e7-8687-362a3b18cc02","Type":"ContainerDied","Data":"f7a38af1b5d312ee32fddd40fd9f46b9c3e7048d79cbd69580e76049c15dff80"}
Jul 08 23:23:59.655243 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:59.655225    2574 scope.go:117] "RemoveContainer" containerID="f7a38af1b5d312ee32fddd40fd9f46b9c3e7048d79cbd69580e76049c15dff80"
Jul 08 23:23:59.656283 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:59.656254    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:23:59.656389 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:59.656324    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:23:59.656389 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:23:59.656356    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:24:00.665809 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:00.665768    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n" event={"ID":"7838e881-32ab-46e7-8687-362a3b18cc02","Type":"ContainerStarted","Data":"579bb7bf6896947ee1b31084fee7d0aa38b930bcafd18d6ace0a4308e522f4cd"}
Jul 08 23:24:01.139807 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:01.139766    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:24:01.140068 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:01.140044    2574 patch_prober.go:28] interesting pod/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 08 23:24:01.140155 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:01.140108    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n" podUID="7838e881-32ab-46e7-8687-362a3b18cc02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 08 23:24:02.139487 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:02.139440    2574 patch_prober.go:28] interesting pod/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 08 23:24:02.140181 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:02.140144    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n" podUID="7838e881-32ab-46e7-8687-362a3b18cc02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 08 23:24:03.139322 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:03.139280    2574 patch_prober.go:28] interesting pod/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 08 23:24:03.139586 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:03.139373    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n" podUID="7838e881-32ab-46e7-8687-362a3b18cc02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 08 23:24:04.139625 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:04.139577    2574 patch_prober.go:28] interesting pod/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 08 23:24:04.140178 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:04.139655    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n" podUID="7838e881-32ab-46e7-8687-362a3b18cc02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 08 23:24:05.152109 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:05.152062    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:24:05.153130 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:05.153101    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:24:05.153998 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:05.153976    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:24:07.646840 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:07.646791    2574 patch_prober.go:28] interesting pod/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 23:24:07.647253 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:07.646872    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8" podUID="8fe52774-abad-4f97-b9ba-b40cb1a3b324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 23:24:09.718254 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:09.718218    2574 generic.go:356] "Generic (PLEG): container finished" podID="8fe52774-abad-4f97-b9ba-b40cb1a3b324" containerID="9a16744ed02438945a02345b04c45b3fb3df3c77204c5fa5f3340e1d31f331a5" exitCode=0
Jul 08 23:24:09.718771 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:09.718293    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8" event={"ID":"8fe52774-abad-4f97-b9ba-b40cb1a3b324","Type":"ContainerDied","Data":"9a16744ed02438945a02345b04c45b3fb3df3c77204c5fa5f3340e1d31f331a5"}
Jul 08 23:24:09.718771 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:09.718724    2574 scope.go:117] "RemoveContainer" containerID="9a16744ed02438945a02345b04c45b3fb3df3c77204c5fa5f3340e1d31f331a5"
Jul 08 23:24:09.719819 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:09.719789    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:24:09.719895 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:09.719878    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:24:09.719933 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:09.719919    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:24:10.195489 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:10.195454    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"]
Jul 08 23:24:10.195725 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:10.195680    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n" podUID="7838e881-32ab-46e7-8687-362a3b18cc02" containerName="istio-proxy" containerID="cri-o://579bb7bf6896947ee1b31084fee7d0aa38b930bcafd18d6ace0a4308e522f4cd" gracePeriod=30
Jul 08 23:24:10.756331 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:10.756286    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8" event={"ID":"8fe52774-abad-4f97-b9ba-b40cb1a3b324","Type":"ContainerStarted","Data":"315f8511306b8f740ba64ba036a7c000a584cd934c6fd1c92de24ac2d103b4fa"}
Jul 08 23:24:10.953076 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:10.953034    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:24:10.953265 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:10.953165    2574 patch_prober.go:28] interesting pod/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 08 23:24:10.953265 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:10.953244    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8" podUID="8fe52774-abad-4f97-b9ba-b40cb1a3b324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 08 23:24:11.953479 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:11.953433    2574 patch_prober.go:28] interesting pod/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 08 23:24:11.954038 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:11.953504    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8" podUID="8fe52774-abad-4f97-b9ba-b40cb1a3b324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 08 23:24:12.953866 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:12.953834    2574 patch_prober.go:28] interesting pod/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 08 23:24:12.954372 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:12.954348    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8" podUID="8fe52774-abad-4f97-b9ba-b40cb1a3b324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 08 23:24:13.953421 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:13.953375    2574 patch_prober.go:28] interesting pod/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 08 23:24:13.953645 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:13.953438    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8" podUID="8fe52774-abad-4f97-b9ba-b40cb1a3b324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 08 23:24:14.957056 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:14.957025    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:24:14.957509 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:14.957484    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:24:14.958284 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:14.958265    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:24:15.479879 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.479854    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:24:15.500877 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.500068    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-workload-certs\") pod \"7838e881-32ab-46e7-8687-362a3b18cc02\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") "
Jul 08 23:24:15.500877 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.500124    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-istio-data\") pod \"7838e881-32ab-46e7-8687-362a3b18cc02\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") "
Jul 08 23:24:15.500877 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.500170    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-istio-envoy\") pod \"7838e881-32ab-46e7-8687-362a3b18cc02\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") "
Jul 08 23:24:15.500877 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.500218    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcq65\" (UniqueName: \"kubernetes.io/projected/7838e881-32ab-46e7-8687-362a3b18cc02-kube-api-access-wcq65\") pod \"7838e881-32ab-46e7-8687-362a3b18cc02\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") "
Jul 08 23:24:15.500877 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.500243    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7838e881-32ab-46e7-8687-362a3b18cc02-istio-podinfo\") pod \"7838e881-32ab-46e7-8687-362a3b18cc02\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") "
Jul 08 23:24:15.500877 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.500282    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7838e881-32ab-46e7-8687-362a3b18cc02-istio-token\") pod \"7838e881-32ab-46e7-8687-362a3b18cc02\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") "
Jul 08 23:24:15.500877 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.500317    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7838e881-32ab-46e7-8687-362a3b18cc02-istiod-ca-cert\") pod \"7838e881-32ab-46e7-8687-362a3b18cc02\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") "
Jul 08 23:24:15.500877 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.500387    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-workload-socket\") pod \"7838e881-32ab-46e7-8687-362a3b18cc02\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") "
Jul 08 23:24:15.500877 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.500449    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-credential-socket\") pod \"7838e881-32ab-46e7-8687-362a3b18cc02\" (UID: \"7838e881-32ab-46e7-8687-362a3b18cc02\") "
Jul 08 23:24:15.501495 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.501021    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7838e881-32ab-46e7-8687-362a3b18cc02" (UID: "7838e881-32ab-46e7-8687-362a3b18cc02"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:24:15.501495 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.501205    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7838e881-32ab-46e7-8687-362a3b18cc02" (UID: "7838e881-32ab-46e7-8687-362a3b18cc02"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:24:15.501495 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.501337    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7838e881-32ab-46e7-8687-362a3b18cc02-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7838e881-32ab-46e7-8687-362a3b18cc02" (UID: "7838e881-32ab-46e7-8687-362a3b18cc02"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:24:15.501667 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.501573    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7838e881-32ab-46e7-8687-362a3b18cc02" (UID: "7838e881-32ab-46e7-8687-362a3b18cc02"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:24:15.502358 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.502333    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-istio-data" (OuterVolumeSpecName: "istio-data") pod "7838e881-32ab-46e7-8687-362a3b18cc02" (UID: "7838e881-32ab-46e7-8687-362a3b18cc02"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:24:15.503843 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.503803    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7838e881-32ab-46e7-8687-362a3b18cc02-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7838e881-32ab-46e7-8687-362a3b18cc02" (UID: "7838e881-32ab-46e7-8687-362a3b18cc02"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:24:15.503843 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.503816    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7838e881-32ab-46e7-8687-362a3b18cc02" (UID: "7838e881-32ab-46e7-8687-362a3b18cc02"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:24:15.505744 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.504658    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7838e881-32ab-46e7-8687-362a3b18cc02-istio-token" (OuterVolumeSpecName: "istio-token") pod "7838e881-32ab-46e7-8687-362a3b18cc02" (UID: "7838e881-32ab-46e7-8687-362a3b18cc02"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:24:15.505744 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.504961    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7838e881-32ab-46e7-8687-362a3b18cc02-kube-api-access-wcq65" (OuterVolumeSpecName: "kube-api-access-wcq65") pod "7838e881-32ab-46e7-8687-362a3b18cc02" (UID: "7838e881-32ab-46e7-8687-362a3b18cc02"). InnerVolumeSpecName "kube-api-access-wcq65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:24:15.601758 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.601716    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-workload-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:15.601758 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.601757    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-credential-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:15.601758 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.601768    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-workload-certs\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:15.602011 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.601777    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-istio-data\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:15.602011 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.601784    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7838e881-32ab-46e7-8687-362a3b18cc02-istio-envoy\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:15.602011 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.601792    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcq65\" (UniqueName: \"kubernetes.io/projected/7838e881-32ab-46e7-8687-362a3b18cc02-kube-api-access-wcq65\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:15.602011 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.601801    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7838e881-32ab-46e7-8687-362a3b18cc02-istio-podinfo\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:15.602011 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.601808    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7838e881-32ab-46e7-8687-362a3b18cc02-istio-token\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:15.602011 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.601816    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7838e881-32ab-46e7-8687-362a3b18cc02-istiod-ca-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:15.785451 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.785354    2574 generic.go:356] "Generic (PLEG): container finished" podID="7838e881-32ab-46e7-8687-362a3b18cc02" containerID="579bb7bf6896947ee1b31084fee7d0aa38b930bcafd18d6ace0a4308e522f4cd" exitCode=0
Jul 08 23:24:15.785451 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.785417    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"
Jul 08 23:24:15.785662 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.785438    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n" event={"ID":"7838e881-32ab-46e7-8687-362a3b18cc02","Type":"ContainerDied","Data":"579bb7bf6896947ee1b31084fee7d0aa38b930bcafd18d6ace0a4308e522f4cd"}
Jul 08 23:24:15.785662 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.785493    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n" event={"ID":"7838e881-32ab-46e7-8687-362a3b18cc02","Type":"ContainerDied","Data":"79df8f5f4a4356fec4648e3df92bfd44a7027567d390cddecf1bf887f7d11e8d"}
Jul 08 23:24:15.785662 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.785514    2574 scope.go:117] "RemoveContainer" containerID="579bb7bf6896947ee1b31084fee7d0aa38b930bcafd18d6ace0a4308e522f4cd"
Jul 08 23:24:15.794825 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.794808    2574 scope.go:117] "RemoveContainer" containerID="f7a38af1b5d312ee32fddd40fd9f46b9c3e7048d79cbd69580e76049c15dff80"
Jul 08 23:24:15.803345 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.803319    2574 scope.go:117] "RemoveContainer" containerID="579bb7bf6896947ee1b31084fee7d0aa38b930bcafd18d6ace0a4308e522f4cd"
Jul 08 23:24:15.803654 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:24:15.803633    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"579bb7bf6896947ee1b31084fee7d0aa38b930bcafd18d6ace0a4308e522f4cd\": container with ID starting with 579bb7bf6896947ee1b31084fee7d0aa38b930bcafd18d6ace0a4308e522f4cd not found: ID does not exist" containerID="579bb7bf6896947ee1b31084fee7d0aa38b930bcafd18d6ace0a4308e522f4cd"
Jul 08 23:24:15.803767 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.803663    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579bb7bf6896947ee1b31084fee7d0aa38b930bcafd18d6ace0a4308e522f4cd"} err="failed to get container status \"579bb7bf6896947ee1b31084fee7d0aa38b930bcafd18d6ace0a4308e522f4cd\": rpc error: code = NotFound desc = could not find container \"579bb7bf6896947ee1b31084fee7d0aa38b930bcafd18d6ace0a4308e522f4cd\": container with ID starting with 579bb7bf6896947ee1b31084fee7d0aa38b930bcafd18d6ace0a4308e522f4cd not found: ID does not exist"
Jul 08 23:24:15.803767 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.803682    2574 scope.go:117] "RemoveContainer" containerID="f7a38af1b5d312ee32fddd40fd9f46b9c3e7048d79cbd69580e76049c15dff80"
Jul 08 23:24:15.804083 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:24:15.804065    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7a38af1b5d312ee32fddd40fd9f46b9c3e7048d79cbd69580e76049c15dff80\": container with ID starting with f7a38af1b5d312ee32fddd40fd9f46b9c3e7048d79cbd69580e76049c15dff80 not found: ID does not exist" containerID="f7a38af1b5d312ee32fddd40fd9f46b9c3e7048d79cbd69580e76049c15dff80"
Jul 08 23:24:15.804152 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.804086    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7a38af1b5d312ee32fddd40fd9f46b9c3e7048d79cbd69580e76049c15dff80"} err="failed to get container status \"f7a38af1b5d312ee32fddd40fd9f46b9c3e7048d79cbd69580e76049c15dff80\": rpc error: code = NotFound desc = could not find container \"f7a38af1b5d312ee32fddd40fd9f46b9c3e7048d79cbd69580e76049c15dff80\": container with ID starting with f7a38af1b5d312ee32fddd40fd9f46b9c3e7048d79cbd69580e76049c15dff80 not found: ID does not exist"
Jul 08 23:24:15.804243 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.804225    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"]
Jul 08 23:24:15.807832 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:15.807810    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a50ce6-openshift-default-6c99ddcc87-szq5n"]
Jul 08 23:24:16.846757 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:16.846720    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"]
Jul 08 23:24:17.503336 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.503295    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7838e881-32ab-46e7-8687-362a3b18cc02" path="/var/lib/kubelet/pods/7838e881-32ab-46e7-8687-362a3b18cc02/volumes"
Jul 08 23:24:17.653217 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.653180    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"]
Jul 08 23:24:17.653576 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.653563    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee4737a5-9b3d-48b7-b126-7188bcd596d9" containerName="istio-proxy"
Jul 08 23:24:17.653621 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.653578    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4737a5-9b3d-48b7-b126-7188bcd596d9" containerName="istio-proxy"
Jul 08 23:24:17.653621 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.653589    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7838e881-32ab-46e7-8687-362a3b18cc02" containerName="istio-proxy"
Jul 08 23:24:17.653621 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.653594    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7838e881-32ab-46e7-8687-362a3b18cc02" containerName="istio-proxy"
Jul 08 23:24:17.653621 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.653605    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7838e881-32ab-46e7-8687-362a3b18cc02" containerName="istio-proxy"
Jul 08 23:24:17.653621 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.653610    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7838e881-32ab-46e7-8687-362a3b18cc02" containerName="istio-proxy"
Jul 08 23:24:17.653802 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.653668    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7838e881-32ab-46e7-8687-362a3b18cc02" containerName="istio-proxy"
Jul 08 23:24:17.653802 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.653676    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7838e881-32ab-46e7-8687-362a3b18cc02" containerName="istio-proxy"
Jul 08 23:24:17.656659 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.656633    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.659367 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.659346    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-77dfb5-openshift-default-dockercfg-mk8kq\""
Jul 08 23:24:17.668495 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.668464    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"]
Jul 08 23:24:17.720995 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.720951    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-workload-socket\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.720995 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.720992    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-podinfo\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.721214 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.721012    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-token\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.721214 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.721032    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-workload-certs\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.721214 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.721115    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-credential-socket\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.721214 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.721145    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-data\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.721214 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.721176    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-envoy\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.721214 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.721203    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51b797f5-6d5c-44df-b382-20a60f62b4f6-istiod-ca-cert\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.721412 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.721226    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8pzt\" (UniqueName: \"kubernetes.io/projected/51b797f5-6d5c-44df-b382-20a60f62b4f6-kube-api-access-n8pzt\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.799239 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.799123    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8" podUID="8fe52774-abad-4f97-b9ba-b40cb1a3b324" containerName="istio-proxy" containerID="cri-o://315f8511306b8f740ba64ba036a7c000a584cd934c6fd1c92de24ac2d103b4fa" gracePeriod=30
Jul 08 23:24:17.822275 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.822235    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-workload-socket\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.822275 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.822275    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-podinfo\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.822539 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.822296    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-token\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.822539 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.822318    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-workload-certs\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.822539 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.822362    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-credential-socket\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.822539 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.822385    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-data\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.822539 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.822517    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-envoy\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.822845 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.822556    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51b797f5-6d5c-44df-b382-20a60f62b4f6-istiod-ca-cert\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.822845 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.822595    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8pzt\" (UniqueName: \"kubernetes.io/projected/51b797f5-6d5c-44df-b382-20a60f62b4f6-kube-api-access-n8pzt\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.822845 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.822727    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-workload-socket\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.822845 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.822781    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-credential-socket\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.823067 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.822944    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-workload-certs\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.823116 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.823063    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-data\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.823311 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.823290    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51b797f5-6d5c-44df-b382-20a60f62b4f6-istiod-ca-cert\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.824991 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.824965    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-envoy\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.825195 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.825175    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-podinfo\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.830435 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.830413    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8pzt\" (UniqueName: \"kubernetes.io/projected/51b797f5-6d5c-44df-b382-20a60f62b4f6-kube-api-access-n8pzt\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.830768 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.830751    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-token\") pod \"e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") " pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:17.968923 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:17.968882    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:18.120618 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:18.120587    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"]
Jul 08 23:24:18.121588 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:24:18.121554    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b797f5_6d5c_44df_b382_20a60f62b4f6.slice/crio-fe09dcf7b922bdd2a1a6877f9612b9b28304c22137b1208371952d08eb1dde7b WatchSource:0}: Error finding container fe09dcf7b922bdd2a1a6877f9612b9b28304c22137b1208371952d08eb1dde7b: Status 404 returned error can't find the container with id fe09dcf7b922bdd2a1a6877f9612b9b28304c22137b1208371952d08eb1dde7b
Jul 08 23:24:18.123791 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:18.123754    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:24:18.123949 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:18.123838    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:24:18.123949 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:18.123877    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:24:18.805315 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:18.805275    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7" event={"ID":"51b797f5-6d5c-44df-b382-20a60f62b4f6","Type":"ContainerStarted","Data":"c116bcc6f28293ddad41c9afb9ab867cb677f876b0a99126ea195a9ddcf14561"}
Jul 08 23:24:18.805498 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:18.805337    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7" event={"ID":"51b797f5-6d5c-44df-b382-20a60f62b4f6","Type":"ContainerStarted","Data":"fe09dcf7b922bdd2a1a6877f9612b9b28304c22137b1208371952d08eb1dde7b"}
Jul 08 23:24:18.827890 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:18.827832    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7" podStartSLOduration=1.827807268 podStartE2EDuration="1.827807268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:24:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:24:18.824998421 +0000 UTC m=+2233.849580422" watchObservedRunningTime="2026-07-08 23:24:18.827807268 +0000 UTC m=+2233.852389273"
Jul 08 23:24:18.969578 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:18.969542    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:19.974402 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:19.974366    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:20.815321 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:20.815288    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:20.816233 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:20.816215    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:23.067301 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.067237    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:24:23.179591 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.179555    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9l66\" (UniqueName: \"kubernetes.io/projected/8fe52774-abad-4f97-b9ba-b40cb1a3b324-kube-api-access-z9l66\") pod \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") "
Jul 08 23:24:23.179807 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.179614    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istiod-ca-cert\") pod \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") "
Jul 08 23:24:23.179807 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.179652    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-envoy\") pod \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") "
Jul 08 23:24:23.179807 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.179724    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-workload-certs\") pod \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") "
Jul 08 23:24:23.179807 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.179757    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-data\") pod \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") "
Jul 08 23:24:23.179807 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.179787    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-credential-socket\") pod \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") "
Jul 08 23:24:23.180099 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.179813    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-workload-socket\") pod \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") "
Jul 08 23:24:23.180099 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.179851    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-token\") pod \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") "
Jul 08 23:24:23.180099 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.179910    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-podinfo\") pod \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\" (UID: \"8fe52774-abad-4f97-b9ba-b40cb1a3b324\") "
Jul 08 23:24:23.180099 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.180058    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8fe52774-abad-4f97-b9ba-b40cb1a3b324" (UID: "8fe52774-abad-4f97-b9ba-b40cb1a3b324"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:24:23.180323 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.180148    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8fe52774-abad-4f97-b9ba-b40cb1a3b324" (UID: "8fe52774-abad-4f97-b9ba-b40cb1a3b324"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:24:23.180323 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.180233    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8fe52774-abad-4f97-b9ba-b40cb1a3b324" (UID: "8fe52774-abad-4f97-b9ba-b40cb1a3b324"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:24:23.180451 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.180338    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istiod-ca-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:23.180451 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.180358    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-workload-certs\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:23.180451 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.180372    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-workload-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:23.180610 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.180496    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8fe52774-abad-4f97-b9ba-b40cb1a3b324" (UID: "8fe52774-abad-4f97-b9ba-b40cb1a3b324"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:24:23.180787 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.180761    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-data" (OuterVolumeSpecName: "istio-data") pod "8fe52774-abad-4f97-b9ba-b40cb1a3b324" (UID: "8fe52774-abad-4f97-b9ba-b40cb1a3b324"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:24:23.181990 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.181963    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fe52774-abad-4f97-b9ba-b40cb1a3b324-kube-api-access-z9l66" (OuterVolumeSpecName: "kube-api-access-z9l66") pod "8fe52774-abad-4f97-b9ba-b40cb1a3b324" (UID: "8fe52774-abad-4f97-b9ba-b40cb1a3b324"). InnerVolumeSpecName "kube-api-access-z9l66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:24:23.182117 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.182012    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8fe52774-abad-4f97-b9ba-b40cb1a3b324" (UID: "8fe52774-abad-4f97-b9ba-b40cb1a3b324"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:24:23.182183 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.182129    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8fe52774-abad-4f97-b9ba-b40cb1a3b324" (UID: "8fe52774-abad-4f97-b9ba-b40cb1a3b324"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:24:23.182183 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.182166    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-token" (OuterVolumeSpecName: "istio-token") pod "8fe52774-abad-4f97-b9ba-b40cb1a3b324" (UID: "8fe52774-abad-4f97-b9ba-b40cb1a3b324"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:24:23.281248 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.281210    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-podinfo\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:23.281248 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.281242    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9l66\" (UniqueName: \"kubernetes.io/projected/8fe52774-abad-4f97-b9ba-b40cb1a3b324-kube-api-access-z9l66\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:23.281248 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.281252    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-envoy\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:23.281248 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.281260    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-data\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:23.281531 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.281268    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe52774-abad-4f97-b9ba-b40cb1a3b324-credential-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:23.281531 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.281276    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fe52774-abad-4f97-b9ba-b40cb1a3b324-istio-token\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:24:23.831759 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.831660    2574 generic.go:356] "Generic (PLEG): container finished" podID="8fe52774-abad-4f97-b9ba-b40cb1a3b324" containerID="315f8511306b8f740ba64ba036a7c000a584cd934c6fd1c92de24ac2d103b4fa" exitCode=0
Jul 08 23:24:23.831759 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.831727    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"
Jul 08 23:24:23.831759 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.831738    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8" event={"ID":"8fe52774-abad-4f97-b9ba-b40cb1a3b324","Type":"ContainerDied","Data":"315f8511306b8f740ba64ba036a7c000a584cd934c6fd1c92de24ac2d103b4fa"}
Jul 08 23:24:23.832049 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.831797    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8" event={"ID":"8fe52774-abad-4f97-b9ba-b40cb1a3b324","Type":"ContainerDied","Data":"61455711fff20d5514eb3f9e1d2dc000fbfaad484d3a123b0a88eaf96dbfdddb"}
Jul 08 23:24:23.832049 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.831822    2574 scope.go:117] "RemoveContainer" containerID="315f8511306b8f740ba64ba036a7c000a584cd934c6fd1c92de24ac2d103b4fa"
Jul 08 23:24:23.841351 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.841331    2574 scope.go:117] "RemoveContainer" containerID="9a16744ed02438945a02345b04c45b3fb3df3c77204c5fa5f3340e1d31f331a5"
Jul 08 23:24:23.849375 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.849344    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"]
Jul 08 23:24:23.850343 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.850315    2574 scope.go:117] "RemoveContainer" containerID="315f8511306b8f740ba64ba036a7c000a584cd934c6fd1c92de24ac2d103b4fa"
Jul 08 23:24:23.850780 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:24:23.850752    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"315f8511306b8f740ba64ba036a7c000a584cd934c6fd1c92de24ac2d103b4fa\": container with ID starting with 315f8511306b8f740ba64ba036a7c000a584cd934c6fd1c92de24ac2d103b4fa not found: ID does not exist" containerID="315f8511306b8f740ba64ba036a7c000a584cd934c6fd1c92de24ac2d103b4fa"
Jul 08 23:24:23.850898 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.850792    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"315f8511306b8f740ba64ba036a7c000a584cd934c6fd1c92de24ac2d103b4fa"} err="failed to get container status \"315f8511306b8f740ba64ba036a7c000a584cd934c6fd1c92de24ac2d103b4fa\": rpc error: code = NotFound desc = could not find container \"315f8511306b8f740ba64ba036a7c000a584cd934c6fd1c92de24ac2d103b4fa\": container with ID starting with 315f8511306b8f740ba64ba036a7c000a584cd934c6fd1c92de24ac2d103b4fa not found: ID does not exist"
Jul 08 23:24:23.850898 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.850816    2574 scope.go:117] "RemoveContainer" containerID="9a16744ed02438945a02345b04c45b3fb3df3c77204c5fa5f3340e1d31f331a5"
Jul 08 23:24:23.851132 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:24:23.851113    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a16744ed02438945a02345b04c45b3fb3df3c77204c5fa5f3340e1d31f331a5\": container with ID starting with 9a16744ed02438945a02345b04c45b3fb3df3c77204c5fa5f3340e1d31f331a5 not found: ID does not exist" containerID="9a16744ed02438945a02345b04c45b3fb3df3c77204c5fa5f3340e1d31f331a5"
Jul 08 23:24:23.851194 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.851139    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a16744ed02438945a02345b04c45b3fb3df3c77204c5fa5f3340e1d31f331a5"} err="failed to get container status \"9a16744ed02438945a02345b04c45b3fb3df3c77204c5fa5f3340e1d31f331a5\": rpc error: code = NotFound desc = could not find container \"9a16744ed02438945a02345b04c45b3fb3df3c77204c5fa5f3340e1d31f331a5\": container with ID starting with 9a16744ed02438945a02345b04c45b3fb3df3c77204c5fa5f3340e1d31f331a5 not found: ID does not exist"
Jul 08 23:24:23.853036 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:23.853016    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-52eefd-openshift-default-7fd7bb9447-bw8m8"]
Jul 08 23:24:25.504737 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.504682    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fe52774-abad-4f97-b9ba-b40cb1a3b324" path="/var/lib/kubelet/pods/8fe52774-abad-4f97-b9ba-b40cb1a3b324/volumes"
Jul 08 23:24:25.780385 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.780290    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"]
Jul 08 23:24:25.780851 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.780828    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fe52774-abad-4f97-b9ba-b40cb1a3b324" containerName="istio-proxy"
Jul 08 23:24:25.780960 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.780853    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fe52774-abad-4f97-b9ba-b40cb1a3b324" containerName="istio-proxy"
Jul 08 23:24:25.780960 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.780871    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fe52774-abad-4f97-b9ba-b40cb1a3b324" containerName="istio-proxy"
Jul 08 23:24:25.780960 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.780879    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fe52774-abad-4f97-b9ba-b40cb1a3b324" containerName="istio-proxy"
Jul 08 23:24:25.781102 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.780997    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fe52774-abad-4f97-b9ba-b40cb1a3b324" containerName="istio-proxy"
Jul 08 23:24:25.781102 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.781009    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fe52774-abad-4f97-b9ba-b40cb1a3b324" containerName="istio-proxy"
Jul 08 23:24:25.785307 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.785281    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:25.788002 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.787977    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-5b1175-openshift-default-dockercfg-sw9rc\""
Jul 08 23:24:25.796796 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.796764    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"]
Jul 08 23:24:25.907276 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.907230    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-workload-certs\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:25.907464 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.907289    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-credential-socket\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:25.907464 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.907317    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-istio-envoy\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:25.907464 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.907339    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-istio-data\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:25.907464 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.907396    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c72101f-6a24-4059-8252-04ae331b838e-istio-podinfo\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:25.907464 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.907426    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mstcv\" (UniqueName: \"kubernetes.io/projected/7c72101f-6a24-4059-8252-04ae331b838e-kube-api-access-mstcv\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:25.907464 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.907457    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c72101f-6a24-4059-8252-04ae331b838e-istio-token\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:25.907712 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.907474    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c72101f-6a24-4059-8252-04ae331b838e-istiod-ca-cert\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:25.907712 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:25.907532    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-workload-socket\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.008204 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.008167    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mstcv\" (UniqueName: \"kubernetes.io/projected/7c72101f-6a24-4059-8252-04ae331b838e-kube-api-access-mstcv\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.008204 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.008214    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c72101f-6a24-4059-8252-04ae331b838e-istio-token\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.008469 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.008231    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c72101f-6a24-4059-8252-04ae331b838e-istiod-ca-cert\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.008469 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.008274    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-workload-socket\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.008469 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.008321    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-workload-certs\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.008469 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.008348    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-credential-socket\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.008469 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.008381    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-istio-envoy\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.008469 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.008410    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-istio-data\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.008469 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.008458    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c72101f-6a24-4059-8252-04ae331b838e-istio-podinfo\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.008856 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.008836    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-workload-certs\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.008920 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.008886    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-credential-socket\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.008973 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.008935    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-workload-socket\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.009086 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.009066    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-istio-data\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.009149 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.009099    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c72101f-6a24-4059-8252-04ae331b838e-istiod-ca-cert\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.010829 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.010810    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-istio-envoy\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.010939 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.010893    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c72101f-6a24-4059-8252-04ae331b838e-istio-podinfo\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.016226 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.016200    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c72101f-6a24-4059-8252-04ae331b838e-istio-token\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.016663 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.016646    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mstcv\" (UniqueName: \"kubernetes.io/projected/7c72101f-6a24-4059-8252-04ae331b838e-kube-api-access-mstcv\") pod \"e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") " pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.098365 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.098261    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:26.242298 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.242270    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"]
Jul 08 23:24:26.244313 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:24:26.244281    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c72101f_6a24_4059_8252_04ae331b838e.slice/crio-f8788148db48f5aab2c6c4eac0d41b682d6e04d07c4212af18022d5958d62df3 WatchSource:0}: Error finding container f8788148db48f5aab2c6c4eac0d41b682d6e04d07c4212af18022d5958d62df3: Status 404 returned error can't find the container with id f8788148db48f5aab2c6c4eac0d41b682d6e04d07c4212af18022d5958d62df3
Jul 08 23:24:26.246502 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.246466    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:24:26.246582 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.246544    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:24:26.246582 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.246575    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:24:26.850432 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.850396    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj" event={"ID":"7c72101f-6a24-4059-8252-04ae331b838e","Type":"ContainerStarted","Data":"7eba28126ad21fe6b44884f59a71fe207d051ca2ec19d708ec41c2b8dba02e57"}
Jul 08 23:24:26.850868 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.850464    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj" event={"ID":"7c72101f-6a24-4059-8252-04ae331b838e","Type":"ContainerStarted","Data":"f8788148db48f5aab2c6c4eac0d41b682d6e04d07c4212af18022d5958d62df3"}
Jul 08 23:24:26.870672 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:26.870620    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj" podStartSLOduration=1.8706028030000001 podStartE2EDuration="1.870602803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:24:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:24:26.867332541 +0000 UTC m=+2241.891914545" watchObservedRunningTime="2026-07-08 23:24:26.870602803 +0000 UTC m=+2241.895184806"
Jul 08 23:24:27.099535 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:27.099452    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:27.104558 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:27.104488    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:27.856943 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:27.856909    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:27.858010 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:27.857991    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:34.896289 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:34.896255    2574 generic.go:356] "Generic (PLEG): container finished" podID="51b797f5-6d5c-44df-b382-20a60f62b4f6" containerID="c116bcc6f28293ddad41c9afb9ab867cb677f876b0a99126ea195a9ddcf14561" exitCode=0
Jul 08 23:24:34.896820 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:34.896313    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7" event={"ID":"51b797f5-6d5c-44df-b382-20a60f62b4f6","Type":"ContainerDied","Data":"c116bcc6f28293ddad41c9afb9ab867cb677f876b0a99126ea195a9ddcf14561"}
Jul 08 23:24:34.896820 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:34.896735    2574 scope.go:117] "RemoveContainer" containerID="c116bcc6f28293ddad41c9afb9ab867cb677f876b0a99126ea195a9ddcf14561"
Jul 08 23:24:34.897797 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:34.897763    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:24:34.897911 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:34.897853    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:24:34.897911 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:34.897905    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:24:35.815888 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:35.815846    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:35.903608 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:35.903573    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7" event={"ID":"51b797f5-6d5c-44df-b382-20a60f62b4f6","Type":"ContainerStarted","Data":"38d6d97517669ba90c29da408ea9c7aefcba744f388e90743633d3fb6675c865"}
Jul 08 23:24:35.969834 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:35.969789    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:35.972937 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:35.970883    2574 patch_prober.go:28] interesting pod/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 08 23:24:35.972937 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:35.970941    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7" podUID="51b797f5-6d5c-44df-b382-20a60f62b4f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 08 23:24:36.970286 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:36.970230    2574 patch_prober.go:28] interesting pod/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 08 23:24:36.970862 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:36.970325    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7" podUID="51b797f5-6d5c-44df-b382-20a60f62b4f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 08 23:24:37.969903 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:37.969864    2574 patch_prober.go:28] interesting pod/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 08 23:24:37.970201 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:37.970166    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7" podUID="51b797f5-6d5c-44df-b382-20a60f62b4f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 08 23:24:38.969328 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:38.969232    2574 patch_prober.go:28] interesting pod/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 08 23:24:38.969804 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:38.969344    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7" podUID="51b797f5-6d5c-44df-b382-20a60f62b4f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 08 23:24:39.980038 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:39.980009    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:39.980532 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:39.980434    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:39.981211 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:39.981189    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:24:41.938118 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:41.938086    2574 generic.go:356] "Generic (PLEG): container finished" podID="7c72101f-6a24-4059-8252-04ae331b838e" containerID="7eba28126ad21fe6b44884f59a71fe207d051ca2ec19d708ec41c2b8dba02e57" exitCode=0
Jul 08 23:24:41.938806 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:41.938165    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj" event={"ID":"7c72101f-6a24-4059-8252-04ae331b838e","Type":"ContainerDied","Data":"7eba28126ad21fe6b44884f59a71fe207d051ca2ec19d708ec41c2b8dba02e57"}
Jul 08 23:24:41.938806 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:41.938671    2574 scope.go:117] "RemoveContainer" containerID="7eba28126ad21fe6b44884f59a71fe207d051ca2ec19d708ec41c2b8dba02e57"
Jul 08 23:24:41.939719 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:41.939672    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:24:41.939842 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:41.939776    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:24:41.939842 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:41.939825    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:24:42.857759 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:42.857715    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:42.951131 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:42.950141    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj" event={"ID":"7c72101f-6a24-4059-8252-04ae331b838e","Type":"ContainerStarted","Data":"33856ab16b3ccf87c75820a25a34a38d6c70e179082bcf09a6626c3f3c807e82"}
Jul 08 23:24:43.099347 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:43.099303    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:43.100589 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:43.100561    2574 patch_prober.go:28] interesting pod/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 08 23:24:43.100723 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:43.100619    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj" podUID="7c72101f-6a24-4059-8252-04ae331b838e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 08 23:24:44.099107 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:44.099069    2574 patch_prober.go:28] interesting pod/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 08 23:24:44.099513 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:44.099159    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj" podUID="7c72101f-6a24-4059-8252-04ae331b838e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 08 23:24:45.099201 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:45.099163    2574 patch_prober.go:28] interesting pod/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 08 23:24:45.099620 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:45.099255    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj" podUID="7c72101f-6a24-4059-8252-04ae331b838e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 08 23:24:46.099358 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:46.099318    2574 patch_prober.go:28] interesting pod/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 08 23:24:46.099802 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:46.099382    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj" podUID="7c72101f-6a24-4059-8252-04ae331b838e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 08 23:24:47.103027 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:47.102995    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:47.103478 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:47.103279    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:24:47.103936 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:24:47.103922    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:25:25.784090 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:25.784052    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"]
Jul 08 23:25:25.787575 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:25.787552    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:25.792018 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:25.791982    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5b1175\"/\"kube-root-ca.crt\""
Jul 08 23:25:25.792018 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:25.792011    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5b1175\"/\"openshift-service-ca.crt\""
Jul 08 23:25:25.792250 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:25.792032    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5b1175\"/\"default-dockercfg-4z8gf\""
Jul 08 23:25:25.792250 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:25.792131    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5b1175\"/\"auth-test-model-5b1175-kserve-self-signed-certs\""
Jul 08 23:25:25.796952 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:25.796929    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"]
Jul 08 23:25:25.900886 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:25.900847    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-model-cache\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:25.901082 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:25.900908    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-home\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:25.901082 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:25.901005    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-tls-certs\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:25.901082 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:25.901032    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-dshm\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:25.901082 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:25.901049    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-tmp-dir\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:25.901242 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:25.901127    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fgq5\" (UniqueName: \"kubernetes.io/projected/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-kube-api-access-5fgq5\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:26.002715 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:26.002654    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fgq5\" (UniqueName: \"kubernetes.io/projected/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-kube-api-access-5fgq5\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:26.002927 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:26.002762    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-model-cache\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:26.002927 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:26.002798    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-home\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:26.002927 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:26.002841    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-tls-certs\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:26.002927 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:26.002868    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-dshm\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:26.002927 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:26.002887    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-tmp-dir\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:26.003249 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:26.003229    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-home\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:26.003323 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:26.003271    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-tmp-dir\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:26.003385 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:26.003325    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-model-cache\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:26.005206 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:26.005182    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-dshm\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:26.005434 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:26.005418    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-tls-certs\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:26.011036 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:26.011017    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fgq5\" (UniqueName: \"kubernetes.io/projected/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-kube-api-access-5fgq5\") pod \"auth-test-model-5b1175-kserve-759d5b979f-kfc85\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") " pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:26.100386 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:26.100294    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:26.249319 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:26.249288    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"]
Jul 08 23:25:26.251024 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:25:26.250999    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9c2c8fb_8396_45d6_9dbe_5962c7d124df.slice/crio-fe401f131ca7c206cc45d74b4969c58bfb121fe933188ad8a94f2833bfd88542 WatchSource:0}: Error finding container fe401f131ca7c206cc45d74b4969c58bfb121fe933188ad8a94f2833bfd88542: Status 404 returned error can't find the container with id fe401f131ca7c206cc45d74b4969c58bfb121fe933188ad8a94f2833bfd88542
Jul 08 23:25:27.192624 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:27.192590    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85" event={"ID":"f9c2c8fb-8396-45d6-9dbe-5962c7d124df","Type":"ContainerStarted","Data":"18a37bc4c4e7c7007390fdb2e4d29e465293edfbda72a85791ad97c4be5a6eca"}
Jul 08 23:25:27.192624 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:27.192631    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85" event={"ID":"f9c2c8fb-8396-45d6-9dbe-5962c7d124df","Type":"ContainerStarted","Data":"fe401f131ca7c206cc45d74b4969c58bfb121fe933188ad8a94f2833bfd88542"}
Jul 08 23:25:27.210288 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:27.210235    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85" podStartSLOduration=2.210218104 podStartE2EDuration="2.210218104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:25:27.208107077 +0000 UTC m=+2302.232689082" watchObservedRunningTime="2026-07-08 23:25:27.210218104 +0000 UTC m=+2302.234800107"
Jul 08 23:25:36.101011 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:36.100979    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:36.101011 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:36.101022    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:36.113642 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:36.113614    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:25:36.255147 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:25:36.255118    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:27:05.627542 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:05.627513    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 23:27:05.633565 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:05.633533    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 23:27:29.792877 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:29.792802    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"]
Jul 08 23:27:44.813232 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:44.813167    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85" podUID="f9c2c8fb-8396-45d6-9dbe-5962c7d124df" containerName="main" containerID="cri-o://18a37bc4c4e7c7007390fdb2e4d29e465293edfbda72a85791ad97c4be5a6eca" gracePeriod=45
Jul 08 23:27:44.943150 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:44.943121    2574 generic.go:356] "Generic (PLEG): container finished" podID="f9c2c8fb-8396-45d6-9dbe-5962c7d124df" containerID="18a37bc4c4e7c7007390fdb2e4d29e465293edfbda72a85791ad97c4be5a6eca" exitCode=0
Jul 08 23:27:44.943324 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:44.943198    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85" event={"ID":"f9c2c8fb-8396-45d6-9dbe-5962c7d124df","Type":"ContainerDied","Data":"18a37bc4c4e7c7007390fdb2e4d29e465293edfbda72a85791ad97c4be5a6eca"}
Jul 08 23:27:45.069328 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.069259    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:27:45.170157 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.170121    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-dshm\") pod \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") "
Jul 08 23:27:45.170336 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.170179    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-home\") pod \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") "
Jul 08 23:27:45.170336 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.170210    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-tmp-dir\") pod \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") "
Jul 08 23:27:45.170336 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.170235    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-model-cache\") pod \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") "
Jul 08 23:27:45.170336 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.170316    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fgq5\" (UniqueName: \"kubernetes.io/projected/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-kube-api-access-5fgq5\") pod \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") "
Jul 08 23:27:45.170482 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.170392    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-tls-certs\") pod \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\" (UID: \"f9c2c8fb-8396-45d6-9dbe-5962c7d124df\") "
Jul 08 23:27:45.170482 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.170452    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f9c2c8fb-8396-45d6-9dbe-5962c7d124df" (UID: "f9c2c8fb-8396-45d6-9dbe-5962c7d124df"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:27:45.170600 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.170468    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-home" (OuterVolumeSpecName: "home") pod "f9c2c8fb-8396-45d6-9dbe-5962c7d124df" (UID: "f9c2c8fb-8396-45d6-9dbe-5962c7d124df"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:27:45.170600 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.170545    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-model-cache" (OuterVolumeSpecName: "model-cache") pod "f9c2c8fb-8396-45d6-9dbe-5962c7d124df" (UID: "f9c2c8fb-8396-45d6-9dbe-5962c7d124df"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:27:45.170747 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.170732    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-home\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:27:45.170814 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.170753    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-tmp-dir\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:27:45.170814 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.170768    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-model-cache\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:27:45.172435 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.172407    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-dshm" (OuterVolumeSpecName: "dshm") pod "f9c2c8fb-8396-45d6-9dbe-5962c7d124df" (UID: "f9c2c8fb-8396-45d6-9dbe-5962c7d124df"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:27:45.172565 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.172441    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f9c2c8fb-8396-45d6-9dbe-5962c7d124df" (UID: "f9c2c8fb-8396-45d6-9dbe-5962c7d124df"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:27:45.172565 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.172501    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-kube-api-access-5fgq5" (OuterVolumeSpecName: "kube-api-access-5fgq5") pod "f9c2c8fb-8396-45d6-9dbe-5962c7d124df" (UID: "f9c2c8fb-8396-45d6-9dbe-5962c7d124df"). InnerVolumeSpecName "kube-api-access-5fgq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:27:45.272071 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.272034    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-dshm\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:27:45.272071 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.272066    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fgq5\" (UniqueName: \"kubernetes.io/projected/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-kube-api-access-5fgq5\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:27:45.272071 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.272081    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9c2c8fb-8396-45d6-9dbe-5962c7d124df-tls-certs\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:27:45.949790 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.949765    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"
Jul 08 23:27:45.950210 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.949765    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85" event={"ID":"f9c2c8fb-8396-45d6-9dbe-5962c7d124df","Type":"ContainerDied","Data":"fe401f131ca7c206cc45d74b4969c58bfb121fe933188ad8a94f2833bfd88542"}
Jul 08 23:27:45.950210 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.949884    2574 scope.go:117] "RemoveContainer" containerID="18a37bc4c4e7c7007390fdb2e4d29e465293edfbda72a85791ad97c4be5a6eca"
Jul 08 23:27:45.966847 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.966806    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"]
Jul 08 23:27:45.969841 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:45.969817    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-5b1175/auth-test-model-5b1175-kserve-759d5b979f-kfc85"]
Jul 08 23:27:47.502571 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:27:47.502539    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9c2c8fb-8396-45d6-9dbe-5962c7d124df" path="/var/lib/kubelet/pods/f9c2c8fb-8396-45d6-9dbe-5962c7d124df/volumes"
Jul 08 23:29:26.088541 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.088448    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"]
Jul 08 23:29:26.089184 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.088918    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9c2c8fb-8396-45d6-9dbe-5962c7d124df" containerName="main"
Jul 08 23:29:26.089184 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.088931    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9c2c8fb-8396-45d6-9dbe-5962c7d124df" containerName="main"
Jul 08 23:29:26.089184 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.088985    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9c2c8fb-8396-45d6-9dbe-5962c7d124df" containerName="main"
Jul 08 23:29:26.091759 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.091735    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.096029 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.096004    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-77dfb5\"/\"rate-test-model-77dfb5-kserve-self-signed-certs\""
Jul 08 23:29:26.096184 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.096047    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-77dfb5\"/\"openshift-service-ca.crt\""
Jul 08 23:29:26.096184 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.096004    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-77dfb5\"/\"kube-root-ca.crt\""
Jul 08 23:29:26.096184 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.096032    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-77dfb5\"/\"default-dockercfg-sn2xr\""
Jul 08 23:29:26.101904 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.101877    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"]
Jul 08 23:29:26.154680 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.154642    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-tmp-dir\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.154869 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.154708    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-dshm\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.154869 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.154763    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcnzp\" (UniqueName: \"kubernetes.io/projected/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-kube-api-access-qcnzp\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.154869 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.154794    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-model-cache\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.154869 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.154820    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-home\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.155048 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.154921    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-tls-certs\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.255938 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.255884    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-tmp-dir\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.255938 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.255939    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-dshm\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.256214 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.255979    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcnzp\" (UniqueName: \"kubernetes.io/projected/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-kube-api-access-qcnzp\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.256214 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.256001    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-model-cache\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.256214 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.256024    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-home\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.256214 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.256095    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-tls-certs\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.256421 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.256330    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-tmp-dir\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.256421 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.256384    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-model-cache\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.256493 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.256423    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-home\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.258340 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.258317    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-dshm\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.258491 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.258462    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-tls-certs\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.264210 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.264183    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcnzp\" (UniqueName: \"kubernetes.io/projected/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-kube-api-access-qcnzp\") pod \"rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") " pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.404319 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.404277    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:26.548221 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:26.548194    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"]
Jul 08 23:29:26.549934 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:29:26.549895    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2b762fd_a1f3_47f8_9414_d7ba146fa26e.slice/crio-4d9132d126836e3dc16219e3010a114c3e8ece423d167b3fa48f9f281db17ba3 WatchSource:0}: Error finding container 4d9132d126836e3dc16219e3010a114c3e8ece423d167b3fa48f9f281db17ba3: Status 404 returned error can't find the container with id 4d9132d126836e3dc16219e3010a114c3e8ece423d167b3fa48f9f281db17ba3
Jul 08 23:29:27.502727 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:27.502670    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb" event={"ID":"e2b762fd-a1f3-47f8-9414-d7ba146fa26e","Type":"ContainerStarted","Data":"fd6cf32c36b92b21c88a260ff6f9bdb1d64085d9463f203eef73da0a43ec5cb2"}
Jul 08 23:29:27.502727 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:27.502729    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb" event={"ID":"e2b762fd-a1f3-47f8-9414-d7ba146fa26e","Type":"ContainerStarted","Data":"4d9132d126836e3dc16219e3010a114c3e8ece423d167b3fa48f9f281db17ba3"}
Jul 08 23:29:27.517437 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:27.517384    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb" podStartSLOduration=1.517366991 podStartE2EDuration="1.517366991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:29:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:29:27.515155342 +0000 UTC m=+2542.539737346" watchObservedRunningTime="2026-07-08 23:29:27.517366991 +0000 UTC m=+2542.541948995"
Jul 08 23:29:36.405399 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:36.405364    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:36.405860 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:36.405421    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:36.418886 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:36.418861    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:29:36.559250 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:29:36.559220    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:30:52.957038 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:30:52.957003    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"]
Jul 08 23:31:07.979935 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:07.979867    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb" podUID="e2b762fd-a1f3-47f8-9414-d7ba146fa26e" containerName="main" containerID="cri-o://fd6cf32c36b92b21c88a260ff6f9bdb1d64085d9463f203eef73da0a43ec5cb2" gracePeriod=45
Jul 08 23:31:08.240839 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.240769    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:31:08.348177 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.348137    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-model-cache\") pod \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") "
Jul 08 23:31:08.348177 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.348180    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-tmp-dir\") pod \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") "
Jul 08 23:31:08.348435 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.348211    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcnzp\" (UniqueName: \"kubernetes.io/projected/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-kube-api-access-qcnzp\") pod \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") "
Jul 08 23:31:08.348435 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.348248    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-tls-certs\") pod \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") "
Jul 08 23:31:08.348435 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.348279    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-dshm\") pod \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") "
Jul 08 23:31:08.348599 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.348428    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-model-cache" (OuterVolumeSpecName: "model-cache") pod "e2b762fd-a1f3-47f8-9414-d7ba146fa26e" (UID: "e2b762fd-a1f3-47f8-9414-d7ba146fa26e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:31:08.348599 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.348438    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e2b762fd-a1f3-47f8-9414-d7ba146fa26e" (UID: "e2b762fd-a1f3-47f8-9414-d7ba146fa26e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:31:08.348599 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.348438    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-home\") pod \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\" (UID: \"e2b762fd-a1f3-47f8-9414-d7ba146fa26e\") "
Jul 08 23:31:08.348875 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.348835    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-home" (OuterVolumeSpecName: "home") pod "e2b762fd-a1f3-47f8-9414-d7ba146fa26e" (UID: "e2b762fd-a1f3-47f8-9414-d7ba146fa26e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:31:08.348875 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.348870    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-model-cache\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:08.349067 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.348891    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-tmp-dir\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:08.350530 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.350500    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-dshm" (OuterVolumeSpecName: "dshm") pod "e2b762fd-a1f3-47f8-9414-d7ba146fa26e" (UID: "e2b762fd-a1f3-47f8-9414-d7ba146fa26e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:31:08.350637 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.350533    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e2b762fd-a1f3-47f8-9414-d7ba146fa26e" (UID: "e2b762fd-a1f3-47f8-9414-d7ba146fa26e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:31:08.350700 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.350642    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-kube-api-access-qcnzp" (OuterVolumeSpecName: "kube-api-access-qcnzp") pod "e2b762fd-a1f3-47f8-9414-d7ba146fa26e" (UID: "e2b762fd-a1f3-47f8-9414-d7ba146fa26e"). InnerVolumeSpecName "kube-api-access-qcnzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:31:08.450440 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.450401    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-tls-certs\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:08.450440 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.450435    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-dshm\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:08.450440 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.450447    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-home\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:08.450714 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:08.450460    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcnzp\" (UniqueName: \"kubernetes.io/projected/e2b762fd-a1f3-47f8-9414-d7ba146fa26e-kube-api-access-qcnzp\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:09.062760 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:09.062720    2574 generic.go:356] "Generic (PLEG): container finished" podID="e2b762fd-a1f3-47f8-9414-d7ba146fa26e" containerID="fd6cf32c36b92b21c88a260ff6f9bdb1d64085d9463f203eef73da0a43ec5cb2" exitCode=0
Jul 08 23:31:09.063274 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:09.062795    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb" event={"ID":"e2b762fd-a1f3-47f8-9414-d7ba146fa26e","Type":"ContainerDied","Data":"fd6cf32c36b92b21c88a260ff6f9bdb1d64085d9463f203eef73da0a43ec5cb2"}
Jul 08 23:31:09.063274 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:09.062803    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"
Jul 08 23:31:09.063274 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:09.062837    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb" event={"ID":"e2b762fd-a1f3-47f8-9414-d7ba146fa26e","Type":"ContainerDied","Data":"4d9132d126836e3dc16219e3010a114c3e8ece423d167b3fa48f9f281db17ba3"}
Jul 08 23:31:09.063274 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:09.062860    2574 scope.go:117] "RemoveContainer" containerID="fd6cf32c36b92b21c88a260ff6f9bdb1d64085d9463f203eef73da0a43ec5cb2"
Jul 08 23:31:09.072809 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:09.072783    2574 scope.go:117] "RemoveContainer" containerID="fd6cf32c36b92b21c88a260ff6f9bdb1d64085d9463f203eef73da0a43ec5cb2"
Jul 08 23:31:09.073102 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:31:09.073085    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd6cf32c36b92b21c88a260ff6f9bdb1d64085d9463f203eef73da0a43ec5cb2\": container with ID starting with fd6cf32c36b92b21c88a260ff6f9bdb1d64085d9463f203eef73da0a43ec5cb2 not found: ID does not exist" containerID="fd6cf32c36b92b21c88a260ff6f9bdb1d64085d9463f203eef73da0a43ec5cb2"
Jul 08 23:31:09.073173 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:09.073110    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd6cf32c36b92b21c88a260ff6f9bdb1d64085d9463f203eef73da0a43ec5cb2"} err="failed to get container status \"fd6cf32c36b92b21c88a260ff6f9bdb1d64085d9463f203eef73da0a43ec5cb2\": rpc error: code = NotFound desc = could not find container \"fd6cf32c36b92b21c88a260ff6f9bdb1d64085d9463f203eef73da0a43ec5cb2\": container with ID starting with fd6cf32c36b92b21c88a260ff6f9bdb1d64085d9463f203eef73da0a43ec5cb2 not found: ID does not exist"
Jul 08 23:31:09.091591 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:09.091540    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"]
Jul 08 23:31:09.091819 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:09.091627    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-77dfb5/rate-test-model-77dfb5-kserve-77f9b5f94c-qdfpb"]
Jul 08 23:31:09.503926 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:09.503883    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2b762fd-a1f3-47f8-9414-d7ba146fa26e" path="/var/lib/kubelet/pods/e2b762fd-a1f3-47f8-9414-d7ba146fa26e/volumes"
Jul 08 23:31:21.112284 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:21.112247    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"]
Jul 08 23:31:21.112874 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:21.112527    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7" podUID="51b797f5-6d5c-44df-b382-20a60f62b4f6" containerName="istio-proxy" containerID="cri-o://38d6d97517669ba90c29da408ea9c7aefcba744f388e90743633d3fb6675c865" gracePeriod=30
Jul 08 23:31:24.982610 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:24.982569    2574 patch_prober.go:28] interesting pod/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 23:31:24.983020 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:24.982642    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7" podUID="51b797f5-6d5c-44df-b382-20a60f62b4f6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 23:31:26.373762 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.373733    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:31:26.421535 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.421441    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8pzt\" (UniqueName: \"kubernetes.io/projected/51b797f5-6d5c-44df-b382-20a60f62b4f6-kube-api-access-n8pzt\") pod \"51b797f5-6d5c-44df-b382-20a60f62b4f6\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") "
Jul 08 23:31:26.421535 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.421501    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-token\") pod \"51b797f5-6d5c-44df-b382-20a60f62b4f6\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") "
Jul 08 23:31:26.421535 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.421532    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-credential-socket\") pod \"51b797f5-6d5c-44df-b382-20a60f62b4f6\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") "
Jul 08 23:31:26.421960 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.421557    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-podinfo\") pod \"51b797f5-6d5c-44df-b382-20a60f62b4f6\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") "
Jul 08 23:31:26.421960 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.421604    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51b797f5-6d5c-44df-b382-20a60f62b4f6-istiod-ca-cert\") pod \"51b797f5-6d5c-44df-b382-20a60f62b4f6\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") "
Jul 08 23:31:26.421960 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.421633    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-envoy\") pod \"51b797f5-6d5c-44df-b382-20a60f62b4f6\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") "
Jul 08 23:31:26.421960 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.421664    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-workload-socket\") pod \"51b797f5-6d5c-44df-b382-20a60f62b4f6\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") "
Jul 08 23:31:26.421960 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.421722    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-workload-certs\") pod \"51b797f5-6d5c-44df-b382-20a60f62b4f6\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") "
Jul 08 23:31:26.421960 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.421764    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-data\") pod \"51b797f5-6d5c-44df-b382-20a60f62b4f6\" (UID: \"51b797f5-6d5c-44df-b382-20a60f62b4f6\") "
Jul 08 23:31:26.422290 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.422129    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51b797f5-6d5c-44df-b382-20a60f62b4f6" (UID: "51b797f5-6d5c-44df-b382-20a60f62b4f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:31:26.422290 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.422143    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51b797f5-6d5c-44df-b382-20a60f62b4f6" (UID: "51b797f5-6d5c-44df-b382-20a60f62b4f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:31:26.422290 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.422184    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51b797f5-6d5c-44df-b382-20a60f62b4f6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51b797f5-6d5c-44df-b382-20a60f62b4f6" (UID: "51b797f5-6d5c-44df-b382-20a60f62b4f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:31:26.422465 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.422353    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51b797f5-6d5c-44df-b382-20a60f62b4f6" (UID: "51b797f5-6d5c-44df-b382-20a60f62b4f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:31:26.423059 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.423031    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-data" (OuterVolumeSpecName: "istio-data") pod "51b797f5-6d5c-44df-b382-20a60f62b4f6" (UID: "51b797f5-6d5c-44df-b382-20a60f62b4f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:31:26.424086 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.424053    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "51b797f5-6d5c-44df-b382-20a60f62b4f6" (UID: "51b797f5-6d5c-44df-b382-20a60f62b4f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:31:26.424247 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.424157    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51b797f5-6d5c-44df-b382-20a60f62b4f6-kube-api-access-n8pzt" (OuterVolumeSpecName: "kube-api-access-n8pzt") pod "51b797f5-6d5c-44df-b382-20a60f62b4f6" (UID: "51b797f5-6d5c-44df-b382-20a60f62b4f6"). InnerVolumeSpecName "kube-api-access-n8pzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:31:26.424247 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.424238    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51b797f5-6d5c-44df-b382-20a60f62b4f6" (UID: "51b797f5-6d5c-44df-b382-20a60f62b4f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:31:26.424428 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.424342    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51b797f5-6d5c-44df-b382-20a60f62b4f6" (UID: "51b797f5-6d5c-44df-b382-20a60f62b4f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:31:26.522875 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.522840    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8pzt\" (UniqueName: \"kubernetes.io/projected/51b797f5-6d5c-44df-b382-20a60f62b4f6-kube-api-access-n8pzt\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:26.522875 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.522869    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-token\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:26.522875 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.522880    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-credential-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:26.523120 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.522889    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-podinfo\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:26.523120 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.522898    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51b797f5-6d5c-44df-b382-20a60f62b4f6-istiod-ca-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:26.523120 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.522906    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-envoy\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:26.523120 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.522913    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-workload-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:26.523120 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.522920    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-workload-certs\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:26.523120 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:26.522928    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51b797f5-6d5c-44df-b382-20a60f62b4f6-istio-data\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:27.166122 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:27.166089    2574 generic.go:356] "Generic (PLEG): container finished" podID="51b797f5-6d5c-44df-b382-20a60f62b4f6" containerID="38d6d97517669ba90c29da408ea9c7aefcba744f388e90743633d3fb6675c865" exitCode=0
Jul 08 23:31:27.166347 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:27.166144    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"
Jul 08 23:31:27.166347 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:27.166179    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7" event={"ID":"51b797f5-6d5c-44df-b382-20a60f62b4f6","Type":"ContainerDied","Data":"38d6d97517669ba90c29da408ea9c7aefcba744f388e90743633d3fb6675c865"}
Jul 08 23:31:27.166347 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:27.166246    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7" event={"ID":"51b797f5-6d5c-44df-b382-20a60f62b4f6","Type":"ContainerDied","Data":"fe09dcf7b922bdd2a1a6877f9612b9b28304c22137b1208371952d08eb1dde7b"}
Jul 08 23:31:27.166347 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:27.166281    2574 scope.go:117] "RemoveContainer" containerID="38d6d97517669ba90c29da408ea9c7aefcba744f388e90743633d3fb6675c865"
Jul 08 23:31:27.176253 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:27.176233    2574 scope.go:117] "RemoveContainer" containerID="c116bcc6f28293ddad41c9afb9ab867cb677f876b0a99126ea195a9ddcf14561"
Jul 08 23:31:27.185155 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:27.185135    2574 scope.go:117] "RemoveContainer" containerID="38d6d97517669ba90c29da408ea9c7aefcba744f388e90743633d3fb6675c865"
Jul 08 23:31:27.185472 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:31:27.185452    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38d6d97517669ba90c29da408ea9c7aefcba744f388e90743633d3fb6675c865\": container with ID starting with 38d6d97517669ba90c29da408ea9c7aefcba744f388e90743633d3fb6675c865 not found: ID does not exist" containerID="38d6d97517669ba90c29da408ea9c7aefcba744f388e90743633d3fb6675c865"
Jul 08 23:31:27.185525 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:27.185481    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38d6d97517669ba90c29da408ea9c7aefcba744f388e90743633d3fb6675c865"} err="failed to get container status \"38d6d97517669ba90c29da408ea9c7aefcba744f388e90743633d3fb6675c865\": rpc error: code = NotFound desc = could not find container \"38d6d97517669ba90c29da408ea9c7aefcba744f388e90743633d3fb6675c865\": container with ID starting with 38d6d97517669ba90c29da408ea9c7aefcba744f388e90743633d3fb6675c865 not found: ID does not exist"
Jul 08 23:31:27.185525 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:27.185500    2574 scope.go:117] "RemoveContainer" containerID="c116bcc6f28293ddad41c9afb9ab867cb677f876b0a99126ea195a9ddcf14561"
Jul 08 23:31:27.185794 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:31:27.185774    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c116bcc6f28293ddad41c9afb9ab867cb677f876b0a99126ea195a9ddcf14561\": container with ID starting with c116bcc6f28293ddad41c9afb9ab867cb677f876b0a99126ea195a9ddcf14561 not found: ID does not exist" containerID="c116bcc6f28293ddad41c9afb9ab867cb677f876b0a99126ea195a9ddcf14561"
Jul 08 23:31:27.185857 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:27.185801    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c116bcc6f28293ddad41c9afb9ab867cb677f876b0a99126ea195a9ddcf14561"} err="failed to get container status \"c116bcc6f28293ddad41c9afb9ab867cb677f876b0a99126ea195a9ddcf14561\": rpc error: code = NotFound desc = could not find container \"c116bcc6f28293ddad41c9afb9ab867cb677f876b0a99126ea195a9ddcf14561\": container with ID starting with c116bcc6f28293ddad41c9afb9ab867cb677f876b0a99126ea195a9ddcf14561 not found: ID does not exist"
Jul 08 23:31:27.190798 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:27.190768    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"]
Jul 08 23:31:27.198167 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:27.198124    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-77dfb5-openshift-default-6df66f8699-g4vq7"]
Jul 08 23:31:27.502544 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:27.502458    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51b797f5-6d5c-44df-b382-20a60f62b4f6" path="/var/lib/kubelet/pods/51b797f5-6d5c-44df-b382-20a60f62b4f6/volumes"
Jul 08 23:31:28.098571 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:28.098535    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"]
Jul 08 23:31:28.098791 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:28.098768    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj" podUID="7c72101f-6a24-4059-8252-04ae331b838e" containerName="istio-proxy" containerID="cri-o://33856ab16b3ccf87c75820a25a34a38d6c70e179082bcf09a6626c3f3c807e82" gracePeriod=30
Jul 08 23:31:28.747747 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:28.747713    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75df5b66fd-xbmtk_13dc0fb8-1e25-44b9-9467-081366a2eab2/authorino/0.log"
Jul 08 23:31:32.106203 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:32.106171    2574 patch_prober.go:28] interesting pod/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 23:31:32.106587 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:32.106239    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj" podUID="7c72101f-6a24-4059-8252-04ae331b838e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 23:31:33.200091 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.200059    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-b98w5_ca3d7e84-75b4-441c-93a5-ab9846083f63/manager/0.log"
Jul 08 23:31:33.316681 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.316646    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kkns2_9332cd0f-fc0d-4894-ad31-d3874637f74f/manager/0.log"
Jul 08 23:31:33.363876 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.363810    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:31:33.388114 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.388078    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c72101f-6a24-4059-8252-04ae331b838e-istio-token\") pod \"7c72101f-6a24-4059-8252-04ae331b838e\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") "
Jul 08 23:31:33.388289 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.388127    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-istio-envoy\") pod \"7c72101f-6a24-4059-8252-04ae331b838e\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") "
Jul 08 23:31:33.388289 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.388182    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-istio-data\") pod \"7c72101f-6a24-4059-8252-04ae331b838e\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") "
Jul 08 23:31:33.388289 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.388213    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mstcv\" (UniqueName: \"kubernetes.io/projected/7c72101f-6a24-4059-8252-04ae331b838e-kube-api-access-mstcv\") pod \"7c72101f-6a24-4059-8252-04ae331b838e\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") "
Jul 08 23:31:33.388289 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.388284    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-credential-socket\") pod \"7c72101f-6a24-4059-8252-04ae331b838e\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") "
Jul 08 23:31:33.388528 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.388331    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-workload-socket\") pod \"7c72101f-6a24-4059-8252-04ae331b838e\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") "
Jul 08 23:31:33.388528 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.388360    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-workload-certs\") pod \"7c72101f-6a24-4059-8252-04ae331b838e\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") "
Jul 08 23:31:33.388528 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.388403    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c72101f-6a24-4059-8252-04ae331b838e-istiod-ca-cert\") pod \"7c72101f-6a24-4059-8252-04ae331b838e\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") "
Jul 08 23:31:33.388528 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.388427    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c72101f-6a24-4059-8252-04ae331b838e-istio-podinfo\") pod \"7c72101f-6a24-4059-8252-04ae331b838e\" (UID: \"7c72101f-6a24-4059-8252-04ae331b838e\") "
Jul 08 23:31:33.388758 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.388671    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7c72101f-6a24-4059-8252-04ae331b838e" (UID: "7c72101f-6a24-4059-8252-04ae331b838e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:31:33.388839 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.388770    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-workload-certs\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:33.388985 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.388938    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7c72101f-6a24-4059-8252-04ae331b838e" (UID: "7c72101f-6a24-4059-8252-04ae331b838e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:31:33.389162 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.388980    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7c72101f-6a24-4059-8252-04ae331b838e" (UID: "7c72101f-6a24-4059-8252-04ae331b838e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:31:33.389255 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.389158    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-istio-data" (OuterVolumeSpecName: "istio-data") pod "7c72101f-6a24-4059-8252-04ae331b838e" (UID: "7c72101f-6a24-4059-8252-04ae331b838e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:31:33.389465 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.389435    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c72101f-6a24-4059-8252-04ae331b838e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7c72101f-6a24-4059-8252-04ae331b838e" (UID: "7c72101f-6a24-4059-8252-04ae331b838e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:31:33.390912 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.390885    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7c72101f-6a24-4059-8252-04ae331b838e" (UID: "7c72101f-6a24-4059-8252-04ae331b838e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:31:33.390912 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.390898    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7c72101f-6a24-4059-8252-04ae331b838e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7c72101f-6a24-4059-8252-04ae331b838e" (UID: "7c72101f-6a24-4059-8252-04ae331b838e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:31:33.391097 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.390977    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c72101f-6a24-4059-8252-04ae331b838e-kube-api-access-mstcv" (OuterVolumeSpecName: "kube-api-access-mstcv") pod "7c72101f-6a24-4059-8252-04ae331b838e" (UID: "7c72101f-6a24-4059-8252-04ae331b838e"). InnerVolumeSpecName "kube-api-access-mstcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:31:33.391162 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.391105    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c72101f-6a24-4059-8252-04ae331b838e-istio-token" (OuterVolumeSpecName: "istio-token") pod "7c72101f-6a24-4059-8252-04ae331b838e" (UID: "7c72101f-6a24-4059-8252-04ae331b838e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:31:33.433896 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.433868    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-795d44945-w2s42_f9e60fc3-7d05-45c1-a49a-377f22343f32/manager/0.log"
Jul 08 23:31:33.489970 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.489936    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c72101f-6a24-4059-8252-04ae331b838e-istio-token\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:33.489970 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.489967    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-istio-envoy\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:33.489970 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.489975    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-istio-data\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:33.490173 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.489984    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mstcv\" (UniqueName: \"kubernetes.io/projected/7c72101f-6a24-4059-8252-04ae331b838e-kube-api-access-mstcv\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:33.490173 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.489994    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-credential-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:33.490173 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.490004    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c72101f-6a24-4059-8252-04ae331b838e-workload-socket\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:33.490173 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.490012    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c72101f-6a24-4059-8252-04ae331b838e-istiod-ca-cert\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:33.490173 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.490019    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c72101f-6a24-4059-8252-04ae331b838e-istio-podinfo\") on node \"ip-10-0-143-70.ec2.internal\" DevicePath \"\""
Jul 08 23:31:33.556049 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.556017    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wmvmk_b9ee0f00-4ff3-4819-ba88-407e6d60d84e/server/0.log"
Jul 08 23:31:33.665847 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.665813    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-s2swb_6b517962-b288-42b5-a632-cf87e4f27d69/manager/0.log"
Jul 08 23:31:33.894354 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.894328    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d776fd96-676v4_2376bf68-4318-45a0-9c91-c196290fbf9c/copy-manifests/0.log"
Jul 08 23:31:33.900437 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:33.900410    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d776fd96-676v4_2376bf68-4318-45a0-9c91-c196290fbf9c/manager/0.log"
Jul 08 23:31:34.205845 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.205805    2574 generic.go:356] "Generic (PLEG): container finished" podID="7c72101f-6a24-4059-8252-04ae331b838e" containerID="33856ab16b3ccf87c75820a25a34a38d6c70e179082bcf09a6626c3f3c807e82" exitCode=0
Jul 08 23:31:34.206283 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.205862    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"
Jul 08 23:31:34.206283 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.205888    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj" event={"ID":"7c72101f-6a24-4059-8252-04ae331b838e","Type":"ContainerDied","Data":"33856ab16b3ccf87c75820a25a34a38d6c70e179082bcf09a6626c3f3c807e82"}
Jul 08 23:31:34.206283 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.205943    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj" event={"ID":"7c72101f-6a24-4059-8252-04ae331b838e","Type":"ContainerDied","Data":"f8788148db48f5aab2c6c4eac0d41b682d6e04d07c4212af18022d5958d62df3"}
Jul 08 23:31:34.206283 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.205968    2574 scope.go:117] "RemoveContainer" containerID="33856ab16b3ccf87c75820a25a34a38d6c70e179082bcf09a6626c3f3c807e82"
Jul 08 23:31:34.215077 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.215063    2574 scope.go:117] "RemoveContainer" containerID="7eba28126ad21fe6b44884f59a71fe207d051ca2ec19d708ec41c2b8dba02e57"
Jul 08 23:31:34.223273 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.223189    2574 scope.go:117] "RemoveContainer" containerID="33856ab16b3ccf87c75820a25a34a38d6c70e179082bcf09a6626c3f3c807e82"
Jul 08 23:31:34.223642 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:31:34.223620    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33856ab16b3ccf87c75820a25a34a38d6c70e179082bcf09a6626c3f3c807e82\": container with ID starting with 33856ab16b3ccf87c75820a25a34a38d6c70e179082bcf09a6626c3f3c807e82 not found: ID does not exist" containerID="33856ab16b3ccf87c75820a25a34a38d6c70e179082bcf09a6626c3f3c807e82"
Jul 08 23:31:34.223809 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.223656    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33856ab16b3ccf87c75820a25a34a38d6c70e179082bcf09a6626c3f3c807e82"} err="failed to get container status \"33856ab16b3ccf87c75820a25a34a38d6c70e179082bcf09a6626c3f3c807e82\": rpc error: code = NotFound desc = could not find container \"33856ab16b3ccf87c75820a25a34a38d6c70e179082bcf09a6626c3f3c807e82\": container with ID starting with 33856ab16b3ccf87c75820a25a34a38d6c70e179082bcf09a6626c3f3c807e82 not found: ID does not exist"
Jul 08 23:31:34.223809 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.223680    2574 scope.go:117] "RemoveContainer" containerID="7eba28126ad21fe6b44884f59a71fe207d051ca2ec19d708ec41c2b8dba02e57"
Jul 08 23:31:34.224058 ip-10-0-143-70 kubenswrapper[2574]: E0708 23:31:34.224032    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eba28126ad21fe6b44884f59a71fe207d051ca2ec19d708ec41c2b8dba02e57\": container with ID starting with 7eba28126ad21fe6b44884f59a71fe207d051ca2ec19d708ec41c2b8dba02e57 not found: ID does not exist" containerID="7eba28126ad21fe6b44884f59a71fe207d051ca2ec19d708ec41c2b8dba02e57"
Jul 08 23:31:34.224172 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.224061    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eba28126ad21fe6b44884f59a71fe207d051ca2ec19d708ec41c2b8dba02e57"} err="failed to get container status \"7eba28126ad21fe6b44884f59a71fe207d051ca2ec19d708ec41c2b8dba02e57\": rpc error: code = NotFound desc = could not find container \"7eba28126ad21fe6b44884f59a71fe207d051ca2ec19d708ec41c2b8dba02e57\": container with ID starting with 7eba28126ad21fe6b44884f59a71fe207d051ca2ec19d708ec41c2b8dba02e57 not found: ID does not exist"
Jul 08 23:31:34.226772 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.226749    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"]
Jul 08 23:31:34.233061 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.233039    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-5b1175-openshift-default-6d485ddb99-49tgj"]
Jul 08 23:31:34.746060 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.746029    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj_57a4640a-cffb-4320-9ffa-95f17a5e5d83/util/0.log"
Jul 08 23:31:34.752092 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.752061    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj_57a4640a-cffb-4320-9ffa-95f17a5e5d83/pull/0.log"
Jul 08 23:31:34.757471 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.757441    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj_57a4640a-cffb-4320-9ffa-95f17a5e5d83/extract/0.log"
Jul 08 23:31:34.866059 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.866029    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn_7c74ce02-e122-488d-a87e-da70ea922395/util/0.log"
Jul 08 23:31:34.871742 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.871717    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn_7c74ce02-e122-488d-a87e-da70ea922395/pull/0.log"
Jul 08 23:31:34.877188 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.877170    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn_7c74ce02-e122-488d-a87e-da70ea922395/extract/0.log"
Jul 08 23:31:34.987590 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.987562    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8_9d389063-cb2c-44bc-8f3d-95eec45728a0/pull/0.log"
Jul 08 23:31:34.993532 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.993510    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8_9d389063-cb2c-44bc-8f3d-95eec45728a0/extract/0.log"
Jul 08 23:31:34.999218 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:34.999151    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8_9d389063-cb2c-44bc-8f3d-95eec45728a0/util/0.log"
Jul 08 23:31:35.106602 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:35.106574    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d_6f996e62-e3bc-4779-985f-9469aa177d14/pull/0.log"
Jul 08 23:31:35.112481 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:35.112453    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d_6f996e62-e3bc-4779-985f-9469aa177d14/extract/0.log"
Jul 08 23:31:35.117806 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:35.117787    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d_6f996e62-e3bc-4779-985f-9469aa177d14/util/0.log"
Jul 08 23:31:35.232817 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:35.232787    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75df5b66fd-xbmtk_13dc0fb8-1e25-44b9-9467-081366a2eab2/authorino/0.log"
Jul 08 23:31:35.343503 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:35.343419    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nvmvt_caed00df-5082-4dbd-bc5e-0fec788c93c2/manager/0.log"
Jul 08 23:31:35.502193 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:35.502156    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c72101f-6a24-4059-8252-04ae331b838e" path="/var/lib/kubelet/pods/7c72101f-6a24-4059-8252-04ae331b838e/volumes"
Jul 08 23:31:35.556110 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:35.556082    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-n9wnq_1c2ba35f-a6bf-44e9-8fd9-35d83d30802d/kuadrant-console-plugin/0.log"
Jul 08 23:31:35.665571 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:35.665539    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8qvtg_c332f4df-54db-4e20-9599-a9a08b0682e7/registry-server/0.log"
Jul 08 23:31:35.784497 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:35.784465    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fng6d_586ee5be-92ef-4c37-8028-b48c0a97833b/manager/0.log"
Jul 08 23:31:36.355132 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:36.355097    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678z8p58_d33b5f1d-e61b-40b6-b75b-52c78dcdd44d/istio-proxy/0.log"
Jul 08 23:31:36.588287 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:36.588261    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78df955549-gjp2q_70783537-4fee-4553-8ea6-1e67a1866ee9/kube-auth-proxy/0.log"
Jul 08 23:31:36.807197 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:36.807164    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-d86tq_bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce/istio-proxy/1.log"
Jul 08 23:31:37.039406 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:37.039375    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-28k6f_09f0ce99-c32f-4570-9668-06abf6268ae1/payload-processing/0.log"
Jul 08 23:31:37.593578 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:37.593548    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-tj9x8_9405d7be-7479-4bc9-84fa-004b6362d13e/main/0.log"
Jul 08 23:31:37.929212 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:37.929177    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-hll64_ac31ec2e-983e-4f01-a043-d9dcdc633399/main/0.log"
Jul 08 23:31:42.251849 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.251816    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c9xpw/must-gather-t6nks"]
Jul 08 23:31:42.252379 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.252295    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51b797f5-6d5c-44df-b382-20a60f62b4f6" containerName="istio-proxy"
Jul 08 23:31:42.252379 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.252314    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b797f5-6d5c-44df-b382-20a60f62b4f6" containerName="istio-proxy"
Jul 08 23:31:42.252379 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.252328    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c72101f-6a24-4059-8252-04ae331b838e" containerName="istio-proxy"
Jul 08 23:31:42.252379 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.252337    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c72101f-6a24-4059-8252-04ae331b838e" containerName="istio-proxy"
Jul 08 23:31:42.252379 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.252353    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51b797f5-6d5c-44df-b382-20a60f62b4f6" containerName="istio-proxy"
Jul 08 23:31:42.252379 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.252361    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b797f5-6d5c-44df-b382-20a60f62b4f6" containerName="istio-proxy"
Jul 08 23:31:42.252622 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.252387    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2b762fd-a1f3-47f8-9414-d7ba146fa26e" containerName="main"
Jul 08 23:31:42.252622 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.252396    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2b762fd-a1f3-47f8-9414-d7ba146fa26e" containerName="main"
Jul 08 23:31:42.252622 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.252502    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2b762fd-a1f3-47f8-9414-d7ba146fa26e" containerName="main"
Jul 08 23:31:42.252622 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.252517    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c72101f-6a24-4059-8252-04ae331b838e" containerName="istio-proxy"
Jul 08 23:31:42.252622 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.252526    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="51b797f5-6d5c-44df-b382-20a60f62b4f6" containerName="istio-proxy"
Jul 08 23:31:42.252622 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.252533    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c72101f-6a24-4059-8252-04ae331b838e" containerName="istio-proxy"
Jul 08 23:31:42.252622 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.252588    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c72101f-6a24-4059-8252-04ae331b838e" containerName="istio-proxy"
Jul 08 23:31:42.252622 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.252594    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c72101f-6a24-4059-8252-04ae331b838e" containerName="istio-proxy"
Jul 08 23:31:42.252897 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.252659    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="51b797f5-6d5c-44df-b382-20a60f62b4f6" containerName="istio-proxy"
Jul 08 23:31:42.256975 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.256959    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9xpw/must-gather-t6nks"
Jul 08 23:31:42.259745 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.259723    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c9xpw\"/\"kube-root-ca.crt\""
Jul 08 23:31:42.261110 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.261091    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c9xpw\"/\"openshift-service-ca.crt\""
Jul 08 23:31:42.261236 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.261222    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c9xpw\"/\"default-dockercfg-nlb47\""
Jul 08 23:31:42.264473 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.264450    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9xpw/must-gather-t6nks"]
Jul 08 23:31:42.369811 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.369772    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c7c477b4-40f3-449c-96aa-d9968cefcef8-must-gather-output\") pod \"must-gather-t6nks\" (UID: \"c7c477b4-40f3-449c-96aa-d9968cefcef8\") " pod="openshift-must-gather-c9xpw/must-gather-t6nks"
Jul 08 23:31:42.370001 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.369850    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5p8q\" (UniqueName: \"kubernetes.io/projected/c7c477b4-40f3-449c-96aa-d9968cefcef8-kube-api-access-b5p8q\") pod \"must-gather-t6nks\" (UID: \"c7c477b4-40f3-449c-96aa-d9968cefcef8\") " pod="openshift-must-gather-c9xpw/must-gather-t6nks"
Jul 08 23:31:42.470870 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.470826    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5p8q\" (UniqueName: \"kubernetes.io/projected/c7c477b4-40f3-449c-96aa-d9968cefcef8-kube-api-access-b5p8q\") pod \"must-gather-t6nks\" (UID: \"c7c477b4-40f3-449c-96aa-d9968cefcef8\") " pod="openshift-must-gather-c9xpw/must-gather-t6nks"
Jul 08 23:31:42.471054 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.470886    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c7c477b4-40f3-449c-96aa-d9968cefcef8-must-gather-output\") pod \"must-gather-t6nks\" (UID: \"c7c477b4-40f3-449c-96aa-d9968cefcef8\") " pod="openshift-must-gather-c9xpw/must-gather-t6nks"
Jul 08 23:31:42.471181 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.471166    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c7c477b4-40f3-449c-96aa-d9968cefcef8-must-gather-output\") pod \"must-gather-t6nks\" (UID: \"c7c477b4-40f3-449c-96aa-d9968cefcef8\") " pod="openshift-must-gather-c9xpw/must-gather-t6nks"
Jul 08 23:31:42.481066 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.481033    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5p8q\" (UniqueName: \"kubernetes.io/projected/c7c477b4-40f3-449c-96aa-d9968cefcef8-kube-api-access-b5p8q\") pod \"must-gather-t6nks\" (UID: \"c7c477b4-40f3-449c-96aa-d9968cefcef8\") " pod="openshift-must-gather-c9xpw/must-gather-t6nks"
Jul 08 23:31:42.567427 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.567335    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9xpw/must-gather-t6nks"
Jul 08 23:31:42.721738 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.721711    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9xpw/must-gather-t6nks"]
Jul 08 23:31:42.723525 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:31:42.723498    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7c477b4_40f3_449c_96aa_d9968cefcef8.slice/crio-acb2d780d4a4d76afaa42e4f1020707f768cbd9822dc48eebad1e51e0da0e441 WatchSource:0}: Error finding container acb2d780d4a4d76afaa42e4f1020707f768cbd9822dc48eebad1e51e0da0e441: Status 404 returned error can't find the container with id acb2d780d4a4d76afaa42e4f1020707f768cbd9822dc48eebad1e51e0da0e441
Jul 08 23:31:42.725454 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:42.725436    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 23:31:43.257082 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:43.257041    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9xpw/must-gather-t6nks" event={"ID":"c7c477b4-40f3-449c-96aa-d9968cefcef8","Type":"ContainerStarted","Data":"acb2d780d4a4d76afaa42e4f1020707f768cbd9822dc48eebad1e51e0da0e441"}
Jul 08 23:31:44.267835 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:44.267527    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9xpw/must-gather-t6nks" event={"ID":"c7c477b4-40f3-449c-96aa-d9968cefcef8","Type":"ContainerStarted","Data":"7a0206b28f5e3fc0a612c2e96c1834be0a235be6e2f8189965db1498ae1fa2da"}
Jul 08 23:31:44.267835 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:44.267585    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9xpw/must-gather-t6nks" event={"ID":"c7c477b4-40f3-449c-96aa-d9968cefcef8","Type":"ContainerStarted","Data":"4166d4bab578ce781c5cd3c3a9d17f587f8eaf15b1498af9d412c3aae6629c91"}
Jul 08 23:31:44.286922 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:44.286860    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c9xpw/must-gather-t6nks" podStartSLOduration=1.335565884 podStartE2EDuration="2.28683906s" totalImagesPullingTime="951.273176ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:31:44.283205031 +0000 UTC m=+2679.307787037" watchObservedRunningTime="2026-07-08 23:31:44.28683906 +0000 UTC m=+2679.311421065"
Jul 08 23:31:45.196006 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:45.195969    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4sd78_9d56c9bb-23d5-45f4-ac28-b73d088da22d/global-pull-secret-syncer/0.log"
Jul 08 23:31:45.389504 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:45.389474    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zmwdz_9a616ad8-cd7d-41ed-b42e-3cd2e8cc4db8/konnectivity-agent/0.log"
Jul 08 23:31:45.453270 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:45.453165    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-70.ec2.internal_ff9df22879b0b8b1cf1cf0c7d2186ee4/haproxy/0.log"
Jul 08 23:31:50.132431 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:50.132391    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj_57a4640a-cffb-4320-9ffa-95f17a5e5d83/extract/0.log"
Jul 08 23:31:50.155247 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:50.155217    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj_57a4640a-cffb-4320-9ffa-95f17a5e5d83/util/0.log"
Jul 08 23:31:50.183870 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:50.183828    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6lj_57a4640a-cffb-4320-9ffa-95f17a5e5d83/pull/0.log"
Jul 08 23:31:50.209703 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:50.209659    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn_7c74ce02-e122-488d-a87e-da70ea922395/extract/0.log"
Jul 08 23:31:50.236516 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:50.236489    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn_7c74ce02-e122-488d-a87e-da70ea922395/util/0.log"
Jul 08 23:31:50.256287 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:50.256219    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sz6nn_7c74ce02-e122-488d-a87e-da70ea922395/pull/0.log"
Jul 08 23:31:50.289882 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:50.289848    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8_9d389063-cb2c-44bc-8f3d-95eec45728a0/extract/0.log"
Jul 08 23:31:50.327144 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:50.327108    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8_9d389063-cb2c-44bc-8f3d-95eec45728a0/util/0.log"
Jul 08 23:31:50.348491 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:50.348463    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps2l8_9d389063-cb2c-44bc-8f3d-95eec45728a0/pull/0.log"
Jul 08 23:31:50.376263 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:50.376217    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d_6f996e62-e3bc-4779-985f-9469aa177d14/extract/0.log"
Jul 08 23:31:50.397343 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:50.397240    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d_6f996e62-e3bc-4779-985f-9469aa177d14/util/0.log"
Jul 08 23:31:50.417701 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:50.417657    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tpf2d_6f996e62-e3bc-4779-985f-9469aa177d14/pull/0.log"
Jul 08 23:31:50.806047 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:50.805959    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75df5b66fd-xbmtk_13dc0fb8-1e25-44b9-9467-081366a2eab2/authorino/0.log"
Jul 08 23:31:50.849419 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:50.849389    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nvmvt_caed00df-5082-4dbd-bc5e-0fec788c93c2/manager/0.log"
Jul 08 23:31:50.895380 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:50.895352    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-n9wnq_1c2ba35f-a6bf-44e9-8fd9-35d83d30802d/kuadrant-console-plugin/0.log"
Jul 08 23:31:50.943517 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:50.943485    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8qvtg_c332f4df-54db-4e20-9599-a9a08b0682e7/registry-server/0.log"
Jul 08 23:31:51.153657 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:51.153628    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fng6d_586ee5be-92ef-4c37-8028-b48c0a97833b/manager/0.log"
Jul 08 23:31:53.264211 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:53.264156    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nprhm_c454d9a2-e484-44ac-bf0f-4e1788ade819/node-exporter/0.log"
Jul 08 23:31:53.284334 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:53.284253    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nprhm_c454d9a2-e484-44ac-bf0f-4e1788ade819/kube-rbac-proxy/0.log"
Jul 08 23:31:53.307142 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:53.307117    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nprhm_c454d9a2-e484-44ac-bf0f-4e1788ade819/init-textfile/0.log"
Jul 08 23:31:53.757750 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:53.757712    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7df9c7b9f7-qspdg_ad7a6e39-c232-41ba-9954-03f38ea49774/telemeter-client/0.log"
Jul 08 23:31:53.780879 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:53.780852    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7df9c7b9f7-qspdg_ad7a6e39-c232-41ba-9954-03f38ea49774/reload/0.log"
Jul 08 23:31:53.813630 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:53.813598    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7df9c7b9f7-qspdg_ad7a6e39-c232-41ba-9954-03f38ea49774/kube-rbac-proxy/0.log"
Jul 08 23:31:55.886000 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:55.885960    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"]
Jul 08 23:31:55.891892 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:55.891861    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:55.901453 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:55.901422    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"]
Jul 08 23:31:56.029861 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.029811    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwrvq\" (UniqueName: \"kubernetes.io/projected/287e8b5c-0175-48e9-afc6-495770914d04-kube-api-access-pwrvq\") pod \"perf-node-gather-daemonset-tg6zd\" (UID: \"287e8b5c-0175-48e9-afc6-495770914d04\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:56.030058 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.029957    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/287e8b5c-0175-48e9-afc6-495770914d04-proc\") pod \"perf-node-gather-daemonset-tg6zd\" (UID: \"287e8b5c-0175-48e9-afc6-495770914d04\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:56.030058 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.029992    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/287e8b5c-0175-48e9-afc6-495770914d04-podres\") pod \"perf-node-gather-daemonset-tg6zd\" (UID: \"287e8b5c-0175-48e9-afc6-495770914d04\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:56.030181 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.030105    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/287e8b5c-0175-48e9-afc6-495770914d04-sys\") pod \"perf-node-gather-daemonset-tg6zd\" (UID: \"287e8b5c-0175-48e9-afc6-495770914d04\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:56.030181 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.030139    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/287e8b5c-0175-48e9-afc6-495770914d04-lib-modules\") pod \"perf-node-gather-daemonset-tg6zd\" (UID: \"287e8b5c-0175-48e9-afc6-495770914d04\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:56.131553 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.131506    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/287e8b5c-0175-48e9-afc6-495770914d04-sys\") pod \"perf-node-gather-daemonset-tg6zd\" (UID: \"287e8b5c-0175-48e9-afc6-495770914d04\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:56.131764 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.131572    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/287e8b5c-0175-48e9-afc6-495770914d04-lib-modules\") pod \"perf-node-gather-daemonset-tg6zd\" (UID: \"287e8b5c-0175-48e9-afc6-495770914d04\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:56.131764 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.131655    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/287e8b5c-0175-48e9-afc6-495770914d04-sys\") pod \"perf-node-gather-daemonset-tg6zd\" (UID: \"287e8b5c-0175-48e9-afc6-495770914d04\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:56.131764 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.131704    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwrvq\" (UniqueName: \"kubernetes.io/projected/287e8b5c-0175-48e9-afc6-495770914d04-kube-api-access-pwrvq\") pod \"perf-node-gather-daemonset-tg6zd\" (UID: \"287e8b5c-0175-48e9-afc6-495770914d04\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:56.131764 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.131749    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/287e8b5c-0175-48e9-afc6-495770914d04-proc\") pod \"perf-node-gather-daemonset-tg6zd\" (UID: \"287e8b5c-0175-48e9-afc6-495770914d04\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:56.131963 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.131778    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/287e8b5c-0175-48e9-afc6-495770914d04-podres\") pod \"perf-node-gather-daemonset-tg6zd\" (UID: \"287e8b5c-0175-48e9-afc6-495770914d04\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:56.131963 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.131785    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/287e8b5c-0175-48e9-afc6-495770914d04-lib-modules\") pod \"perf-node-gather-daemonset-tg6zd\" (UID: \"287e8b5c-0175-48e9-afc6-495770914d04\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:56.131963 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.131830    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/287e8b5c-0175-48e9-afc6-495770914d04-proc\") pod \"perf-node-gather-daemonset-tg6zd\" (UID: \"287e8b5c-0175-48e9-afc6-495770914d04\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:56.131963 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.131932    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/287e8b5c-0175-48e9-afc6-495770914d04-podres\") pod \"perf-node-gather-daemonset-tg6zd\" (UID: \"287e8b5c-0175-48e9-afc6-495770914d04\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:56.141228 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.141150    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwrvq\" (UniqueName: \"kubernetes.io/projected/287e8b5c-0175-48e9-afc6-495770914d04-kube-api-access-pwrvq\") pod \"perf-node-gather-daemonset-tg6zd\" (UID: \"287e8b5c-0175-48e9-afc6-495770914d04\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:56.207929 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.207900    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:56.417315 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.417191    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86d977f7bd-9xxv7_869b44ea-05e1-4b2f-9c1d-c0affcfc6d61/console/0.log"
Jul 08 23:31:56.424849 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:56.424825    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"]
Jul 08 23:31:56.428788 ip-10-0-143-70 kubenswrapper[2574]: W0708 23:31:56.428750    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod287e8b5c_0175_48e9_afc6_495770914d04.slice/crio-5cb85e93890dbb64008849931b3a9bac14cfbffbd603104bf080c8b469b8dd43 WatchSource:0}: Error finding container 5cb85e93890dbb64008849931b3a9bac14cfbffbd603104bf080c8b469b8dd43: Status 404 returned error can't find the container with id 5cb85e93890dbb64008849931b3a9bac14cfbffbd603104bf080c8b469b8dd43
Jul 08 23:31:57.379238 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:57.379140    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd" event={"ID":"287e8b5c-0175-48e9-afc6-495770914d04","Type":"ContainerStarted","Data":"4e4f6c688687d204fd555ca28183c472cd0a4179d5aef095e91b83ee2f027d39"}
Jul 08 23:31:57.379238 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:57.379209    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd" event={"ID":"287e8b5c-0175-48e9-afc6-495770914d04","Type":"ContainerStarted","Data":"5cb85e93890dbb64008849931b3a9bac14cfbffbd603104bf080c8b469b8dd43"}
Jul 08 23:31:57.379821 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:57.379580    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:31:57.396860 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:57.396800    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd" podStartSLOduration=2.396778186 podStartE2EDuration="2.396778186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:31:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:31:57.393653755 +0000 UTC m=+2692.418235761" watchObservedRunningTime="2026-07-08 23:31:57.396778186 +0000 UTC m=+2692.421360191"
Jul 08 23:31:57.990172 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:57.990139    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gbz29_3285face-efa6-4a24-a733-7907738aba93/dns/0.log"
Jul 08 23:31:58.008959 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:58.008931    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gbz29_3285face-efa6-4a24-a733-7907738aba93/kube-rbac-proxy/0.log"
Jul 08 23:31:58.162572 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:58.162537    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ztqww_7d0fc7c7-1e2a-4ab0-9664-3fc4c897e998/dns-node-resolver/0.log"
Jul 08 23:31:58.699871 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:58.699829    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5677c78758-5qjft_7c617de0-afc8-4030-9f3c-1e31a5937fe1/registry/0.log"
Jul 08 23:31:58.767753 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:58.767725    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xnvtv_021e1384-753b-4d72-a772-b89e2bfcd232/node-ca/0.log"
Jul 08 23:31:59.676335 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:59.676308    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678z8p58_d33b5f1d-e61b-40b6-b75b-52c78dcdd44d/istio-proxy/0.log"
Jul 08 23:31:59.894535 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:59.894483    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78df955549-gjp2q_70783537-4fee-4553-8ea6-1e67a1866ee9/kube-auth-proxy/0.log"
Jul 08 23:31:59.945216 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:59.945122    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-d86tq_bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce/istio-proxy/0.log"
Jul 08 23:31:59.982473 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:31:59.982433    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-d86tq_bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce/istio-proxy/1.log"
Jul 08 23:32:00.094180 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:00.094147    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-28k6f_09f0ce99-c32f-4570-9668-06abf6268ae1/payload-processing/0.log"
Jul 08 23:32:00.824334 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:00.824301    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-psmb8_9ec41f12-14d9-462d-b59f-43794e1d4423/serve-healthcheck-canary/0.log"
Jul 08 23:32:01.449472 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:01.449447    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vz8h2_8145d27e-5c12-40dd-bdde-d3af3b19da13/kube-rbac-proxy/0.log"
Jul 08 23:32:01.469380 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:01.469349    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vz8h2_8145d27e-5c12-40dd-bdde-d3af3b19da13/exporter/0.log"
Jul 08 23:32:01.488735 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:01.488707    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vz8h2_8145d27e-5c12-40dd-bdde-d3af3b19da13/extractor/0.log"
Jul 08 23:32:03.407761 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:03.400288    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-tg6zd"
Jul 08 23:32:03.586216 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:03.586189    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-b98w5_ca3d7e84-75b4-441c-93a5-ab9846083f63/manager/0.log"
Jul 08 23:32:03.763521 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:03.763437    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kkns2_9332cd0f-fc0d-4894-ad31-d3874637f74f/manager/0.log"
Jul 08 23:32:03.892232 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:03.892197    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-795d44945-w2s42_f9e60fc3-7d05-45c1-a49a-377f22343f32/manager/0.log"
Jul 08 23:32:03.912321 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:03.912292    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wmvmk_b9ee0f00-4ff3-4819-ba88-407e6d60d84e/server/0.log"
Jul 08 23:32:03.995317 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:03.995268    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-s2swb_6b517962-b288-42b5-a632-cf87e4f27d69/manager/0.log"
Jul 08 23:32:04.149942 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:04.149894    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d776fd96-676v4_2376bf68-4318-45a0-9c91-c196290fbf9c/manager/0.log"
Jul 08 23:32:04.168807 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:04.168777    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d776fd96-676v4_2376bf68-4318-45a0-9c91-c196290fbf9c/copy-manifests/0.log"
Jul 08 23:32:05.693962 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:05.693930    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 23:32:05.695547 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:05.695477    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kb8bv_571e851d-c74f-49ae-93fe-86afecc79768/ovn-acl-logging/0.log"
Jul 08 23:32:06.312321 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:06.312235    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678z8p58_d33b5f1d-e61b-40b6-b75b-52c78dcdd44d/istio-proxy/0.log"
Jul 08 23:32:06.514567 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:06.514536    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78df955549-gjp2q_70783537-4fee-4553-8ea6-1e67a1866ee9/kube-auth-proxy/0.log"
Jul 08 23:32:06.557594 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:06.557556    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-d86tq_bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce/istio-proxy/0.log"
Jul 08 23:32:06.594886 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:06.594817    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-d86tq_bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce/istio-proxy/1.log"
Jul 08 23:32:06.688510 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:06.688472    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-28k6f_09f0ce99-c32f-4570-9668-06abf6268ae1/payload-processing/0.log"
Jul 08 23:32:07.960743 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:07.960711    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678z8p58_d33b5f1d-e61b-40b6-b75b-52c78dcdd44d/istio-proxy/0.log"
Jul 08 23:32:08.159996 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:08.159908    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78df955549-gjp2q_70783537-4fee-4553-8ea6-1e67a1866ee9/kube-auth-proxy/0.log"
Jul 08 23:32:08.191792 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:08.191758    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-d86tq_bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce/istio-proxy/0.log"
Jul 08 23:32:08.230573 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:08.230535    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-d86tq_bcb3dc2f-488d-4ef0-8613-c6fbe6fe68ce/istio-proxy/1.log"
Jul 08 23:32:08.326088 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:08.326049    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-28k6f_09f0ce99-c32f-4570-9668-06abf6268ae1/payload-processing/0.log"
Jul 08 23:32:12.209765 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:12.209734    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-58lmh_977bd50f-ac01-4a5d-8157-89ca6e78fb21/kube-multus/0.log"
Jul 08 23:32:12.233420 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:12.233393    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bcjd8_017f7171-4e43-4468-b4d0-9336ef8bfcee/kube-multus-additional-cni-plugins/0.log"
Jul 08 23:32:12.252314 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:12.252287    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bcjd8_017f7171-4e43-4468-b4d0-9336ef8bfcee/egress-router-binary-copy/0.log"
Jul 08 23:32:12.270376 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:12.270344    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bcjd8_017f7171-4e43-4468-b4d0-9336ef8bfcee/cni-plugins/0.log"
Jul 08 23:32:12.287825 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:12.287790    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bcjd8_017f7171-4e43-4468-b4d0-9336ef8bfcee/bond-cni-plugin/0.log"
Jul 08 23:32:12.306218 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:12.306188    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bcjd8_017f7171-4e43-4468-b4d0-9336ef8bfcee/routeoverride-cni/0.log"
Jul 08 23:32:12.324128 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:12.324102    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bcjd8_017f7171-4e43-4468-b4d0-9336ef8bfcee/whereabouts-cni-bincopy/0.log"
Jul 08 23:32:12.342371 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:12.342336    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bcjd8_017f7171-4e43-4468-b4d0-9336ef8bfcee/whereabouts-cni/0.log"
Jul 08 23:32:12.671507 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:12.671474    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8kgb8_b3eb825e-1dd9-461e-86b2-9fad2fade7e4/network-metrics-daemon/0.log"
Jul 08 23:32:12.687778 ip-10-0-143-70 kubenswrapper[2574]: I0708 23:32:12.687746    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8kgb8_b3eb825e-1dd9-461e-86b2-9fad2fade7e4/kube-rbac-proxy/0.log"