Jul 15 10:19:59.489668 ip-10-0-134-102 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 10:19:59.831403 ip-10-0-134-102 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 10:19:59.831403 ip-10-0-134-102 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 10:19:59.831403 ip-10-0-134-102 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 10:19:59.831403 ip-10-0-134-102 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 10:19:59.831403 ip-10-0-134-102 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 10:19:59.832881 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.832780    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 10:19:59.836844 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836824    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 10:19:59.836844 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836844    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 10:19:59.836844 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836847    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836851    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836854    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836858    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836861    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836863    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836866    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836869    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836872    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836874    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836877    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836881    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836884    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836886    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836889    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836891    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836894    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836896    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836915    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836918    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 10:19:59.836947 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836921    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836923    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836926    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836928    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836931    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836933    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836935    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836938    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836941    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836943    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836946    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836948    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836951    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836954    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836957    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836960    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836962    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836965    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836967    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 10:19:59.837446 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836970    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836972    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836976    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836981    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836984    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836987    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836990    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836993    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836996    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.836999    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837003    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837005    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837009    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837013    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837015    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837020    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837023    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837026    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837029    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 10:19:59.837919 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837031    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837034    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837037    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837039    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837042    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837044    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837047    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837050    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837055    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837058    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837061    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837063    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837066    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837068    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837071    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837073    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837076    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837079    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837081    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837084    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 10:19:59.838397 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837086    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837089    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837091    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837094    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837096    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837099    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837101    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837104    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837107    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837110    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837112    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837115    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837117    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837120    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837122    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837125    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837127    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837130    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837133    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 10:19:59.838858 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837883    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837893    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837897    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837900    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837903    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837906    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837909    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837912    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837914    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837917    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837920    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837923    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837927    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837929    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837932    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837934    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837937    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837939    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837942    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 10:19:59.839295 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837944    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837947    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837950    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837953    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837955    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837958    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837960    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837963    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837965    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837968    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837971    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837974    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837976    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837978    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837981    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837983    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837985    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837991    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837994    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837996    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 10:19:59.839763 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.837999    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838001    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838004    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838006    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838008    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838012    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838016    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838019    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838022    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838024    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838028    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838030    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838032    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838036    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838038    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838041    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838043    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838045    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838048    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838050    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 10:19:59.840310 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838053    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838055    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838058    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838060    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838062    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838065    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838067    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838069    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838072    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838074    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838077    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838079    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838082    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838084    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838087    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838089    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838091    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838094    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838098    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838101    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 10:19:59.840815 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838103    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838106    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838108    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838110    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838113    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838116    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838118    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838120    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838123    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838125    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838127    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838129    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838132    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838134    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838136    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838139    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838141    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838144    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838147    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838151    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 10:19:59.841312 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838570    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838576    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838580    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838583    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838585    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838589    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838591    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838594    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838597    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838600    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838609    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838612    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838615    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838618    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838620    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838623    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838627    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838631    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838634    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 10:19:59.841790 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838636    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838639    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838642    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838644    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838647    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838650    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838652    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838655    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838657    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838660    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838662    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838665    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838667    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838670    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838672    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838674    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838676    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838679    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838681    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 10:19:59.842245 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838684    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838686    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838690    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838693    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838695    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838698    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838701    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838703    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838705    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838709    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838711    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838714    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838716    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838718    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838721    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838723    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838726    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838728    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838730    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838733    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 10:19:59.842701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838735    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838738    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838740    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838742    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838745    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838747    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838749    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838752    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838754    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838758    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838761    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838764    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838766    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838769    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838771    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838774    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838776    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838779    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838781    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 10:19:59.843167 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838785    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838787    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838790    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838792    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838795    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838797    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838800    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838802    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838804    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838807    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838809    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838812    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838814    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838817    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838819    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838821    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838824    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838827    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838829    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838831    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 10:19:59.843635 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838834    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.838836    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838914    2568 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838922    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838929    2568 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838934    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838938    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838941    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838946    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838950    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838954    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838957    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838961    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838965    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838968    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838971    2568 flags.go:64] FLAG: --cgroup-root=""
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838974    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838977    2568 flags.go:64] FLAG: --client-ca-file=""
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838980    2568 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838983    2568 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838988    2568 flags.go:64] FLAG: --cluster-domain=""
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838991    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838994    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.838997    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 10:19:59.844110 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839000    2568 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839004    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839007    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839010    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839013    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839016    2568 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839019    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839022    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839025    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839028    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839032    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839035    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839037    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839040    2568 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839043    2568 flags.go:64] FLAG: --enable-server="true"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839045    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839052    2568 flags.go:64] FLAG: --event-burst="100"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839055    2568 flags.go:64] FLAG: --event-qps="50"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839058    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839061    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839064    2568 flags.go:64] FLAG: --eviction-hard=""
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839074    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839077    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839080    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839085    2568 flags.go:64] FLAG: --eviction-soft=""
Jul 15 10:19:59.844720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839088    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839091    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839093    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839096    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839099    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839101    2568 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839104    2568 flags.go:64] FLAG: --feature-gates=""
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839108    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839110    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839113    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839116    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839120    2568 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839122    2568 flags.go:64] FLAG: --help="false"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839126    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-134-102.ec2.internal"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839129    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839131    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839134    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839138    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839141    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839143    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839146    2568 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839149    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839151    2568 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 10:19:59.845339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839155    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839159    2568 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839161    2568 flags.go:64] FLAG: --kube-reserved=""
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839164    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839167    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839169    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839174    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839177    2568 flags.go:64] FLAG: --lock-file=""
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839182    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839184    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839187    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839192    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839195    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839198    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839200    2568 flags.go:64] FLAG: --logging-format="text"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839203    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839206    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839209    2568 flags.go:64] FLAG: --manifest-url=""
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839212    2568 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839216    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839219    2568 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839223    2568 flags.go:64] FLAG: --max-pods="110"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839226    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839229    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839232    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 10:19:59.846091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839235    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839237    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839240    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839243    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839250    2568 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839253    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839256    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839261    2568 flags.go:64] FLAG: --pod-cidr=""
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839263    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839269    2568 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839272    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839275    2568 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839278    2568 flags.go:64] FLAG: --port="10250"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839281    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839284    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00b60b4882ab5f946"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839287    2568 flags.go:64] FLAG: --qos-reserved=""
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839292    2568 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839295    2568 flags.go:64] FLAG: --register-node="true"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839298    2568 flags.go:64] FLAG: --register-with-taints=""
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839302    2568 flags.go:64] FLAG: --registry-burst="10"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839305    2568 flags.go:64] FLAG: --registry-qps="5"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839307    2568 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839310    2568 flags.go:64] FLAG: --reserved-memory=""
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839314    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839317    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 10:19:59.846704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839320    2568 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839323    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839325    2568 flags.go:64] FLAG: --runonce="false"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839328    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839331    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839334    2568 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839336    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839339    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839342    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839359    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839362    2568 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839365    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839368    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839371    2568 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839374    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839378    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839380    2568 flags.go:64] FLAG: --system-cgroups=""
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839383    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839388    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839391    2568 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839394    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839398    2568 flags.go:64] FLAG: --tls-min-version=""
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839402    2568 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839406    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839409    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 10:19:59.847302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839411    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839414    2568 flags.go:64] FLAG: --v="2"
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839418    2568 flags.go:64] FLAG: --version="false"
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839422    2568 flags.go:64] FLAG: --vmodule=""
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839426    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839429    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839549    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839552    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839556    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839559    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839562    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839564    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839567    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839570    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839572    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839575    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839578    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839580    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839582    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839585    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839587    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 10:19:59.847920 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839592    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839596    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839599    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839601    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839604    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839606    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839609    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839611    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839615    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839621    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839624    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839627    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839630    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839632    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839635    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839638    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839641    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839644    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839646    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 10:19:59.848488 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839649    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839652    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839655    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839657    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839661    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839664    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839666    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839669    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839672    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839674    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839676    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839679    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839681    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839685    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839688    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839690    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839692    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839695    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839697    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 10:19:59.848945 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839700    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839702    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839704    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839708    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839711    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839714    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839716    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839718    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839721    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839723    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839726    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839728    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839731    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839733    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839735    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839738    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839740    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839743    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839746    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 10:19:59.849538 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839748    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839751    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839753    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839756    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839759    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839761    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839764    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839768    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839771    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839773    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839776    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839779    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839781    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839784    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839786    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839789    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839792    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839795    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839797    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839800    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 10:19:59.849992 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839802    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 10:19:59.850495 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839805    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 10:19:59.850495 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839808    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 10:19:59.850495 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839810    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 10:19:59.850495 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839812    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 10:19:59.850495 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839815    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 10:19:59.850495 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.839817    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 10:19:59.850495 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.839823    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 10:19:59.850495 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.847514    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 10:19:59.850495 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.847536    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 10:19:59.850495 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.848404    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 10:19:59.850495 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.848412    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 10:19:59.850495 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848484    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 10:19:59.850495 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848491    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 10:19:59.850495 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848497    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 10:19:59.850495 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848500    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848503    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848506    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848508    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848511    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848514    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848516    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848519    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848522    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848524    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848527    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848529    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848532    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848535    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848538    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848540    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848543    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848545    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848549    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 10:19:59.850863 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848553    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848556    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848559    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848562    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848565    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848568    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848570    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848579    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848582    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848586    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848589    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848592    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848595    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848598    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848600    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848603    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848605    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848608    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848611    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 10:19:59.851294 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848614    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848616    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848619    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848622    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848624    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848626    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848629    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848632    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848634    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848637    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848639    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848642    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848644    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848647    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848649    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848652    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848654    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848657    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848660    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848663    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 10:19:59.851766 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848665    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848674    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848676    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848679    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848681    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848684    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848686    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848689    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848691    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848694    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848696    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848699    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848701    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848704    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848707    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848709    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848712    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848715    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848717    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848720    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 10:19:59.852297 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848722    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 10:19:59.852823 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848725    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 10:19:59.852823 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848727    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 10:19:59.852823 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848730    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 10:19:59.852823 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848733    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 10:19:59.852823 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848735    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 10:19:59.852823 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848737    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 10:19:59.852823 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848740    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 10:19:59.852823 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848743    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 10:19:59.852823 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848745    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 10:19:59.852823 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848748    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 10:19:59.852823 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848750    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 10:19:59.852823 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848753    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 10:19:59.852823 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848755    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 10:19:59.852823 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848763    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 10:19:59.852823 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848766    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 10:19:59.852823 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848768    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 10:19:59.852823 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848771    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 10:19:59.853241 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.848776    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 10:19:59.853241 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848956    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 10:19:59.853241 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848962    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 10:19:59.853241 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848965    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 10:19:59.853241 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848968    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 10:19:59.853241 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848971    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 10:19:59.853241 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848974    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 10:19:59.853241 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848976    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 10:19:59.853241 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848979    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 10:19:59.853241 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848981    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 10:19:59.853241 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848983    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 10:19:59.853241 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848986    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 10:19:59.853241 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848988    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 10:19:59.853241 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848991    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848993    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.848997    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849001    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849005    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849007    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849010    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849012    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849015    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849017    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849020    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849024    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849028    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849030    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849033    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849036    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849044    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849047    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849050    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 10:19:59.853644 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849052    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849055    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849057    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849059    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849062    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849065    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849067    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849070    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849072    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849074    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849077    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849079    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849082    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849084    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849087    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849089    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849091    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849094    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849096    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849098    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 10:19:59.854096 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849101    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849103    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849106    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849109    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849111    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849114    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849116    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849118    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849121    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849124    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849132    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849135    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849137    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849140    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849142    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849144    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849147    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849150    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849152    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849154    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 10:19:59.854597 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849157    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849159    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849161    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849164    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849166    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849168    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849171    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849173    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849176    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849178    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849181    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849183    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849186    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849188    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849192    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849196    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849199    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849201    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849204    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 10:19:59.855077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849206    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 10:19:59.855541 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849211    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 10:19:59.855541 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849214    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 10:19:59.855541 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849216    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 10:19:59.855541 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849225    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 10:19:59.855541 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849228    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 10:19:59.855541 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849230    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 10:19:59.855541 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849233    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 10:19:59.855541 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:19:59.849235    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 10:19:59.855541 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.849240    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 10:19:59.855541 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.849430    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 10:19:59.855541 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.852266    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 10:19:59.855541 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.853435    2568 server.go:1019] "Starting client certificate rotation"
Jul 15 10:19:59.855541 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.853537    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 10:19:59.855541 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.853570    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 10:19:59.855917 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.855826    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 10:19:59.859725 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.859692    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 10:19:59.866869 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.866847    2568 log.go:25] "Validated CRI v1 runtime API"
Jul 15 10:19:59.868805 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.868788    2568 log.go:25] "Validated CRI v1 image API"
Jul 15 10:19:59.870916 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.870898    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 10:19:59.873039 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.873018    2568 fs.go:135] Filesystem UUIDs: map[3ecbf29a-c2d7-457a-a7c3-9ceecf96eb2e:/dev/nvme0n1p3 4b3f3811-6d41-4cfc-9b90-e972c5a726da:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 15 10:19:59.873102 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.873039    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 10:19:59.878722 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.878593    2568 manager.go:216] Machine: {Timestamp:2026-07-15 10:19:59.877504066 +0000 UTC m=+0.275908224 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3184521 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26df3977a88948ae948911c19bc0f5 SystemUUID:ec26df39-77a8-8948-ae94-8911c19bc0f5 BootID:8f1eb22a-8390-4f83-a9ea-50b44dfda60e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9d:fb:96:25:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9d:fb:96:25:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:a0:2c:aa:ff:64 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 10:19:59.878722 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.878711    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 10:19:59.878888 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.878800    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 10:19:59.881395 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.881367    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 10:19:59.881562 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.881399    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-102.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 10:19:59.882801 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.882788    2568 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 10:19:59.882863 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.882808    2568 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 10:19:59.882863 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.882818    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 10:19:59.883388 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.883376    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 10:19:59.884639 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.884626    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 10:19:59.888548 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.888532    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 10:19:59.888897 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.888883    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 10:19:59.889499 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.889488    2568 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 10:19:59.889569 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.889507    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 10:19:59.889569 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.889528    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 10:19:59.889569 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.889543    2568 kubelet.go:398] "Adding apiserver pod source"
Jul 15 10:19:59.889569 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.889557    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 10:19:59.889969 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.889955    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 10:19:59.890040 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.889978    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 10:19:59.893085 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.893069    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 10:19:59.895038 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.895018    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 10:19:59.895093 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.895055    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 10:19:59.895245 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.895236    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 10:19:59.895283 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.895252    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 10:19:59.895283 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.895258    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 10:19:59.895283 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.895264    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 10:19:59.895283 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.895276    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 10:19:59.895283 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.895284    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 10:19:59.895665 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.895657    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 10:19:59.895665 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.895666    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 10:19:59.895724 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.895673    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 10:19:59.895724 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.895678    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 10:19:59.895724 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.895694    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 10:19:59.895724 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.895701    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 10:19:59.896316 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.896306    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 10:19:59.896316 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.896316    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 10:19:59.898418 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.898397    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 10:19:59.899861 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.899841    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-102.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 10:19:59.900056 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.900044    2568 server.go:1268] "Started kubelet"
Jul 15 10:19:59.900108 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:19:59.900081    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 10:19:59.900197 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.900159    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 10:19:59.900262 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.900212    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 10:19:59.900310 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.900287    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 10:19:59.900766 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:19:59.900389    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 10:19:59.901231 ip-10-0-134-102 systemd[1]: Started Kubernetes Kubelet.
Jul 15 10:19:59.903769 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.903750    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 10:19:59.905845 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.905826    2568 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 10:19:59.906069 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:19:59.906044    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 10:19:59.909838 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.909818    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 10:19:59.909838 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.909820    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 10:19:59.910194 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:19:59.909967    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found"
Jul 15 10:19:59.910435 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.910419    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 10:19:59.910520 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.910419    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 10:19:59.910520 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.910461    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 10:19:59.910612 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.910532    2568 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 10:19:59.910612 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.910540    2568 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 10:19:59.911208 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.911180    2568 factory.go:55] Registering systemd factory
Jul 15 10:19:59.911208 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.911201    2568 factory.go:223] Registration of the systemd container factory successfully
Jul 15 10:19:59.911449 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.911427    2568 factory.go:153] Registering CRI-O factory
Jul 15 10:19:59.911449 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.911445    2568 factory.go:223] Registration of the crio container factory successfully
Jul 15 10:19:59.911599 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.911497    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 10:19:59.911599 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.911520    2568 factory.go:103] Registering Raw factory
Jul 15 10:19:59.911599 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.911535    2568 manager.go:1196] Started watching for new ooms in manager
Jul 15 10:19:59.911986 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.911975    2568 manager.go:349] Starting recovery of all containers
Jul 15 10:19:59.912543 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:19:59.911685    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-102.ec2.internal.18c26f51e3fa9879  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-102.ec2.internal,UID:ip-10-0-134-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-102.ec2.internal,},FirstTimestamp:2026-07-15 10:19:59.900022905 +0000 UTC m=+0.298427063,LastTimestamp:2026-07-15 10:19:59.900022905 +0000 UTC m=+0.298427063,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-102.ec2.internal,}"
Jul 15 10:19:59.920628 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.920482    2568 manager.go:354] Recovery completed
Jul 15 10:19:59.922215 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:19:59.922183    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 10:19:59.922215 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:19:59.922194    2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 10:19:59.925590 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.925576    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 10:19:59.926301 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.926285    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8b9c5"
Jul 15 10:19:59.927854 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.927835    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 10:19:59.927939 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.927874    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 10:19:59.927939 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.927887    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientPID"
Jul 15 10:19:59.928540 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.928524    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 10:19:59.928540 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.928539    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 10:19:59.928636 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.928540    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 10:19:59.928636 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.928607    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 10:19:59.930050 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:19:59.929984    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-102.ec2.internal.18c26f51e5a34bf5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-102.ec2.internal,UID:ip-10-0-134-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-102.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-102.ec2.internal,},FirstTimestamp:2026-07-15 10:19:59.927856117 +0000 UTC m=+0.326260285,LastTimestamp:2026-07-15 10:19:59.927856117 +0000 UTC m=+0.326260285,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-102.ec2.internal,}"
Jul 15 10:19:59.930840 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.930828    2568 policy_none.go:49] "None policy: Start"
Jul 15 10:19:59.930897 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.930845    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 10:19:59.930897 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.930855    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 10:19:59.932318 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.932303    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 10:19:59.932435 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.932331    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 10:19:59.932435 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.932341    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientPID"
Jul 15 10:19:59.932846 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.932833    2568 policy_none.go:47] "Start"
Jul 15 10:19:59.940736 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.940705    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8b9c5"
Jul 15 10:19:59.941639 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:19:59.941567    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-102.ec2.internal.18c26f51e5a3a7f6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-102.ec2.internal,UID:ip-10-0-134-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-102.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-102.ec2.internal,},FirstTimestamp:2026-07-15 10:19:59.92787967 +0000 UTC m=+0.326283828,LastTimestamp:2026-07-15 10:19:59.92787967 +0000 UTC m=+0.326283828,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-102.ec2.internal,}"
Jul 15 10:19:59.944499 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:19:59.944408    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-102.ec2.internal.18c26f51e5a3d237  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-102.ec2.internal,UID:ip-10-0-134-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-102.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-102.ec2.internal,},FirstTimestamp:2026-07-15 10:19:59.927890487 +0000 UTC m=+0.326294644,LastTimestamp:2026-07-15 10:19:59.927890487 +0000 UTC m=+0.326294644,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-102.ec2.internal,}"
Jul 15 10:19:59.973026 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.973000    2568 manager.go:337] "Starting Device Plugin manager"
Jul 15 10:19:59.973141 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:19:59.973045    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 10:19:59.973141 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.973059    2568 server.go:87] "Starting device plugin registration server"
Jul 15 10:19:59.973424 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.973413    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 10:19:59.973472 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.973426    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 10:19:59.973546 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.973525    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 10:19:59.973642 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.973624    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 10:19:59.973642 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:19:59.973640    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 10:19:59.974311 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:19:59.974277    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 10:19:59.974399 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:19:59.974339    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-102.ec2.internal\" not found"
Jul 15 10:20:00.060979 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.060931    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 10:20:00.063263 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.062406    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 10:20:00.063263 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.062449    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 10:20:00.063263 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.062475    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 10:20:00.063263 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:00.062518    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 10:20:00.065201 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.065179    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 10:20:00.073727 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.073700    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 10:20:00.074917 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.074900    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 10:20:00.074996 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.074935    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 10:20:00.074996 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.074946    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientPID"
Jul 15 10:20:00.074996 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.074971    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-102.ec2.internal"
Jul 15 10:20:00.084248 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.084191    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-102.ec2.internal"
Jul 15 10:20:00.084248 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:00.084220    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-102.ec2.internal\": node \"ip-10-0-134-102.ec2.internal\" not found"
Jul 15 10:20:00.095629 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:00.095603    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found"
Jul 15 10:20:00.163668 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.163635    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal"]
Jul 15 10:20:00.163764 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.163719    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 10:20:00.164771 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.164754    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 10:20:00.164862 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.164789    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 10:20:00.164862 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.164803    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientPID"
Jul 15 10:20:00.167245 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.167231    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 10:20:00.167422 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.167406    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal"
Jul 15 10:20:00.167483 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.167443    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 10:20:00.168293 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.168278    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 10:20:00.168396 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.168291    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 10:20:00.168396 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.168310    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 10:20:00.168396 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.168314    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 10:20:00.168396 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.168324    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientPID"
Jul 15 10:20:00.168396 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.168327    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientPID"
Jul 15 10:20:00.170703 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.170688    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal"
Jul 15 10:20:00.170778 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.170717    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 10:20:00.171439 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.171424    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 10:20:00.171534 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.171450    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 10:20:00.171534 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.171463    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientPID"
Jul 15 10:20:00.195924 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:00.195897    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found"
Jul 15 10:20:00.196105 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:00.196090    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-102.ec2.internal\" not found" node="ip-10-0-134-102.ec2.internal"
Jul 15 10:20:00.200752 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:00.200736    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-102.ec2.internal\" not found" node="ip-10-0-134-102.ec2.internal"
Jul 15 10:20:00.211545 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.211526    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b58eee2f6dff32c538b037ed8e3f6b25-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal\" (UID: \"b58eee2f6dff32c538b037ed8e3f6b25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal"
Jul 15 10:20:00.211610 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.211556    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b58eee2f6dff32c538b037ed8e3f6b25-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal\" (UID: \"b58eee2f6dff32c538b037ed8e3f6b25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal"
Jul 15 10:20:00.211610 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.211572    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6fd61ae3c3b82a20bce79ca2b950fe8e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-102.ec2.internal\" (UID: \"6fd61ae3c3b82a20bce79ca2b950fe8e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal"
Jul 15 10:20:00.296812 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:00.296775    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found"
Jul 15 10:20:00.311779 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.311751    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b58eee2f6dff32c538b037ed8e3f6b25-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal\" (UID: \"b58eee2f6dff32c538b037ed8e3f6b25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal"
Jul 15 10:20:00.311850 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.311784    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6fd61ae3c3b82a20bce79ca2b950fe8e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-102.ec2.internal\" (UID: \"6fd61ae3c3b82a20bce79ca2b950fe8e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal"
Jul 15 10:20:00.311850 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.311801    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b58eee2f6dff32c538b037ed8e3f6b25-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal\" (UID: \"b58eee2f6dff32c538b037ed8e3f6b25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal"
Jul 15 10:20:00.311920 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.311859    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b58eee2f6dff32c538b037ed8e3f6b25-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal\" (UID: \"b58eee2f6dff32c538b037ed8e3f6b25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal"
Jul 15 10:20:00.311920 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.311887    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b58eee2f6dff32c538b037ed8e3f6b25-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal\" (UID: \"b58eee2f6dff32c538b037ed8e3f6b25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal"
Jul 15 10:20:00.311920 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.311859    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6fd61ae3c3b82a20bce79ca2b950fe8e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-102.ec2.internal\" (UID: \"6fd61ae3c3b82a20bce79ca2b950fe8e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal"
Jul 15 10:20:00.397177 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:00.397109    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found"
Jul 15 10:20:00.497637 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:00.497600    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found"
Jul 15 10:20:00.497704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.497644    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal"
Jul 15 10:20:00.503819 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.503800    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal"
Jul 15 10:20:00.598127 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:00.598096    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found"
Jul 15 10:20:00.698738 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:00.698668    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found"
Jul 15 10:20:00.742457 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:00.742432    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 10:20:00.799509 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:00.799472    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found"
Jul 15 10:20:02.431725 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:02.431702    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 10:20:02.432215 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:02.431866    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 10:20:02.432215 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:02.431880    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 10:20:02.479200 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:02.479166    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found"
Jul 15 10:20:02.524372 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:02.524323    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 10:15:01 +0000 UTC" deadline="2027-12-14 16:37:51.552299873 +0000 UTC"
Jul 15 10:20:02.524372 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:02.524366    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12414h17m49.027936935s"
Jul 15 10:20:02.579707 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:02.579671    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found"
Jul 15 10:20:02.594142 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:02.594096    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 10:20:02.677459 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:20:02.677417    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58eee2f6dff32c538b037ed8e3f6b25.slice/crio-2e4799791c685d1c82b05411346a74cfbdaaafc3ac68ee4d928b1877cdc68fd6 WatchSource:0}: Error finding container 2e4799791c685d1c82b05411346a74cfbdaaafc3ac68ee4d928b1877cdc68fd6: Status 404 returned error can't find the container with id 2e4799791c685d1c82b05411346a74cfbdaaafc3ac68ee4d928b1877cdc68fd6
Jul 15 10:20:02.681739 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:02.681725    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 10:20:02.689494 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:02.689472    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal"
Jul 15 10:20:02.698105 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:02.698087    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 10:20:02.698882 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:02.698870    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal"
Jul 15 10:20:02.710471 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:02.710451    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 10:20:02.907341 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:02.907253    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 10:20:03.470992 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.470858    2568 apiserver.go:52] "Watching apiserver"
Jul 15 10:20:03.479625 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.479596    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 10:20:03.481168 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.481140    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9","openshift-cluster-node-tuning-operator/tuned-b8wcj","openshift-dns/node-resolver-xlk4p","openshift-multus/multus-8jhqs","openshift-multus/multus-additional-cni-plugins-4cj5h","openshift-image-registry/node-ca-n7pj6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal","openshift-multus/network-metrics-daemon-dbd7d","openshift-network-diagnostics/network-check-target-lxnrt","openshift-network-operator/iptables-alerter-b5px9","openshift-ovn-kubernetes/ovnkube-node-b94br","kube-system/global-pull-secret-syncer-5r2sb","kube-system/konnectivity-agent-dwq9h"]
Jul 15 10:20:03.483729 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.483704    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n7pj6"
Jul 15 10:20:03.485872 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.485847    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:03.486016 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:03.485934    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:03.488174 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.488155    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.489637 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.489618    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 10:20:03.490330 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.490312    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xlk4p"
Jul 15 10:20:03.493146 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.492416    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 10:20:03.493146 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.492446    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.493146 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.492637    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 10:20:03.493146 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.492693    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 10:20:03.493146 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.492719    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hx8sx\""
Jul 15 10:20:03.493146 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.492920    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rgg87\""
Jul 15 10:20:03.493146 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.492921    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 10:20:03.493146 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.492991    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 10:20:03.493146 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.493008    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 10:20:03.493601 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.493580    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-skvt5\""
Jul 15 10:20:03.493601 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.493589    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 10:20:03.494718 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.494700    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 10:20:03.494881 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.494866    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.495408 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.495382    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 10:20:03.495717 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.495702    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 10:20:03.495894 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.495876    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 10:20:03.496308 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.496288    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g4lzv\""
Jul 15 10:20:03.497389 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.497167    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:03.497389 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:03.497234    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:03.497670 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.497642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-run\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.497771 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.497676    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-host\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.497771 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.497704    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 10:20:03.497771 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.497702    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04d03060-07a3-4ce5-a041-d56a227e615c-host\") pod \"node-ca-n7pj6\" (UID: \"04d03060-07a3-4ce5-a041-d56a227e615c\") " pod="openshift-image-registry/node-ca-n7pj6"
Jul 15 10:20:03.497934 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.497768    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-modprobe-d\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.497934 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.497705    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lx6bh\""
Jul 15 10:20:03.497934 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.497800    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-sysconfig\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.497934 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.497823    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-sysctl-d\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.497934 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.497845    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-sysctl-conf\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.497934 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.497859    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-sys\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.497934 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.497880    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-kubernetes\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.498252 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.498076    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 10:20:03.498436 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.498412    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-systemd\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.498524 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.498443    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-var-lib-kubelet\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.498524 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.498494    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-tuned\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.498653 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.498530    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt9vg\" (UniqueName: \"kubernetes.io/projected/0f33f6cd-1763-4502-84a6-75e9069e6b46-kube-api-access-vt9vg\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.498653 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.498554    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/793964cf-e10f-455e-ade5-5724240979d1-hosts-file\") pod \"node-resolver-xlk4p\" (UID: \"793964cf-e10f-455e-ade5-5724240979d1\") " pod="openshift-dns/node-resolver-xlk4p"
Jul 15 10:20:03.498653 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.498579    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/793964cf-e10f-455e-ade5-5724240979d1-tmp-dir\") pod \"node-resolver-xlk4p\" (UID: \"793964cf-e10f-455e-ade5-5724240979d1\") " pod="openshift-dns/node-resolver-xlk4p"
Jul 15 10:20:03.498653 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.498603    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/141455ed-ae53-465c-8979-db50257b660f-kubelet-config\") pod \"global-pull-secret-syncer-5r2sb\" (UID: \"141455ed-ae53-465c-8979-db50257b660f\") " pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:03.498653 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.498626    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-lib-modules\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.498653 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.498647    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f33f6cd-1763-4502-84a6-75e9069e6b46-tmp\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.498955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.498685    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj2lg\" (UniqueName: \"kubernetes.io/projected/793964cf-e10f-455e-ade5-5724240979d1-kube-api-access-cj2lg\") pod \"node-resolver-xlk4p\" (UID: \"793964cf-e10f-455e-ade5-5724240979d1\") " pod="openshift-dns/node-resolver-xlk4p"
Jul 15 10:20:03.498955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.498727    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04d03060-07a3-4ce5-a041-d56a227e615c-serviceca\") pod \"node-ca-n7pj6\" (UID: \"04d03060-07a3-4ce5-a041-d56a227e615c\") " pod="openshift-image-registry/node-ca-n7pj6"
Jul 15 10:20:03.498955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.498761    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsdfd\" (UniqueName: \"kubernetes.io/projected/04d03060-07a3-4ce5-a041-d56a227e615c-kube-api-access-wsdfd\") pod \"node-ca-n7pj6\" (UID: \"04d03060-07a3-4ce5-a041-d56a227e615c\") " pod="openshift-image-registry/node-ca-n7pj6"
Jul 15 10:20:03.498955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.498785    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/141455ed-ae53-465c-8979-db50257b660f-dbus\") pod \"global-pull-secret-syncer-5r2sb\" (UID: \"141455ed-ae53-465c-8979-db50257b660f\") " pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:03.498955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.498810    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret\") pod \"global-pull-secret-syncer-5r2sb\" (UID: \"141455ed-ae53-465c-8979-db50257b660f\") " pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:03.500719 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.499934    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dwq9h"
Jul 15 10:20:03.502957 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.502845    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.503535 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.503512    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 10:20:03.503795 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.503767    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 10:20:03.503986 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.503971    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p44d5\""
Jul 15 10:20:03.505578 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.505556    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 10:20:03.505784 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.505765    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:03.505853 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:03.505837    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:03.506632 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.506617    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-txv7z\""
Jul 15 10:20:03.507204 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.507189    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 10:20:03.507278 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.507250    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 10:20:03.507437 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.507419    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 10:20:03.508631 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.508559    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b5px9"
Jul 15 10:20:03.510955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.510916    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.511433 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.511414    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 10:20:03.511528 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.511475    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 10:20:03.511528 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.511509    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 10:20:03.511528 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.511522    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gn9h8\""
Jul 15 10:20:03.513137 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.513101    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 10:20:03.513356 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.513341    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 10:20:03.513525 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.513509    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 10:20:03.513600 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.513569    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c94h4\""
Jul 15 10:20:03.513653 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.513607    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 10:20:03.514705 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.514675    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 10:20:03.514789 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.514775    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 10:20:03.529464 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.529437    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-t67nl"
Jul 15 10:20:03.539092 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.539066    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t67nl"
Jul 15 10:20:03.590428 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.590398    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 10:20:03.600009 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.599982    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28e62077-4f3c-41b1-a6da-ffd066a86033-ovn-node-metrics-cert\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.600009 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600021    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-kubernetes\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.600276 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600060    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/793964cf-e10f-455e-ade5-5724240979d1-tmp-dir\") pod \"node-resolver-xlk4p\" (UID: \"793964cf-e10f-455e-ade5-5724240979d1\") " pod="openshift-dns/node-resolver-xlk4p"
Jul 15 10:20:03.600276 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600102    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2b9d577-b496-4c9f-81d1-888e0bb7af84-konnectivity-ca\") pod \"konnectivity-agent-dwq9h\" (UID: \"d2b9d577-b496-4c9f-81d1-888e0bb7af84\") " pod="kube-system/konnectivity-agent-dwq9h"
Jul 15 10:20:03.600276 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600155    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-var-lib-kubelet\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.600276 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600182    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d959c3bd-248e-4d1e-92f4-d64a2903c707-system-cni-dir\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.600276 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600194    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-kubernetes\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.600276 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600209    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d959c3bd-248e-4d1e-92f4-d64a2903c707-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.600276 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600232    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-var-lib-openvswitch\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.600276 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600259    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.600582 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600290    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/141455ed-ae53-465c-8979-db50257b660f-kubelet-config\") pod \"global-pull-secret-syncer-5r2sb\" (UID: \"141455ed-ae53-465c-8979-db50257b660f\") " pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:03.600582 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600330    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj2lg\" (UniqueName: \"kubernetes.io/projected/793964cf-e10f-455e-ade5-5724240979d1-kube-api-access-cj2lg\") pod \"node-resolver-xlk4p\" (UID: \"793964cf-e10f-455e-ade5-5724240979d1\") " pod="openshift-dns/node-resolver-xlk4p"
Jul 15 10:20:03.600582 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600355    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-run-multus-certs\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.600582 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600365    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/141455ed-ae53-465c-8979-db50257b660f-kubelet-config\") pod \"global-pull-secret-syncer-5r2sb\" (UID: \"141455ed-ae53-465c-8979-db50257b660f\") " pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:03.600582 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600377    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-run-netns\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.600582 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600392    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/793964cf-e10f-455e-ade5-5724240979d1-tmp-dir\") pod \"node-resolver-xlk4p\" (UID: \"793964cf-e10f-455e-ade5-5724240979d1\") " pod="openshift-dns/node-resolver-xlk4p"
Jul 15 10:20:03.600582 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600458    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-var-lib-cni-bin\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.600582 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600484    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/141455ed-ae53-465c-8979-db50257b660f-dbus\") pod \"global-pull-secret-syncer-5r2sb\" (UID: \"141455ed-ae53-465c-8979-db50257b660f\") " pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:03.600582 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600504    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.600582 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600531    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ggd4\" (UniqueName: \"kubernetes.io/projected/6826670d-3452-40f8-87ab-420507a99550-kube-api-access-4ggd4\") pod \"iptables-alerter-b5px9\" (UID: \"6826670d-3452-40f8-87ab-420507a99550\") " pod="openshift-network-operator/iptables-alerter-b5px9"
Jul 15 10:20:03.600582 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600550    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-os-release\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.600582 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600564    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-multus-socket-dir-parent\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.600582 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600579    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04d03060-07a3-4ce5-a041-d56a227e615c-host\") pod \"node-ca-n7pj6\" (UID: \"04d03060-07a3-4ce5-a041-d56a227e615c\") " pod="openshift-image-registry/node-ca-n7pj6"
Jul 15 10:20:03.601190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600610    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-sysconfig\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.601190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600641    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04d03060-07a3-4ce5-a041-d56a227e615c-host\") pod \"node-ca-n7pj6\" (UID: \"04d03060-07a3-4ce5-a041-d56a227e615c\") " pod="openshift-image-registry/node-ca-n7pj6"
Jul 15 10:20:03.601190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600649    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/141455ed-ae53-465c-8979-db50257b660f-dbus\") pod \"global-pull-secret-syncer-5r2sb\" (UID: \"141455ed-ae53-465c-8979-db50257b660f\") " pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:03.601190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600641    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqlfl\" (UniqueName: \"kubernetes.io/projected/0a6611f6-0c2c-4d27-ac49-1430af282e2a-kube-api-access-dqlfl\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.601190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600685    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-sysconfig\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.601190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600688    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-run-k8s-cni-cncf-io\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.601190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600741    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-run-ovn-kubernetes\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.601190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600773    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs\") pod \"network-metrics-daemon-dbd7d\" (UID: \"8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9\") " pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:03.601190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600797    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbkxg\" (UniqueName: \"kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg\") pod \"network-check-target-lxnrt\" (UID: \"3e69daa3-77e6-44a2-9d3d-4072bdf5424d\") " pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:03.601190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600819    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28e62077-4f3c-41b1-a6da-ffd066a86033-ovnkube-config\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.601190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600847    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-lib-modules\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.601190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600869    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-etc-kubernetes\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.601190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600907    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-etc-openvswitch\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.601190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600930    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04d03060-07a3-4ce5-a041-d56a227e615c-serviceca\") pod \"node-ca-n7pj6\" (UID: \"04d03060-07a3-4ce5-a041-d56a227e615c\") " pod="openshift-image-registry/node-ca-n7pj6"
Jul 15 10:20:03.601190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600952    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-run\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.601190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600974    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-host\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.601190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600985    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-lib-modules\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.601849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.600997    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-socket-dir\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.601849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601034    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-run\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.601849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601043    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-host\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.601849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601043    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-registration-dir\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.601849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601084    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-cni-binary-copy\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.601849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601132    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-multus-conf-dir\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.601849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601170    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-multus-daemon-config\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.601849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601205    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-sysctl-d\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.601849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601229    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-sysctl-conf\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.601849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601298    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-sys\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.601849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601346    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-sysctl-d\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.601849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601346    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt9vg\" (UniqueName: \"kubernetes.io/projected/0f33f6cd-1763-4502-84a6-75e9069e6b46-kube-api-access-vt9vg\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.601849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601373    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04d03060-07a3-4ce5-a041-d56a227e615c-serviceca\") pod \"node-ca-n7pj6\" (UID: \"04d03060-07a3-4ce5-a041-d56a227e615c\") " pod="openshift-image-registry/node-ca-n7pj6"
Jul 15 10:20:03.601849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601382    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-sysctl-conf\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.601849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601456    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/793964cf-e10f-455e-ade5-5724240979d1-hosts-file\") pod \"node-resolver-xlk4p\" (UID: \"793964cf-e10f-455e-ade5-5724240979d1\") " pod="openshift-dns/node-resolver-xlk4p"
Jul 15 10:20:03.601849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601482    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-sys\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.601849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601510    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d959c3bd-248e-4d1e-92f4-d64a2903c707-cnibin\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.602597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601532    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-systemd-units\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.602597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601566    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-slash\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.602597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601582    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/793964cf-e10f-455e-ade5-5724240979d1-hosts-file\") pod \"node-resolver-xlk4p\" (UID: \"793964cf-e10f-455e-ade5-5724240979d1\") " pod="openshift-dns/node-resolver-xlk4p"
Jul 15 10:20:03.602597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601599    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-run-systemd\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.602597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601626    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-run-openvswitch\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.602597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601647    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xlsw\" (UniqueName: \"kubernetes.io/projected/28e62077-4f3c-41b1-a6da-ffd066a86033-kube-api-access-7xlsw\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.602597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601670    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-sys-fs\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.602597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601687    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-hostroot\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.602597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601703    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d959c3bd-248e-4d1e-92f4-d64a2903c707-cni-binary-copy\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.602597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601719    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhdt9\" (UniqueName: \"kubernetes.io/projected/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-kube-api-access-bhdt9\") pod \"network-metrics-daemon-dbd7d\" (UID: \"8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9\") " pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:03.602597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601787    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5f5m\" (UniqueName: \"kubernetes.io/projected/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-kube-api-access-d5f5m\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.602597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601832    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret\") pod \"global-pull-secret-syncer-5r2sb\" (UID: \"141455ed-ae53-465c-8979-db50257b660f\") " pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:03.602597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601879    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-system-cni-dir\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.602597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601908    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-multus-cni-dir\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.602597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601929    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d959c3bd-248e-4d1e-92f4-d64a2903c707-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.602597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.601957    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-log-socket\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.602597 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:03.601978    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 10:20:03.603321 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602001    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-modprobe-d\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.603321 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602024    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-tuned\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.603321 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602040    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-etc-selinux\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.603321 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:03.602073    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret podName:141455ed-ae53-465c-8979-db50257b660f nodeName:}" failed. No retries permitted until 2026-07-15 10:20:04.102051344 +0000 UTC m=+2.921693221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret") pod "global-pull-secret-syncer-5r2sb" (UID: "141455ed-ae53-465c-8979-db50257b660f") : object "kube-system"/"original-pull-secret" not registered
Jul 15 10:20:03.603321 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602093    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkxb4\" (UniqueName: \"kubernetes.io/projected/d959c3bd-248e-4d1e-92f4-d64a2903c707-kube-api-access-bkxb4\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.603321 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602151    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-node-log\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.603321 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602179    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-cni-bin\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.603321 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602187    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-modprobe-d\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.603321 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602200    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-cni-netd\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.603321 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602224    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28e62077-4f3c-41b1-a6da-ffd066a86033-env-overrides\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.603321 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602254    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-systemd\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.603321 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602279    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-var-lib-kubelet\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.603321 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602313    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2b9d577-b496-4c9f-81d1-888e0bb7af84-agent-certs\") pod \"konnectivity-agent-dwq9h\" (UID: \"d2b9d577-b496-4c9f-81d1-888e0bb7af84\") " pod="kube-system/konnectivity-agent-dwq9h"
Jul 15 10:20:03.603321 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602334    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-device-dir\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.603321 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602381    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6826670d-3452-40f8-87ab-420507a99550-iptables-alerter-script\") pod \"iptables-alerter-b5px9\" (UID: \"6826670d-3452-40f8-87ab-420507a99550\") " pod="openshift-network-operator/iptables-alerter-b5px9"
Jul 15 10:20:03.603321 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602403    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 10:20:03.603955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602437    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-systemd\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.603955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602427    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f33f6cd-1763-4502-84a6-75e9069e6b46-var-lib-kubelet\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.603955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602484    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-run-netns\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.603955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602508    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d959c3bd-248e-4d1e-92f4-d64a2903c707-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.603955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602529    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f33f6cd-1763-4502-84a6-75e9069e6b46-tmp\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.603955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602558    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6826670d-3452-40f8-87ab-420507a99550-host-slash\") pod \"iptables-alerter-b5px9\" (UID: \"6826670d-3452-40f8-87ab-420507a99550\") " pod="openshift-network-operator/iptables-alerter-b5px9"
Jul 15 10:20:03.603955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602579    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-cnibin\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.603955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602615    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-var-lib-cni-multus\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.603955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602645    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d959c3bd-248e-4d1e-92f4-d64a2903c707-os-release\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.603955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602666    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-kubelet\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.603955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602705    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsdfd\" (UniqueName: \"kubernetes.io/projected/04d03060-07a3-4ce5-a041-d56a227e615c-kube-api-access-wsdfd\") pod \"node-ca-n7pj6\" (UID: \"04d03060-07a3-4ce5-a041-d56a227e615c\") " pod="openshift-image-registry/node-ca-n7pj6"
Jul 15 10:20:03.603955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602727    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-run-ovn\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.603955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.602762    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28e62077-4f3c-41b1-a6da-ffd066a86033-ovnkube-script-lib\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.605780 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.605755    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f33f6cd-1763-4502-84a6-75e9069e6b46-tmp\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.605894 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.605840    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f33f6cd-1763-4502-84a6-75e9069e6b46-etc-tuned\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.614241 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.614211    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt9vg\" (UniqueName: \"kubernetes.io/projected/0f33f6cd-1763-4502-84a6-75e9069e6b46-kube-api-access-vt9vg\") pod \"tuned-b8wcj\" (UID: \"0f33f6cd-1763-4502-84a6-75e9069e6b46\") " pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.614241 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.614211    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj2lg\" (UniqueName: \"kubernetes.io/projected/793964cf-e10f-455e-ade5-5724240979d1-kube-api-access-cj2lg\") pod \"node-resolver-xlk4p\" (UID: \"793964cf-e10f-455e-ade5-5724240979d1\") " pod="openshift-dns/node-resolver-xlk4p"
Jul 15 10:20:03.614751 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.614720    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsdfd\" (UniqueName: \"kubernetes.io/projected/04d03060-07a3-4ce5-a041-d56a227e615c-kube-api-access-wsdfd\") pod \"node-ca-n7pj6\" (UID: \"04d03060-07a3-4ce5-a041-d56a227e615c\") " pod="openshift-image-registry/node-ca-n7pj6"
Jul 15 10:20:03.646052 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.645998    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal" event={"ID":"b58eee2f6dff32c538b037ed8e3f6b25","Type":"ContainerStarted","Data":"2e4799791c685d1c82b05411346a74cfbdaaafc3ac68ee4d928b1877cdc68fd6"}
Jul 15 10:20:03.647203 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.647174    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal" event={"ID":"6fd61ae3c3b82a20bce79ca2b950fe8e","Type":"ContainerStarted","Data":"cbf4b499495f129624c6af6ba579146804c21a365551bede422ed6a474619f95"}
Jul 15 10:20:03.703715 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.703682    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d959c3bd-248e-4d1e-92f4-d64a2903c707-cnibin\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.703715 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.703715    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-systemd-units\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.703945 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.703735    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-slash\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.703945 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.703753    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-run-systemd\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.703945 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.703800    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-slash\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.703945 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.703813    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d959c3bd-248e-4d1e-92f4-d64a2903c707-cnibin\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.703945 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.703814    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-systemd-units\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.703945 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.703842    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-run-systemd\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.703945 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.703865    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-run-openvswitch\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.703945 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.703893    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xlsw\" (UniqueName: \"kubernetes.io/projected/28e62077-4f3c-41b1-a6da-ffd066a86033-kube-api-access-7xlsw\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.703945 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.703914    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-sys-fs\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.703945 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.703929    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-hostroot\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.703945 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.703937    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-run-openvswitch\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.703945 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.703946    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d959c3bd-248e-4d1e-92f4-d64a2903c707-cni-binary-copy\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.704482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.703963    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhdt9\" (UniqueName: \"kubernetes.io/projected/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-kube-api-access-bhdt9\") pod \"network-metrics-daemon-dbd7d\" (UID: \"8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9\") " pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:03.704482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.703979    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5f5m\" (UniqueName: \"kubernetes.io/projected/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-kube-api-access-d5f5m\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.704482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.703996    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-sys-fs\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.704482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704008    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-hostroot\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.704482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704014    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-system-cni-dir\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.704482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704046    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-multus-cni-dir\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.704482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704065    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d959c3bd-248e-4d1e-92f4-d64a2903c707-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.704482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704088    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-log-socket\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.704482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704136    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-etc-selinux\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.704482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704142    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-multus-cni-dir\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.704482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704160    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkxb4\" (UniqueName: \"kubernetes.io/projected/d959c3bd-248e-4d1e-92f4-d64a2903c707-kube-api-access-bkxb4\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.704482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704181    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-system-cni-dir\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.704482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704183    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-node-log\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.704482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704205    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-cni-bin\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.704482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704227    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-cni-netd\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.704482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704249    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28e62077-4f3c-41b1-a6da-ffd066a86033-env-overrides\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.704482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704256    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-etc-selinux\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704274    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2b9d577-b496-4c9f-81d1-888e0bb7af84-agent-certs\") pod \"konnectivity-agent-dwq9h\" (UID: \"d2b9d577-b496-4c9f-81d1-888e0bb7af84\") " pod="kube-system/konnectivity-agent-dwq9h"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704288    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-node-log\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704262    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-log-socket\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704321    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-device-dir\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704326    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-cni-netd\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704320    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d959c3bd-248e-4d1e-92f4-d64a2903c707-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704368    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-cni-bin\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704395    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-device-dir\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704414    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6826670d-3452-40f8-87ab-420507a99550-iptables-alerter-script\") pod \"iptables-alerter-b5px9\" (UID: \"6826670d-3452-40f8-87ab-420507a99550\") " pod="openshift-network-operator/iptables-alerter-b5px9"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704445    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-run-netns\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704471    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d959c3bd-248e-4d1e-92f4-d64a2903c707-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704498    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6826670d-3452-40f8-87ab-420507a99550-host-slash\") pod \"iptables-alerter-b5px9\" (UID: \"6826670d-3452-40f8-87ab-420507a99550\") " pod="openshift-network-operator/iptables-alerter-b5px9"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704521    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-cnibin\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704532    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-run-netns\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704545    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-var-lib-cni-multus\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704594    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-var-lib-cni-multus\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704599    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6826670d-3452-40f8-87ab-420507a99550-host-slash\") pod \"iptables-alerter-b5px9\" (UID: \"6826670d-3452-40f8-87ab-420507a99550\") " pod="openshift-network-operator/iptables-alerter-b5px9"
Jul 15 10:20:03.705296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704647    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-cnibin\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.706075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704652    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d959c3bd-248e-4d1e-92f4-d64a2903c707-cni-binary-copy\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.706075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704672    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d959c3bd-248e-4d1e-92f4-d64a2903c707-os-release\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.706075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704697    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-kubelet\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.706075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704722    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-run-ovn\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.706075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704745    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28e62077-4f3c-41b1-a6da-ffd066a86033-ovnkube-script-lib\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.706075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704766    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-kubelet\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.706075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704800    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28e62077-4f3c-41b1-a6da-ffd066a86033-ovn-node-metrics-cert\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.706075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704828    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d959c3bd-248e-4d1e-92f4-d64a2903c707-os-release\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.706075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704839    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2b9d577-b496-4c9f-81d1-888e0bb7af84-konnectivity-ca\") pod \"konnectivity-agent-dwq9h\" (UID: \"d2b9d577-b496-4c9f-81d1-888e0bb7af84\") " pod="kube-system/konnectivity-agent-dwq9h"
Jul 15 10:20:03.706075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704864    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-var-lib-kubelet\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.706075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704881    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6826670d-3452-40f8-87ab-420507a99550-iptables-alerter-script\") pod \"iptables-alerter-b5px9\" (UID: \"6826670d-3452-40f8-87ab-420507a99550\") " pod="openshift-network-operator/iptables-alerter-b5px9"
Jul 15 10:20:03.706075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704892    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d959c3bd-248e-4d1e-92f4-d64a2903c707-system-cni-dir\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.706075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.704923    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d959c3bd-248e-4d1e-92f4-d64a2903c707-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.706075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705023    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d959c3bd-248e-4d1e-92f4-d64a2903c707-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.706075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705071    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-var-lib-openvswitch\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.706075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705103    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d959c3bd-248e-4d1e-92f4-d64a2903c707-system-cni-dir\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.706075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705151    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.706667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705163    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-var-lib-kubelet\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.706667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705182    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-run-multus-certs\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.706667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705207    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-run-netns\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.706667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705232    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-var-lib-cni-bin\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.706667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705237    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-var-lib-openvswitch\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.706667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705260    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.706667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705286    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ggd4\" (UniqueName: \"kubernetes.io/projected/6826670d-3452-40f8-87ab-420507a99550-kube-api-access-4ggd4\") pod \"iptables-alerter-b5px9\" (UID: \"6826670d-3452-40f8-87ab-420507a99550\") " pod="openshift-network-operator/iptables-alerter-b5px9"
Jul 15 10:20:03.706667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705310    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-os-release\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.706667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705316    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28e62077-4f3c-41b1-a6da-ffd066a86033-ovnkube-script-lib\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.706667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705333    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28e62077-4f3c-41b1-a6da-ffd066a86033-env-overrides\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.706667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705369    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2b9d577-b496-4c9f-81d1-888e0bb7af84-konnectivity-ca\") pod \"konnectivity-agent-dwq9h\" (UID: \"d2b9d577-b496-4c9f-81d1-888e0bb7af84\") " pod="kube-system/konnectivity-agent-dwq9h"
Jul 15 10:20:03.706667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705336    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-multus-socket-dir-parent\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.706667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705389    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-var-lib-cni-bin\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.706667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705392    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-multus-socket-dir-parent\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.706667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705399    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.706667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705418    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqlfl\" (UniqueName: \"kubernetes.io/projected/0a6611f6-0c2c-4d27-ac49-1430af282e2a-kube-api-access-dqlfl\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.706667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705434    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-run-ovn\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.707207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705461    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-os-release\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.707207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705472    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.707207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705480    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-run-k8s-cni-cncf-io\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.707207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705505    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-run-ovn-kubernetes\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.707207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705515    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-run-multus-certs\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.707207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705529    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs\") pod \"network-metrics-daemon-dbd7d\" (UID: \"8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9\") " pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:03.707207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705549    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-run-netns\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.707207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705553    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbkxg\" (UniqueName: \"kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg\") pod \"network-check-target-lxnrt\" (UID: \"3e69daa3-77e6-44a2-9d3d-4072bdf5424d\") " pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:03.707207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705584    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28e62077-4f3c-41b1-a6da-ffd066a86033-ovnkube-config\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.707207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705607    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-host-run-k8s-cni-cncf-io\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.707207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705611    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-etc-kubernetes\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.707207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705637    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-etc-openvswitch\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.707207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705662    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-socket-dir\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.707207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705666    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-etc-kubernetes\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.707207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705692    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-registration-dir\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.707207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705709    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-etc-openvswitch\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.707207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705715    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-cni-binary-copy\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.707686 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705741    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-multus-conf-dir\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.707686 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705744    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28e62077-4f3c-41b1-a6da-ffd066a86033-host-run-ovn-kubernetes\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.707686 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705766    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-multus-daemon-config\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.707686 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:03.705774    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:20:03.707686 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:03.705842    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs podName:8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:04.205824335 +0000 UTC m=+3.025466185 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs") pod "network-metrics-daemon-dbd7d" (UID: "8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:20:03.707686 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705836    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d959c3bd-248e-4d1e-92f4-d64a2903c707-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.707686 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705887    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-multus-conf-dir\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.707686 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.705942    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-registration-dir\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.707686 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.706058    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0a6611f6-0c2c-4d27-ac49-1430af282e2a-socket-dir\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.707686 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.706144    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28e62077-4f3c-41b1-a6da-ffd066a86033-ovnkube-config\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.707686 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.706287    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-cni-binary-copy\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.707686 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.706609    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-multus-daemon-config\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.707686 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.707135    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2b9d577-b496-4c9f-81d1-888e0bb7af84-agent-certs\") pod \"konnectivity-agent-dwq9h\" (UID: \"d2b9d577-b496-4c9f-81d1-888e0bb7af84\") " pod="kube-system/konnectivity-agent-dwq9h"
Jul 15 10:20:03.707686 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.707345    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28e62077-4f3c-41b1-a6da-ffd066a86033-ovn-node-metrics-cert\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.723069 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:03.722720    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 10:20:03.723069 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:03.722747    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 10:20:03.723069 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:03.722781    2568 projected.go:196] Error preparing data for projected volume kube-api-access-jbkxg for pod openshift-network-diagnostics/network-check-target-lxnrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:20:03.723069 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:03.722870    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg podName:3e69daa3-77e6-44a2-9d3d-4072bdf5424d nodeName:}" failed. No retries permitted until 2026-07-15 10:20:04.222849243 +0000 UTC m=+3.042491116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jbkxg" (UniqueName: "kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg") pod "network-check-target-lxnrt" (UID: "3e69daa3-77e6-44a2-9d3d-4072bdf5424d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:20:03.724698 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.724662    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkxb4\" (UniqueName: \"kubernetes.io/projected/d959c3bd-248e-4d1e-92f4-d64a2903c707-kube-api-access-bkxb4\") pod \"multus-additional-cni-plugins-4cj5h\" (UID: \"d959c3bd-248e-4d1e-92f4-d64a2903c707\") " pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.724809 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.724790    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhdt9\" (UniqueName: \"kubernetes.io/projected/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-kube-api-access-bhdt9\") pod \"network-metrics-daemon-dbd7d\" (UID: \"8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9\") " pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:03.724864 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.724828    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqlfl\" (UniqueName: \"kubernetes.io/projected/0a6611f6-0c2c-4d27-ac49-1430af282e2a-kube-api-access-dqlfl\") pod \"aws-ebs-csi-driver-node-446n9\" (UID: \"0a6611f6-0c2c-4d27-ac49-1430af282e2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.725244 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.725225    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xlsw\" (UniqueName: \"kubernetes.io/projected/28e62077-4f3c-41b1-a6da-ffd066a86033-kube-api-access-7xlsw\") pod \"ovnkube-node-b94br\" (UID: \"28e62077-4f3c-41b1-a6da-ffd066a86033\") " pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.725722 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.725702    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ggd4\" (UniqueName: \"kubernetes.io/projected/6826670d-3452-40f8-87ab-420507a99550-kube-api-access-4ggd4\") pod \"iptables-alerter-b5px9\" (UID: \"6826670d-3452-40f8-87ab-420507a99550\") " pod="openshift-network-operator/iptables-alerter-b5px9"
Jul 15 10:20:03.726444 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.726427    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5f5m\" (UniqueName: \"kubernetes.io/projected/00a2dc73-e847-4dd0-aa6a-93b2c0725fef-kube-api-access-d5f5m\") pod \"multus-8jhqs\" (UID: \"00a2dc73-e847-4dd0-aa6a-93b2c0725fef\") " pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.796815 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.796776    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n7pj6"
Jul 15 10:20:03.805408 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.805382    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b8wcj"
Jul 15 10:20:03.816259 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.816217    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xlk4p"
Jul 15 10:20:03.821209 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.821180    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8jhqs"
Jul 15 10:20:03.827472 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.827444    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4cj5h"
Jul 15 10:20:03.843155 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.843098    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dwq9h"
Jul 15 10:20:03.849184 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.849158    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9"
Jul 15 10:20:03.857016 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.856990    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b5px9"
Jul 15 10:20:03.862184 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.862157    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:03.962178 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:03.962144    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 10:20:04.017072 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:20:04.017041    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd959c3bd_248e_4d1e_92f4_d64a2903c707.slice/crio-ed3bcb102aaf0c1fb3ee259fa6364ebcc65752bbffe55a8dc467c27fe8259c9f WatchSource:0}: Error finding container ed3bcb102aaf0c1fb3ee259fa6364ebcc65752bbffe55a8dc467c27fe8259c9f: Status 404 returned error can't find the container with id ed3bcb102aaf0c1fb3ee259fa6364ebcc65752bbffe55a8dc467c27fe8259c9f
Jul 15 10:20:04.017479 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:20:04.017461    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6826670d_3452_40f8_87ab_420507a99550.slice/crio-92768289fd26fbbe4132b7a9cc02af231a5b19812eccabd5d0180f158a509ac9 WatchSource:0}: Error finding container 92768289fd26fbbe4132b7a9cc02af231a5b19812eccabd5d0180f158a509ac9: Status 404 returned error can't find the container with id 92768289fd26fbbe4132b7a9cc02af231a5b19812eccabd5d0180f158a509ac9
Jul 15 10:20:04.042171 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:20:04.042145    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28e62077_4f3c_41b1_a6da_ffd066a86033.slice/crio-d544de1de6a3fe3ba73e4336f3316c05c3d874a8881d1eae4a946c2006cb93a1 WatchSource:0}: Error finding container d544de1de6a3fe3ba73e4336f3316c05c3d874a8881d1eae4a946c2006cb93a1: Status 404 returned error can't find the container with id d544de1de6a3fe3ba73e4336f3316c05c3d874a8881d1eae4a946c2006cb93a1
Jul 15 10:20:04.043088 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:20:04.043059    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod793964cf_e10f_455e_ade5_5724240979d1.slice/crio-e08d7adf3cd01c174ce614f4a015cd8260e7827682ef99577e8791bfc9d18f81 WatchSource:0}: Error finding container e08d7adf3cd01c174ce614f4a015cd8260e7827682ef99577e8791bfc9d18f81: Status 404 returned error can't find the container with id e08d7adf3cd01c174ce614f4a015cd8260e7827682ef99577e8791bfc9d18f81
Jul 15 10:20:04.043780 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:20:04.043757    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04d03060_07a3_4ce5_a041_d56a227e615c.slice/crio-fb301193e8b440093d9379a2d842f85684dbe61c572a7834209f69f2069b24b3 WatchSource:0}: Error finding container fb301193e8b440093d9379a2d842f85684dbe61c572a7834209f69f2069b24b3: Status 404 returned error can't find the container with id fb301193e8b440093d9379a2d842f85684dbe61c572a7834209f69f2069b24b3
Jul 15 10:20:04.045211 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:20:04.044532    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b9d577_b496_4c9f_81d1_888e0bb7af84.slice/crio-4dd6c8b2b31c808d24fa6fda29e429c756d7fc049d77e66f2c1efff4c12760b4 WatchSource:0}: Error finding container 4dd6c8b2b31c808d24fa6fda29e429c756d7fc049d77e66f2c1efff4c12760b4: Status 404 returned error can't find the container with id 4dd6c8b2b31c808d24fa6fda29e429c756d7fc049d77e66f2c1efff4c12760b4
Jul 15 10:20:04.049523 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:20:04.049273    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a6611f6_0c2c_4d27_ac49_1430af282e2a.slice/crio-8ed5e146842090f64f97e6707c5befe35c93327d6c5665943f4d2b5aa8dae7f2 WatchSource:0}: Error finding container 8ed5e146842090f64f97e6707c5befe35c93327d6c5665943f4d2b5aa8dae7f2: Status 404 returned error can't find the container with id 8ed5e146842090f64f97e6707c5befe35c93327d6c5665943f4d2b5aa8dae7f2
Jul 15 10:20:04.109838 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.109587    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret\") pod \"global-pull-secret-syncer-5r2sb\" (UID: \"141455ed-ae53-465c-8979-db50257b660f\") " pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:04.110035 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:04.109852    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 10:20:04.110035 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:04.109939    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret podName:141455ed-ae53-465c-8979-db50257b660f nodeName:}" failed. No retries permitted until 2026-07-15 10:20:05.109917215 +0000 UTC m=+3.929559081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret") pod "global-pull-secret-syncer-5r2sb" (UID: "141455ed-ae53-465c-8979-db50257b660f") : object "kube-system"/"original-pull-secret" not registered
Jul 15 10:20:04.210558 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.210524    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs\") pod \"network-metrics-daemon-dbd7d\" (UID: \"8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9\") " pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:04.210734 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:04.210708    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:20:04.210813 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:04.210785    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs podName:8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:05.210764995 +0000 UTC m=+4.030406848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs") pod "network-metrics-daemon-dbd7d" (UID: "8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:20:04.310910 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.310876    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbkxg\" (UniqueName: \"kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg\") pod \"network-check-target-lxnrt\" (UID: \"3e69daa3-77e6-44a2-9d3d-4072bdf5424d\") " pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:04.311065 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:04.311048    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 10:20:04.311147 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:04.311073    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 10:20:04.311147 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:04.311085    2568 projected.go:196] Error preparing data for projected volume kube-api-access-jbkxg for pod openshift-network-diagnostics/network-check-target-lxnrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:20:04.311276 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:04.311173    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg podName:3e69daa3-77e6-44a2-9d3d-4072bdf5424d nodeName:}" failed. No retries permitted until 2026-07-15 10:20:05.3111529 +0000 UTC m=+4.130794750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbkxg" (UniqueName: "kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg") pod "network-check-target-lxnrt" (UID: "3e69daa3-77e6-44a2-9d3d-4072bdf5424d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:20:04.464835 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.464795    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 10:20:04.542026 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.541903    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 10:15:03 +0000 UTC" deadline="2028-02-11 10:29:37.520450978 +0000 UTC"
Jul 15 10:20:04.542026 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.541966    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13824h9m32.978489906s"
Jul 15 10:20:04.642102 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.641612    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:04.642102 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:04.641744    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:04.653648 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.653569    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xlk4p" event={"ID":"793964cf-e10f-455e-ade5-5724240979d1","Type":"ContainerStarted","Data":"e08d7adf3cd01c174ce614f4a015cd8260e7827682ef99577e8791bfc9d18f81"}
Jul 15 10:20:04.661269 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.661222    2568 generic.go:356] "Generic (PLEG): container finished" podID="b58eee2f6dff32c538b037ed8e3f6b25" containerID="15541bb9c0fd47e9498970d245a84a6e74e76b00ec982b0a679598e984af9f0d" exitCode=0
Jul 15 10:20:04.661425 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.661306    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal" event={"ID":"b58eee2f6dff32c538b037ed8e3f6b25","Type":"ContainerDied","Data":"15541bb9c0fd47e9498970d245a84a6e74e76b00ec982b0a679598e984af9f0d"}
Jul 15 10:20:04.667384 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.667349    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b94br" event={"ID":"28e62077-4f3c-41b1-a6da-ffd066a86033","Type":"ContainerStarted","Data":"d544de1de6a3fe3ba73e4336f3316c05c3d874a8881d1eae4a946c2006cb93a1"}
Jul 15 10:20:04.673648 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.673616    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b5px9" event={"ID":"6826670d-3452-40f8-87ab-420507a99550","Type":"ContainerStarted","Data":"92768289fd26fbbe4132b7a9cc02af231a5b19812eccabd5d0180f158a509ac9"}
Jul 15 10:20:04.682571 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.682538    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cj5h" event={"ID":"d959c3bd-248e-4d1e-92f4-d64a2903c707","Type":"ContainerStarted","Data":"ed3bcb102aaf0c1fb3ee259fa6364ebcc65752bbffe55a8dc467c27fe8259c9f"}
Jul 15 10:20:04.688398 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.688363    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9" event={"ID":"0a6611f6-0c2c-4d27-ac49-1430af282e2a","Type":"ContainerStarted","Data":"8ed5e146842090f64f97e6707c5befe35c93327d6c5665943f4d2b5aa8dae7f2"}
Jul 15 10:20:04.692758 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.692725    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8jhqs" event={"ID":"00a2dc73-e847-4dd0-aa6a-93b2c0725fef","Type":"ContainerStarted","Data":"d0e5ad1710762cf7dc03fecbb9418c3189dc649ff0e5a76283b5580a03d86a5d"}
Jul 15 10:20:04.707544 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.707504    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b8wcj" event={"ID":"0f33f6cd-1763-4502-84a6-75e9069e6b46","Type":"ContainerStarted","Data":"b251f945c12424fc4ea8295c31e556d6115b245e13497b2b787654ac650e29d1"}
Jul 15 10:20:04.719589 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.719552    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dwq9h" event={"ID":"d2b9d577-b496-4c9f-81d1-888e0bb7af84","Type":"ContainerStarted","Data":"4dd6c8b2b31c808d24fa6fda29e429c756d7fc049d77e66f2c1efff4c12760b4"}
Jul 15 10:20:04.731205 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:04.731159    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n7pj6" event={"ID":"04d03060-07a3-4ce5-a041-d56a227e615c","Type":"ContainerStarted","Data":"fb301193e8b440093d9379a2d842f85684dbe61c572a7834209f69f2069b24b3"}
Jul 15 10:20:05.117663 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:05.117573    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret\") pod \"global-pull-secret-syncer-5r2sb\" (UID: \"141455ed-ae53-465c-8979-db50257b660f\") " pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:05.117835 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:05.117742    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 10:20:05.117835 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:05.117814    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret podName:141455ed-ae53-465c-8979-db50257b660f nodeName:}" failed. No retries permitted until 2026-07-15 10:20:07.117792186 +0000 UTC m=+5.937434035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret") pod "global-pull-secret-syncer-5r2sb" (UID: "141455ed-ae53-465c-8979-db50257b660f") : object "kube-system"/"original-pull-secret" not registered
Jul 15 10:20:05.218286 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:05.218230    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs\") pod \"network-metrics-daemon-dbd7d\" (UID: \"8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9\") " pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:05.218516 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:05.218488    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:20:05.218593 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:05.218558    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs podName:8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:07.218538498 +0000 UTC m=+6.038180349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs") pod "network-metrics-daemon-dbd7d" (UID: "8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:20:05.319885 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:05.319076    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbkxg\" (UniqueName: \"kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg\") pod \"network-check-target-lxnrt\" (UID: \"3e69daa3-77e6-44a2-9d3d-4072bdf5424d\") " pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:05.319885 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:05.319318    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 10:20:05.319885 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:05.319341    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 10:20:05.319885 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:05.319355    2568 projected.go:196] Error preparing data for projected volume kube-api-access-jbkxg for pod openshift-network-diagnostics/network-check-target-lxnrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:20:05.319885 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:05.319438    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg podName:3e69daa3-77e6-44a2-9d3d-4072bdf5424d nodeName:}" failed. No retries permitted until 2026-07-15 10:20:07.319396066 +0000 UTC m=+6.139037921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbkxg" (UniqueName: "kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg") pod "network-check-target-lxnrt" (UID: "3e69daa3-77e6-44a2-9d3d-4072bdf5424d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:20:05.543045 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:05.542967    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 10:15:03 +0000 UTC" deadline="2028-03-29 15:05:28.07614143 +0000 UTC"
Jul 15 10:20:05.543045 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:05.543010    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14956h45m22.53313571s"
Jul 15 10:20:05.643866 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:05.643265    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:05.643866 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:05.643486    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:05.644360 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:05.644217    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:05.644360 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:05.644320    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:05.763508 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:05.763463    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal" event={"ID":"b58eee2f6dff32c538b037ed8e3f6b25","Type":"ContainerStarted","Data":"c454b2d328d3170ff4ce66141706e773e2b863d7c032f1fb0f35ff51f9793690"}
Jul 15 10:20:05.783559 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:05.783493    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal" podStartSLOduration=3.783471205 podStartE2EDuration="3.783471205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:20:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:20:05.78257266 +0000 UTC m=+4.602214535" watchObservedRunningTime="2026-07-15 10:20:05.783471205 +0000 UTC m=+4.603113078"
Jul 15 10:20:06.642802 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:06.641761    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:06.642802 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:06.641896    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:07.136710 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:07.136670    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret\") pod \"global-pull-secret-syncer-5r2sb\" (UID: \"141455ed-ae53-465c-8979-db50257b660f\") " pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:07.136950 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:07.136906    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 10:20:07.137040 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:07.136972    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret podName:141455ed-ae53-465c-8979-db50257b660f nodeName:}" failed. No retries permitted until 2026-07-15 10:20:11.136954136 +0000 UTC m=+9.956596000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret") pod "global-pull-secret-syncer-5r2sb" (UID: "141455ed-ae53-465c-8979-db50257b660f") : object "kube-system"/"original-pull-secret" not registered
Jul 15 10:20:07.237840 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:07.237225    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs\") pod \"network-metrics-daemon-dbd7d\" (UID: \"8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9\") " pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:07.237840 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:07.237424    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:20:07.237840 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:07.237489    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs podName:8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:11.237469275 +0000 UTC m=+10.057111127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs") pod "network-metrics-daemon-dbd7d" (UID: "8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:20:07.339080 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:07.338406    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbkxg\" (UniqueName: \"kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg\") pod \"network-check-target-lxnrt\" (UID: \"3e69daa3-77e6-44a2-9d3d-4072bdf5424d\") " pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:07.339080 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:07.338603    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 10:20:07.339080 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:07.338625    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 10:20:07.339080 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:07.338638    2568 projected.go:196] Error preparing data for projected volume kube-api-access-jbkxg for pod openshift-network-diagnostics/network-check-target-lxnrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:20:07.339080 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:07.338702    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg podName:3e69daa3-77e6-44a2-9d3d-4072bdf5424d nodeName:}" failed. No retries permitted until 2026-07-15 10:20:11.338682982 +0000 UTC m=+10.158324836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbkxg" (UniqueName: "kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg") pod "network-check-target-lxnrt" (UID: "3e69daa3-77e6-44a2-9d3d-4072bdf5424d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:20:07.643301 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:07.643267    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:07.643755 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:07.643437    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:07.643834 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:07.643816    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:07.643939 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:07.643919    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:08.642436 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:08.642403    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:08.642645 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:08.642543    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:09.642014 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:09.641969    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:09.642484 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:09.642129    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:09.642692 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:09.642562    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:09.642692 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:09.642656    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:10.642846 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:10.642370    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:10.642846 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:10.642500    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:11.171420 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:11.171377    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret\") pod \"global-pull-secret-syncer-5r2sb\" (UID: \"141455ed-ae53-465c-8979-db50257b660f\") " pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:11.171612 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:11.171496    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 10:20:11.171612 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:11.171576    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret podName:141455ed-ae53-465c-8979-db50257b660f nodeName:}" failed. No retries permitted until 2026-07-15 10:20:19.171558027 +0000 UTC m=+17.991199900 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret") pod "global-pull-secret-syncer-5r2sb" (UID: "141455ed-ae53-465c-8979-db50257b660f") : object "kube-system"/"original-pull-secret" not registered
Jul 15 10:20:11.272580 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:11.272544    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs\") pod \"network-metrics-daemon-dbd7d\" (UID: \"8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9\") " pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:11.272746 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:11.272680    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:20:11.272746 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:11.272733    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs podName:8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:19.272717422 +0000 UTC m=+18.092359272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs") pod "network-metrics-daemon-dbd7d" (UID: "8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:20:11.373900 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:11.373860    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbkxg\" (UniqueName: \"kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg\") pod \"network-check-target-lxnrt\" (UID: \"3e69daa3-77e6-44a2-9d3d-4072bdf5424d\") " pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:11.374085 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:11.374054    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 10:20:11.374085 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:11.374080    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 10:20:11.374221 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:11.374092    2568 projected.go:196] Error preparing data for projected volume kube-api-access-jbkxg for pod openshift-network-diagnostics/network-check-target-lxnrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:20:11.374221 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:11.374157    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg podName:3e69daa3-77e6-44a2-9d3d-4072bdf5424d nodeName:}" failed. No retries permitted until 2026-07-15 10:20:19.374143849 +0000 UTC m=+18.193785698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbkxg" (UniqueName: "kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg") pod "network-check-target-lxnrt" (UID: "3e69daa3-77e6-44a2-9d3d-4072bdf5424d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:20:11.645844 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:11.645736    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:11.646794 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:11.646755    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:11.647214 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:11.647190    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:11.648264 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:11.648231    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:12.642309 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:12.642273    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:12.642472 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:12.642394    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:13.643924 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:13.643248    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:13.643924 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:13.643401    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:13.643924 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:13.643762    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:13.643924 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:13.643858    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:14.642090 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:14.642055    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:14.642262 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:14.642197    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:15.641436 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:15.641394    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:15.641837 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:15.641526    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:15.641837 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:15.641585    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:15.641837 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:15.641712    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:16.641928 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:16.641881    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:16.642416 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:16.642023    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:17.641692 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:17.641653    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:17.641692 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:17.641693    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:17.641928 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:17.641808    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:17.641981 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:17.641928    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:18.642356 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:18.642322    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:18.642851 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:18.642460    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:19.234400 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:19.234318    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret\") pod \"global-pull-secret-syncer-5r2sb\" (UID: \"141455ed-ae53-465c-8979-db50257b660f\") " pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:19.234579 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:19.234524    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 10:20:19.234623 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:19.234602    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret podName:141455ed-ae53-465c-8979-db50257b660f nodeName:}" failed. No retries permitted until 2026-07-15 10:20:35.234585223 +0000 UTC m=+34.054227072 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret") pod "global-pull-secret-syncer-5r2sb" (UID: "141455ed-ae53-465c-8979-db50257b660f") : object "kube-system"/"original-pull-secret" not registered
Jul 15 10:20:19.335223 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:19.335182    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs\") pod \"network-metrics-daemon-dbd7d\" (UID: \"8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9\") " pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:19.335393 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:19.335363    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:20:19.335466 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:19.335446    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs podName:8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:35.335422614 +0000 UTC m=+34.155064487 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs") pod "network-metrics-daemon-dbd7d" (UID: "8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:20:19.436092 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:19.436056    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbkxg\" (UniqueName: \"kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg\") pod \"network-check-target-lxnrt\" (UID: \"3e69daa3-77e6-44a2-9d3d-4072bdf5424d\") " pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:19.436267 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:19.436253    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 10:20:19.436308 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:19.436274    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 10:20:19.436308 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:19.436284    2568 projected.go:196] Error preparing data for projected volume kube-api-access-jbkxg for pod openshift-network-diagnostics/network-check-target-lxnrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:20:19.436382 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:19.436335    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg podName:3e69daa3-77e6-44a2-9d3d-4072bdf5424d nodeName:}" failed. No retries permitted until 2026-07-15 10:20:35.436321504 +0000 UTC m=+34.255963353 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbkxg" (UniqueName: "kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg") pod "network-check-target-lxnrt" (UID: "3e69daa3-77e6-44a2-9d3d-4072bdf5424d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:20:19.641808 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:19.641773    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:19.641960 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:19.641888    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:19.641960 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:19.641943    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:19.642060 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:19.642041    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:20.641641 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:20.641601    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:20.642145 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:20.641733    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:21.643105 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:21.643068    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:21.643592 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:21.643304    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:21.643592 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:21.643353    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:21.643592 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:21.643432    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:22.642197 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:22.642156    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:22.642395 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:22.642289    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:23.641694 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:23.641657    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:23.642176 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:23.641776    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:23.642176 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:23.641829    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:23.642176 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:23.641915    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:24.641662 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.641476    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:24.641831 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:24.641740    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:24.805993 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.805822    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal" event={"ID":"6fd61ae3c3b82a20bce79ca2b950fe8e","Type":"ContainerStarted","Data":"8375a555aae4dcf2b4199952df89e18182dff4f276875dc55449c456f1b9d553"}
Jul 15 10:20:24.808267 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.808234    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9" event={"ID":"0a6611f6-0c2c-4d27-ac49-1430af282e2a","Type":"ContainerStarted","Data":"d89ec9a321082f871b91eac136141fa54855eddbd82a36d5f51c1f5da0ffb846"}
Jul 15 10:20:24.810028 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.809980    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8jhqs" event={"ID":"00a2dc73-e847-4dd0-aa6a-93b2c0725fef","Type":"ContainerStarted","Data":"27fb1cbf0b0a44dd4bbb7d0c024c8395ee8948685138925323f7e5ee8f7e873e"}
Jul 15 10:20:24.811549 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.811522    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b8wcj" event={"ID":"0f33f6cd-1763-4502-84a6-75e9069e6b46","Type":"ContainerStarted","Data":"edcb9b28e85663384b871d91848f55a640ea6b1c18bdd6a1a2e51166e4a4a628"}
Jul 15 10:20:24.813598 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.813571    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dwq9h" event={"ID":"d2b9d577-b496-4c9f-81d1-888e0bb7af84","Type":"ContainerStarted","Data":"6a1f47d66a56528cb143676fb25d06cbafbff73f36d1cbb8a7050af71c9bde0a"}
Jul 15 10:20:24.815218 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.815196    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n7pj6" event={"ID":"04d03060-07a3-4ce5-a041-d56a227e615c","Type":"ContainerStarted","Data":"e11512a67477278ae234bb7b06de2fbdc49105002cfc7bd1894cc0065bfc81b7"}
Jul 15 10:20:24.816861 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.816826    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xlk4p" event={"ID":"793964cf-e10f-455e-ade5-5724240979d1","Type":"ContainerStarted","Data":"8fadfdc6fb36bdac718db9850670d8fdffbd4d377999e7c33e5693bc9c432d5b"}
Jul 15 10:20:24.818846 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.818812    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b94br" event={"ID":"28e62077-4f3c-41b1-a6da-ffd066a86033","Type":"ContainerStarted","Data":"e87a196630d0ee624567a7169a8dbaa4dcfa71b4cdb7dd7f3b33ba85c29da71f"}
Jul 15 10:20:24.818975 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.818897    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b94br" event={"ID":"28e62077-4f3c-41b1-a6da-ffd066a86033","Type":"ContainerStarted","Data":"f6618b923b4f7d97e7f0970bebb490d5f1fda091b5e161d6909f97338a8e8ab6"}
Jul 15 10:20:24.820629 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.820586    2568 generic.go:356] "Generic (PLEG): container finished" podID="d959c3bd-248e-4d1e-92f4-d64a2903c707" containerID="75dbe110fae7e466e3e6a9ad8936ebd88f3e924f7f25d0c07ad986fc56316bfb" exitCode=0
Jul 15 10:20:24.820629 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.820625    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cj5h" event={"ID":"d959c3bd-248e-4d1e-92f4-d64a2903c707","Type":"ContainerDied","Data":"75dbe110fae7e466e3e6a9ad8936ebd88f3e924f7f25d0c07ad986fc56316bfb"}
Jul 15 10:20:24.823106 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.823071    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal" podStartSLOduration=22.823058886 podStartE2EDuration="22.823058886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:20:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:20:24.822462587 +0000 UTC m=+23.642104458" watchObservedRunningTime="2026-07-15 10:20:24.823058886 +0000 UTC m=+23.642700758"
Jul 15 10:20:24.861057 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.860992    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n7pj6" podStartSLOduration=8.120305131 podStartE2EDuration="23.860978551s" totalImagesPullingTime="15.74067342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:20:24.860917898 +0000 UTC m=+23.680559771" watchObservedRunningTime="2026-07-15 10:20:24.860978551 +0000 UTC m=+23.680620422"
Jul 15 10:20:24.877862 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.877806    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xlk4p" podStartSLOduration=4.102951671 podStartE2EDuration="23.877789541s" totalImagesPullingTime="19.77483787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:20:24.877496693 +0000 UTC m=+23.697138563" watchObservedRunningTime="2026-07-15 10:20:24.877789541 +0000 UTC m=+23.697431411"
Jul 15 10:20:24.897000 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.896953    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8jhqs" podStartSLOduration=4.080529958 podStartE2EDuration="23.89693747s" totalImagesPullingTime="19.816407512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:20:24.896755804 +0000 UTC m=+23.716397672" watchObservedRunningTime="2026-07-15 10:20:24.89693747 +0000 UTC m=+23.716579341"
Jul 15 10:20:24.913693 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.913647    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dwq9h" podStartSLOduration=4.129149479 podStartE2EDuration="23.9136312s" totalImagesPullingTime="19.784481721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:20:24.913204607 +0000 UTC m=+23.732846489" watchObservedRunningTime="2026-07-15 10:20:24.9136312 +0000 UTC m=+23.733273070"
Jul 15 10:20:24.931762 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:24.931703    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b8wcj" podStartSLOduration=4.146611383 podStartE2EDuration="23.931686558s" totalImagesPullingTime="19.785075175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:20:24.931500505 +0000 UTC m=+23.751142376" watchObservedRunningTime="2026-07-15 10:20:24.931686558 +0000 UTC m=+23.751328430"
Jul 15 10:20:25.385630 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:25.385588    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 10:20:25.571277 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:25.571156    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T10:20:25.385609735Z","UUID":"29871fc7-f328-4e0d-b872-3f6e26273798","Handler":null,"Name":"","Endpoint":""}
Jul 15 10:20:25.573541 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:25.573519    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 10:20:25.573682 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:25.573555    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 10:20:25.642525 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:25.642491    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:25.642966 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:25.642539    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:25.642966 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:25.642630    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:25.642966 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:25.642777    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:25.827983 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:25.827743    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:20:25.828424 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:25.828396    2568 generic.go:356] "Generic (PLEG): container finished" podID="28e62077-4f3c-41b1-a6da-ffd066a86033" containerID="e87a196630d0ee624567a7169a8dbaa4dcfa71b4cdb7dd7f3b33ba85c29da71f" exitCode=1
Jul 15 10:20:25.828517 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:25.828459    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b94br" event={"ID":"28e62077-4f3c-41b1-a6da-ffd066a86033","Type":"ContainerDied","Data":"e87a196630d0ee624567a7169a8dbaa4dcfa71b4cdb7dd7f3b33ba85c29da71f"}
Jul 15 10:20:25.828574 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:25.828547    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b94br" event={"ID":"28e62077-4f3c-41b1-a6da-ffd066a86033","Type":"ContainerStarted","Data":"2ad71951b409a7929cd6222c0b4b9903811a2b9781653599cee904be521388d6"}
Jul 15 10:20:25.828627 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:25.828598    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b94br" event={"ID":"28e62077-4f3c-41b1-a6da-ffd066a86033","Type":"ContainerStarted","Data":"5aafbf194dacc36d723dde07c7d6d6c454bddcb2f1130b6966a3d18b23dc7ff4"}
Jul 15 10:20:25.828677 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:25.828646    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b94br" event={"ID":"28e62077-4f3c-41b1-a6da-ffd066a86033","Type":"ContainerStarted","Data":"c098ca8689068c4b0c57bac82066fded549c595bc8e54e1e5bdc4ee036b27cd9"}
Jul 15 10:20:25.828733 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:25.828693    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b94br" event={"ID":"28e62077-4f3c-41b1-a6da-ffd066a86033","Type":"ContainerStarted","Data":"5d4132553de6e1b8dc98e25bbd1235fece0401e8f04e390d29a620d6849402c9"}
Jul 15 10:20:25.830039 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:25.830011    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b5px9" event={"ID":"6826670d-3452-40f8-87ab-420507a99550","Type":"ContainerStarted","Data":"d39d0de0f5f1e3ebfc664c8de4371e933388468997b445bc7ee0277b521d732a"}
Jul 15 10:20:25.832590 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:25.832548    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9" event={"ID":"0a6611f6-0c2c-4d27-ac49-1430af282e2a","Type":"ContainerStarted","Data":"b503fba2ac4d9c5d956d0e3f4ae4880f2b4ba3d5b1b415b73cf0a8ebb647f3e9"}
Jul 15 10:20:25.858360 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:25.858268    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b5px9" podStartSLOduration=5.064385856 podStartE2EDuration="24.858252024s" totalImagesPullingTime="19.793866168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:20:25.857991838 +0000 UTC m=+24.677633711" watchObservedRunningTime="2026-07-15 10:20:25.858252024 +0000 UTC m=+24.677893894"
Jul 15 10:20:26.642201 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:26.642164    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:26.642400 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:26.642283    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:26.838036 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:26.837994    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9" event={"ID":"0a6611f6-0c2c-4d27-ac49-1430af282e2a","Type":"ContainerStarted","Data":"2178acd101845f643bb2c13e9b3fa3df6ed1b8ab364f6b8cfb6e34b0891b21e9"}
Jul 15 10:20:26.859626 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:26.859569    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-446n9" podStartSLOduration=3.842383832 podStartE2EDuration="25.859550141s" totalImagesPullingTime="22.017166309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:20:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:20:26.858719185 +0000 UTC m=+25.678361057" watchObservedRunningTime="2026-07-15 10:20:26.859550141 +0000 UTC m=+25.679192013"
Jul 15 10:20:27.645961 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:27.645927    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:27.646167 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:27.645927    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:27.646167 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:27.646051    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:27.646167 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:27.646151    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:28.641991 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:28.641939    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:28.642719 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:28.642088    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:29.177544 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:29.177512    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dwq9h"
Jul 15 10:20:29.178091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:29.178069    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dwq9h"
Jul 15 10:20:29.645422 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:29.645349    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:29.645936 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:29.645349    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:29.645936 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:29.645454    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:29.645936 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:29.645524    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:29.848016 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:29.847990    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:20:29.848407 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:29.848384    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b94br" event={"ID":"28e62077-4f3c-41b1-a6da-ffd066a86033","Type":"ContainerStarted","Data":"e5c060fca6ec9485c940b82a2aaba74243748a083b8b75feab28e2fda63922fa"}
Jul 15 10:20:29.850018 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:29.849990    2568 generic.go:356] "Generic (PLEG): container finished" podID="d959c3bd-248e-4d1e-92f4-d64a2903c707" containerID="204f7ccdfeef87cba5354413a9ba1b5eb9649c219e03026ca442183cde235ab5" exitCode=0
Jul 15 10:20:29.850169 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:29.850074    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cj5h" event={"ID":"d959c3bd-248e-4d1e-92f4-d64a2903c707","Type":"ContainerDied","Data":"204f7ccdfeef87cba5354413a9ba1b5eb9649c219e03026ca442183cde235ab5"}
Jul 15 10:20:29.850475 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:29.850458    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dwq9h"
Jul 15 10:20:29.851583 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:29.851565    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dwq9h"
Jul 15 10:20:30.642525 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:30.642487    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:30.642788 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:30.642609    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:31.643340 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:31.643045    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:31.643755 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:31.643102    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:31.643755 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:31.643457    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:31.643755 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:31.643507    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:31.860205 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:31.860178    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:20:31.860574 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:31.860540    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b94br" event={"ID":"28e62077-4f3c-41b1-a6da-ffd066a86033","Type":"ContainerStarted","Data":"e3d30dda9460826af25a5dbc226ccfd3a45fef5c1f0efa26aa04e2d37b332ec1"}
Jul 15 10:20:31.860906 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:31.860875    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:31.861045 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:31.861027    2568 scope.go:117] "RemoveContainer" containerID="e87a196630d0ee624567a7169a8dbaa4dcfa71b4cdb7dd7f3b33ba85c29da71f"
Jul 15 10:20:31.863159 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:31.863129    2568 generic.go:356] "Generic (PLEG): container finished" podID="d959c3bd-248e-4d1e-92f4-d64a2903c707" containerID="c801163ac76b070dc214156fb83dccf555cea17fb6c77936bd6ae937d631cab1" exitCode=0
Jul 15 10:20:31.863159 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:31.863154    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cj5h" event={"ID":"d959c3bd-248e-4d1e-92f4-d64a2903c707","Type":"ContainerDied","Data":"c801163ac76b070dc214156fb83dccf555cea17fb6c77936bd6ae937d631cab1"}
Jul 15 10:20:31.880256 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:31.880232    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:32.641892 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:32.641862    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:32.642071 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:32.641967    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:32.869375 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:32.869349    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:20:32.869752 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:32.869652    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b94br" event={"ID":"28e62077-4f3c-41b1-a6da-ffd066a86033","Type":"ContainerStarted","Data":"e6317172501a63a52acf7b05a8b92be7695e12be0b80f9b6a5a3f6b893754ff7"}
Jul 15 10:20:32.869881 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:32.869859    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:32.870018 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:32.869933    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:32.885788 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:32.885761    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:20:32.899505 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:32.899416    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-b94br" podStartSLOduration=11.521141357 podStartE2EDuration="31.899400918s" totalImagesPullingTime="20.378259561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:20:32.899206895 +0000 UTC m=+31.718848766" watchObservedRunningTime="2026-07-15 10:20:32.899400918 +0000 UTC m=+31.719042790"
Jul 15 10:20:33.642358 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:33.642157    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:33.642505 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:33.642185    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:33.642505 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:33.642443    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:33.642505 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:33.642496    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:33.669089 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:33.669056    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lxnrt"]
Jul 15 10:20:33.671446 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:33.671420    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5r2sb"]
Jul 15 10:20:33.671571 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:33.671522    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:33.671640 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:33.671618    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:33.685808 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:33.685780    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dbd7d"]
Jul 15 10:20:33.874668 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:33.874634    2568 generic.go:356] "Generic (PLEG): container finished" podID="d959c3bd-248e-4d1e-92f4-d64a2903c707" containerID="ec63a8739b1f6c7df34b7c9a133d927769ad4d0639f38cc25f0b6dea14b22295" exitCode=0
Jul 15 10:20:33.875389 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:33.874722    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:33.875389 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:33.874727    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:33.875389 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:33.874730    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cj5h" event={"ID":"d959c3bd-248e-4d1e-92f4-d64a2903c707","Type":"ContainerDied","Data":"ec63a8739b1f6c7df34b7c9a133d927769ad4d0639f38cc25f0b6dea14b22295"}
Jul 15 10:20:33.875389 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:33.874975    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:33.875389 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:33.874983    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:35.261885 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:35.261844    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret\") pod \"global-pull-secret-syncer-5r2sb\" (UID: \"141455ed-ae53-465c-8979-db50257b660f\") " pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:35.262506 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:35.262004    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 10:20:35.262506 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:35.262083    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret podName:141455ed-ae53-465c-8979-db50257b660f nodeName:}" failed. No retries permitted until 2026-07-15 10:21:07.262063762 +0000 UTC m=+66.081705622 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret") pod "global-pull-secret-syncer-5r2sb" (UID: "141455ed-ae53-465c-8979-db50257b660f") : object "kube-system"/"original-pull-secret" not registered
Jul 15 10:20:35.362720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:35.362681    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs\") pod \"network-metrics-daemon-dbd7d\" (UID: \"8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9\") " pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:35.362890 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:35.362845    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:20:35.362985 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:35.362948    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs podName:8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9 nodeName:}" failed. No retries permitted until 2026-07-15 10:21:07.362927735 +0000 UTC m=+66.182569586 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs") pod "network-metrics-daemon-dbd7d" (UID: "8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:20:35.463836 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:35.463793    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbkxg\" (UniqueName: \"kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg\") pod \"network-check-target-lxnrt\" (UID: \"3e69daa3-77e6-44a2-9d3d-4072bdf5424d\") " pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:35.464024 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:35.463969    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 10:20:35.464024 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:35.463988    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 10:20:35.464024 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:35.463999    2568 projected.go:196] Error preparing data for projected volume kube-api-access-jbkxg for pod openshift-network-diagnostics/network-check-target-lxnrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:20:35.464183 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:35.464077    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg podName:3e69daa3-77e6-44a2-9d3d-4072bdf5424d nodeName:}" failed. No retries permitted until 2026-07-15 10:21:07.464056237 +0000 UTC m=+66.283698108 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbkxg" (UniqueName: "kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg") pod "network-check-target-lxnrt" (UID: "3e69daa3-77e6-44a2-9d3d-4072bdf5424d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:20:35.641571 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:35.641484    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:35.641745 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:35.641484    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:35.641745 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:35.641628    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:35.641745 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:35.641488    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:35.641745 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:35.641691    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:35.641931 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:35.641764    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:37.642197 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:37.642148    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:37.642197 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:37.642173    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:37.642803 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:37.642148    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:37.642803 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:37.642291    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r2sb" podUID="141455ed-ae53-465c-8979-db50257b660f"
Jul 15 10:20:37.642803 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:37.642380    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbd7d" podUID="8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9"
Jul 15 10:20:37.642803 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:37.642451    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxnrt" podUID="3e69daa3-77e6-44a2-9d3d-4072bdf5424d"
Jul 15 10:20:38.024802 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.024777    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeReady"
Jul 15 10:20:38.024930 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.024909    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 10:20:38.075214 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.075135    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7rhhh"]
Jul 15 10:20:38.077932 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.077908    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6xzcz"]
Jul 15 10:20:38.078053 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.078037    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:38.080618 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.080594    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 10:20:38.080742 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.080593    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 10:20:38.080742 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.080645    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jf9sn\""
Jul 15 10:20:38.080742 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.080719    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6xzcz"
Jul 15 10:20:38.083403 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.083373    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vwrs8\""
Jul 15 10:20:38.083403 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.083389    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 10:20:38.083581 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.083431    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 10:20:38.083709 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.083692    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 10:20:38.088832 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.088810    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7rhhh"]
Jul 15 10:20:38.094623 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.094600    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6xzcz"]
Jul 15 10:20:38.186178 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.186139    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-config-volume\") pod \"dns-default-7rhhh\" (UID: \"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6\") " pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:38.186178 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.186181    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls\") pod \"dns-default-7rhhh\" (UID: \"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6\") " pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:38.186352 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.186220    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e06b4d6-70ef-41f0-b4c7-70523622703a-cert\") pod \"ingress-canary-6xzcz\" (UID: \"2e06b4d6-70ef-41f0-b4c7-70523622703a\") " pod="openshift-ingress-canary/ingress-canary-6xzcz"
Jul 15 10:20:38.186352 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.186246    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-tmp-dir\") pod \"dns-default-7rhhh\" (UID: \"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6\") " pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:38.186352 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.186323    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42lhh\" (UniqueName: \"kubernetes.io/projected/2e06b4d6-70ef-41f0-b4c7-70523622703a-kube-api-access-42lhh\") pod \"ingress-canary-6xzcz\" (UID: \"2e06b4d6-70ef-41f0-b4c7-70523622703a\") " pod="openshift-ingress-canary/ingress-canary-6xzcz"
Jul 15 10:20:38.186464 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.186362    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hdss\" (UniqueName: \"kubernetes.io/projected/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-kube-api-access-8hdss\") pod \"dns-default-7rhhh\" (UID: \"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6\") " pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:38.287169 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.286862    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-config-volume\") pod \"dns-default-7rhhh\" (UID: \"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6\") " pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:38.287348 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.287200    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls\") pod \"dns-default-7rhhh\" (UID: \"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6\") " pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:38.287348 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.287255    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e06b4d6-70ef-41f0-b4c7-70523622703a-cert\") pod \"ingress-canary-6xzcz\" (UID: \"2e06b4d6-70ef-41f0-b4c7-70523622703a\") " pod="openshift-ingress-canary/ingress-canary-6xzcz"
Jul 15 10:20:38.287348 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.287309    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-tmp-dir\") pod \"dns-default-7rhhh\" (UID: \"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6\") " pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:38.287504 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:38.287375    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 10:20:38.287504 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:38.287451    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls podName:40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:38.787430508 +0000 UTC m=+37.607072368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls") pod "dns-default-7rhhh" (UID: "40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6") : secret "dns-default-metrics-tls" not found
Jul 15 10:20:38.287504 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.287475    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42lhh\" (UniqueName: \"kubernetes.io/projected/2e06b4d6-70ef-41f0-b4c7-70523622703a-kube-api-access-42lhh\") pod \"ingress-canary-6xzcz\" (UID: \"2e06b4d6-70ef-41f0-b4c7-70523622703a\") " pod="openshift-ingress-canary/ingress-canary-6xzcz"
Jul 15 10:20:38.287653 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.287512    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hdss\" (UniqueName: \"kubernetes.io/projected/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-kube-api-access-8hdss\") pod \"dns-default-7rhhh\" (UID: \"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6\") " pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:38.287653 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.287586    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-tmp-dir\") pod \"dns-default-7rhhh\" (UID: \"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6\") " pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:38.287653 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.287608    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-config-volume\") pod \"dns-default-7rhhh\" (UID: \"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6\") " pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:38.291906 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.291874    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e06b4d6-70ef-41f0-b4c7-70523622703a-cert\") pod \"ingress-canary-6xzcz\" (UID: \"2e06b4d6-70ef-41f0-b4c7-70523622703a\") " pod="openshift-ingress-canary/ingress-canary-6xzcz"
Jul 15 10:20:38.297406 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.297369    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42lhh\" (UniqueName: \"kubernetes.io/projected/2e06b4d6-70ef-41f0-b4c7-70523622703a-kube-api-access-42lhh\") pod \"ingress-canary-6xzcz\" (UID: \"2e06b4d6-70ef-41f0-b4c7-70523622703a\") " pod="openshift-ingress-canary/ingress-canary-6xzcz"
Jul 15 10:20:38.297528 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.297497    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hdss\" (UniqueName: \"kubernetes.io/projected/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-kube-api-access-8hdss\") pod \"dns-default-7rhhh\" (UID: \"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6\") " pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:38.393414 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.393272    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6xzcz"
Jul 15 10:20:38.541820 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.541790    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6xzcz"]
Jul 15 10:20:38.545539 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:20:38.545502    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e06b4d6_70ef_41f0_b4c7_70523622703a.slice/crio-8a826a4eda2ff4fe6bd2a35cf630aab3cd42ee2bb8e6913cc0a514fe3fd4d095 WatchSource:0}: Error finding container 8a826a4eda2ff4fe6bd2a35cf630aab3cd42ee2bb8e6913cc0a514fe3fd4d095: Status 404 returned error can't find the container with id 8a826a4eda2ff4fe6bd2a35cf630aab3cd42ee2bb8e6913cc0a514fe3fd4d095
Jul 15 10:20:38.792053 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.792025    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls\") pod \"dns-default-7rhhh\" (UID: \"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6\") " pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:38.792461 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:38.792234    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 10:20:38.792461 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:38.792305    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls podName:40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:39.792287088 +0000 UTC m=+38.611928949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls") pod "dns-default-7rhhh" (UID: "40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6") : secret "dns-default-metrics-tls" not found
Jul 15 10:20:38.893995 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.893961    2568 generic.go:356] "Generic (PLEG): container finished" podID="d959c3bd-248e-4d1e-92f4-d64a2903c707" containerID="a321d30f6c755b8503dab1de265409a3c997070d8da96a5485cc6e9bb37e14ec" exitCode=0
Jul 15 10:20:38.894213 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.894034    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cj5h" event={"ID":"d959c3bd-248e-4d1e-92f4-d64a2903c707","Type":"ContainerDied","Data":"a321d30f6c755b8503dab1de265409a3c997070d8da96a5485cc6e9bb37e14ec"}
Jul 15 10:20:38.895180 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:38.895155    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6xzcz" event={"ID":"2e06b4d6-70ef-41f0-b4c7-70523622703a","Type":"ContainerStarted","Data":"8a826a4eda2ff4fe6bd2a35cf630aab3cd42ee2bb8e6913cc0a514fe3fd4d095"}
Jul 15 10:20:39.642360 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:39.642324    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:20:39.642360 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:39.642356    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:20:39.642599 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:39.642323    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:20:39.646310 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:39.646274    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 10:20:39.646310 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:39.646290    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 10:20:39.646524 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:39.646338    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-krhcr\""
Jul 15 10:20:39.646524 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:39.646291    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 10:20:39.646625 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:39.646596    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 10:20:39.646811 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:39.646795    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fdfwf\""
Jul 15 10:20:39.800529 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:39.800326    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls\") pod \"dns-default-7rhhh\" (UID: \"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6\") " pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:39.800921 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:39.800459    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 10:20:39.800921 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:39.800626    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls podName:40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:41.800609617 +0000 UTC m=+40.620251480 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls") pod "dns-default-7rhhh" (UID: "40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6") : secret "dns-default-metrics-tls" not found
Jul 15 10:20:39.901633 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:39.901550    2568 generic.go:356] "Generic (PLEG): container finished" podID="d959c3bd-248e-4d1e-92f4-d64a2903c707" containerID="b57648061b264b973abbca559b632f37ff4acae70ff32eee80903716397751e3" exitCode=0
Jul 15 10:20:39.901633 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:39.901610    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cj5h" event={"ID":"d959c3bd-248e-4d1e-92f4-d64a2903c707","Type":"ContainerDied","Data":"b57648061b264b973abbca559b632f37ff4acae70ff32eee80903716397751e3"}
Jul 15 10:20:40.824983 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:40.824954    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k8c9s"]
Jul 15 10:20:40.835640 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:40.835611    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:40.838230 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:40.838204    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 10:20:40.838230 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:40.838219    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 10:20:40.838458 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:40.838243    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 10:20:40.838458 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:40.838320    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 10:20:40.838458 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:40.838327    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-b6kmk\""
Jul 15 10:20:40.840601 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:40.840551    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k8c9s"]
Jul 15 10:20:40.907614 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:40.907574    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cj5h" event={"ID":"d959c3bd-248e-4d1e-92f4-d64a2903c707","Type":"ContainerStarted","Data":"4a905e50ea5be913414c7bfea1d9f6a213dd086e71331715e4ea0276252e6eaa"}
Jul 15 10:20:40.933384 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:40.933332    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4cj5h" podStartSLOduration=9.411011923 podStartE2EDuration="39.933313885s" totalImagesPullingTime="30.522301962s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:20:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:20:40.931924064 +0000 UTC m=+39.751565937" watchObservedRunningTime="2026-07-15 10:20:40.933313885 +0000 UTC m=+39.752955757"
Jul 15 10:20:41.009987 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.009945    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:41.010208 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.010027    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5304fd-c68b-43fe-8f79-049af23c39d6-data-volume\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:41.010208 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.010141    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e5304fd-c68b-43fe-8f79-049af23c39d6-crio-socket\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:41.010208 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.010161    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:41.010362 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.010255    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx6zp\" (UniqueName: \"kubernetes.io/projected/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-api-access-hx6zp\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:41.111559 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.111517    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx6zp\" (UniqueName: \"kubernetes.io/projected/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-api-access-hx6zp\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:41.111751 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.111601    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:41.111751 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.111635    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5304fd-c68b-43fe-8f79-049af23c39d6-data-volume\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:41.111751 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.111653    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e5304fd-c68b-43fe-8f79-049af23c39d6-crio-socket\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:41.111751 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.111671    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:41.111751 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:41.111727    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 10:20:41.112004 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:41.111769    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 10:20:41.112004 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:41.111824    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-rbac-proxy-cm podName:8e5304fd-c68b-43fe-8f79-049af23c39d6 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:41.611803511 +0000 UTC m=+40.431445361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k8c9s" (UID: "8e5304fd-c68b-43fe-8f79-049af23c39d6") : configmap "kube-rbac-proxy" not found
Jul 15 10:20:41.112004 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:41.111843    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls podName:8e5304fd-c68b-43fe-8f79-049af23c39d6 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:41.611834989 +0000 UTC m=+40.431476843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k8c9s" (UID: "8e5304fd-c68b-43fe-8f79-049af23c39d6") : secret "insights-runtime-extractor-tls" not found
Jul 15 10:20:41.112004 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.111905    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e5304fd-c68b-43fe-8f79-049af23c39d6-crio-socket\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:41.112208 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.112026    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5304fd-c68b-43fe-8f79-049af23c39d6-data-volume\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:41.123532 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.123463    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx6zp\" (UniqueName: \"kubernetes.io/projected/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-api-access-hx6zp\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:41.241402 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.241370    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rs65s"]
Jul 15 10:20:41.262286 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.262258    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rs65s"]
Jul 15 10:20:41.262440 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.262381    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rs65s"
Jul 15 10:20:41.265326 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.265302    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 15 10:20:41.265475 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.265354    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 15 10:20:41.265475 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.265354    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xbp77\""
Jul 15 10:20:41.413837 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.413751    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4qbn\" (UniqueName: \"kubernetes.io/projected/f33a2eac-6ada-48c8-8a3e-3a97437eb596-kube-api-access-c4qbn\") pod \"migrator-7f59b54f6c-rs65s\" (UID: \"f33a2eac-6ada-48c8-8a3e-3a97437eb596\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rs65s"
Jul 15 10:20:41.514698 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.514657    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4qbn\" (UniqueName: \"kubernetes.io/projected/f33a2eac-6ada-48c8-8a3e-3a97437eb596-kube-api-access-c4qbn\") pod \"migrator-7f59b54f6c-rs65s\" (UID: \"f33a2eac-6ada-48c8-8a3e-3a97437eb596\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rs65s"
Jul 15 10:20:41.524766 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.524738    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4qbn\" (UniqueName: \"kubernetes.io/projected/f33a2eac-6ada-48c8-8a3e-3a97437eb596-kube-api-access-c4qbn\") pod \"migrator-7f59b54f6c-rs65s\" (UID: \"f33a2eac-6ada-48c8-8a3e-3a97437eb596\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rs65s"
Jul 15 10:20:41.571437 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.571405    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rs65s"
Jul 15 10:20:41.615245 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.615204    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:41.615417 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:41.615312    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 10:20:41.615417 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.615337    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:41.615417 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:41.615378    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-rbac-proxy-cm podName:8e5304fd-c68b-43fe-8f79-049af23c39d6 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:42.615362224 +0000 UTC m=+41.435004076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k8c9s" (UID: "8e5304fd-c68b-43fe-8f79-049af23c39d6") : configmap "kube-rbac-proxy" not found
Jul 15 10:20:41.615529 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:41.615466    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 10:20:41.615562 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:41.615531    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls podName:8e5304fd-c68b-43fe-8f79-049af23c39d6 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:42.615510199 +0000 UTC m=+41.435152072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k8c9s" (UID: "8e5304fd-c68b-43fe-8f79-049af23c39d6") : secret "insights-runtime-extractor-tls" not found
Jul 15 10:20:41.735747 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.735489    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rs65s"]
Jul 15 10:20:41.739523 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:20:41.739493    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf33a2eac_6ada_48c8_8a3e_3a97437eb596.slice/crio-75ba278c731b57ce5c5e4e5bc27bc10efd0fc74f8058eb5b5e959cbcd45d2e04 WatchSource:0}: Error finding container 75ba278c731b57ce5c5e4e5bc27bc10efd0fc74f8058eb5b5e959cbcd45d2e04: Status 404 returned error can't find the container with id 75ba278c731b57ce5c5e4e5bc27bc10efd0fc74f8058eb5b5e959cbcd45d2e04
Jul 15 10:20:41.816551 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.816515    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls\") pod \"dns-default-7rhhh\" (UID: \"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6\") " pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:41.816717 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:41.816670    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 10:20:41.816761 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:41.816752    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls podName:40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:45.816736253 +0000 UTC m=+44.636378118 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls") pod "dns-default-7rhhh" (UID: "40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6") : secret "dns-default-metrics-tls" not found
Jul 15 10:20:41.913042 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.913005    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rs65s" event={"ID":"f33a2eac-6ada-48c8-8a3e-3a97437eb596","Type":"ContainerStarted","Data":"75ba278c731b57ce5c5e4e5bc27bc10efd0fc74f8058eb5b5e959cbcd45d2e04"}
Jul 15 10:20:41.914367 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.914340    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6xzcz" event={"ID":"2e06b4d6-70ef-41f0-b4c7-70523622703a","Type":"ContainerStarted","Data":"ac4033c891aefa24e67e9aeac8644d87ea9f9220a9f59983dd13441be5f53ce2"}
Jul 15 10:20:41.941701 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:41.941608    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6xzcz" podStartSLOduration=1.688665151 podStartE2EDuration="3.941587982s" totalImagesPullingTime="2.252922831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:20:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:20:41.941052864 +0000 UTC m=+40.760694746" watchObservedRunningTime="2026-07-15 10:20:41.941587982 +0000 UTC m=+40.761229852"
Jul 15 10:20:42.622928 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:42.622853    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:42.623107 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:42.623018    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:42.623107 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:42.623056    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 10:20:42.623277 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:42.623147    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 10:20:42.623277 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:42.623187    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls podName:8e5304fd-c68b-43fe-8f79-049af23c39d6 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:44.623164074 +0000 UTC m=+43.442805933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k8c9s" (UID: "8e5304fd-c68b-43fe-8f79-049af23c39d6") : secret "insights-runtime-extractor-tls" not found
Jul 15 10:20:42.623277 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:42.623210    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-rbac-proxy-cm podName:8e5304fd-c68b-43fe-8f79-049af23c39d6 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:44.623199181 +0000 UTC m=+43.442841034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k8c9s" (UID: "8e5304fd-c68b-43fe-8f79-049af23c39d6") : configmap "kube-rbac-proxy" not found
Jul 15 10:20:43.016660 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:43.016628    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xlk4p_793964cf-e10f-455e-ade5-5724240979d1/dns-node-resolver/0.log"
Jul 15 10:20:43.815821 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:43.815787    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n7pj6_04d03060-07a3-4ce5-a041-d56a227e615c/node-ca/0.log"
Jul 15 10:20:43.921524 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:43.921491    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rs65s" event={"ID":"f33a2eac-6ada-48c8-8a3e-3a97437eb596","Type":"ContainerStarted","Data":"59bb948990d252ead6a4572c002dbdd094a8c5ed06f6bfb77667c387d24bae57"}
Jul 15 10:20:44.616788 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:44.616765    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6xzcz_2e06b4d6-70ef-41f0-b4c7-70523622703a/serve-healthcheck-canary/0.log"
Jul 15 10:20:44.639099 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:44.639062    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:44.639182 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:44.639160    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:44.639230 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:44.639194    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 10:20:44.639275 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:44.639265    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-rbac-proxy-cm podName:8e5304fd-c68b-43fe-8f79-049af23c39d6 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:48.639245534 +0000 UTC m=+47.458887400 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k8c9s" (UID: "8e5304fd-c68b-43fe-8f79-049af23c39d6") : configmap "kube-rbac-proxy" not found
Jul 15 10:20:44.639315 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:44.639274    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 10:20:44.639315 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:44.639307    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls podName:8e5304fd-c68b-43fe-8f79-049af23c39d6 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:48.639297771 +0000 UTC m=+47.458939622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k8c9s" (UID: "8e5304fd-c68b-43fe-8f79-049af23c39d6") : secret "insights-runtime-extractor-tls" not found
Jul 15 10:20:44.926094 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:44.925997    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rs65s" event={"ID":"f33a2eac-6ada-48c8-8a3e-3a97437eb596","Type":"ContainerStarted","Data":"93f33ad4fc14ad3c4783bee704deba257ce07f709bf507406170143d63d86220"}
Jul 15 10:20:44.946094 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:44.945963    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rs65s" podStartSLOduration=1.9918329849999998 podStartE2EDuration="3.945940312s" totalImagesPullingTime="1.954107327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:20:44.94561231 +0000 UTC m=+43.765254181" watchObservedRunningTime="2026-07-15 10:20:44.945940312 +0000 UTC m=+43.765582183"
Jul 15 10:20:45.848927 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:45.848881    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls\") pod \"dns-default-7rhhh\" (UID: \"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6\") " pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:45.849341 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:45.849036    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 10:20:45.849341 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:45.849101    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls podName:40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:53.849086933 +0000 UTC m=+52.668728782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls") pod "dns-default-7rhhh" (UID: "40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6") : secret "dns-default-metrics-tls" not found
Jul 15 10:20:48.672055 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:48.671995    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:48.672454 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:48.672073    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:48.672454 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:48.672208    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 10:20:48.672454 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:20:48.672270    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls podName:8e5304fd-c68b-43fe-8f79-049af23c39d6 nodeName:}" failed. No retries permitted until 2026-07-15 10:20:56.672253426 +0000 UTC m=+55.491895299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k8c9s" (UID: "8e5304fd-c68b-43fe-8f79-049af23c39d6") : secret "insights-runtime-extractor-tls" not found
Jul 15 10:20:48.672614 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:48.672590    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e5304fd-c68b-43fe-8f79-049af23c39d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:53.912156 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:53.912099    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls\") pod \"dns-default-7rhhh\" (UID: \"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6\") " pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:53.915423 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:53.915401    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6-metrics-tls\") pod \"dns-default-7rhhh\" (UID: \"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6\") " pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:53.987824 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:53.987777    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:54.135281 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:54.135239    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7rhhh"]
Jul 15 10:20:54.137854 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:20:54.137832    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d1bebd_b7ed_4f6a_a2e9_31dafdb0aff6.slice/crio-e64b2eab0d8b200b12a36312e492bf4a6aa3a536bdd1d6dc8812ee50b590dd9d WatchSource:0}: Error finding container e64b2eab0d8b200b12a36312e492bf4a6aa3a536bdd1d6dc8812ee50b590dd9d: Status 404 returned error can't find the container with id e64b2eab0d8b200b12a36312e492bf4a6aa3a536bdd1d6dc8812ee50b590dd9d
Jul 15 10:20:54.952204 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:54.952155    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7rhhh" event={"ID":"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6","Type":"ContainerStarted","Data":"e64b2eab0d8b200b12a36312e492bf4a6aa3a536bdd1d6dc8812ee50b590dd9d"}
Jul 15 10:20:56.732954 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:56.732857    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:56.735253 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:56.735232    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e5304fd-c68b-43fe-8f79-049af23c39d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k8c9s\" (UID: \"8e5304fd-c68b-43fe-8f79-049af23c39d6\") " pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:56.752269 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:56.752233    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k8c9s"
Jul 15 10:20:56.896789 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:56.896758    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k8c9s"]
Jul 15 10:20:56.899885 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:20:56.899858    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5304fd_c68b_43fe_8f79_049af23c39d6.slice/crio-dbbe40c22d566f0d5a9a43c0fdaf008e5d5e8e49abb17b3a6973aa87f60ac313 WatchSource:0}: Error finding container dbbe40c22d566f0d5a9a43c0fdaf008e5d5e8e49abb17b3a6973aa87f60ac313: Status 404 returned error can't find the container with id dbbe40c22d566f0d5a9a43c0fdaf008e5d5e8e49abb17b3a6973aa87f60ac313
Jul 15 10:20:56.960880 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:56.960837    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7rhhh" event={"ID":"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6","Type":"ContainerStarted","Data":"7e7d6bbba4078e4f0667c7992a4002e774f88522917b5e55369b7315335ac0d1"}
Jul 15 10:20:56.961071 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:56.960906    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7rhhh" event={"ID":"40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6","Type":"ContainerStarted","Data":"d3dc1ce0da599803bb1f44753839d8bcb97e82a211db4326983f1b53657e801d"}
Jul 15 10:20:56.961071 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:56.960936    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:20:56.962055 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:56.962032    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k8c9s" event={"ID":"8e5304fd-c68b-43fe-8f79-049af23c39d6","Type":"ContainerStarted","Data":"dbbe40c22d566f0d5a9a43c0fdaf008e5d5e8e49abb17b3a6973aa87f60ac313"}
Jul 15 10:20:56.994155 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:20:56.994088    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7rhhh" podStartSLOduration=16.808143392 podStartE2EDuration="18.99407252s" totalImagesPullingTime="2.185929128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:20:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:20:56.993616803 +0000 UTC m=+55.813258674" watchObservedRunningTime="2026-07-15 10:20:56.99407252 +0000 UTC m=+55.813714391"
Jul 15 10:21:02.989812 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:02.989719    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k8c9s" event={"ID":"8e5304fd-c68b-43fe-8f79-049af23c39d6","Type":"ContainerStarted","Data":"1b4a638ac90d3f6da4b7ae7fbd616820683e13213f03a7a40f9663068eebb4f4"}
Jul 15 10:21:04.889476 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:04.889447    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b94br"
Jul 15 10:21:06.005057 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.005014    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k8c9s" event={"ID":"8e5304fd-c68b-43fe-8f79-049af23c39d6","Type":"ContainerStarted","Data":"c1fc0814952ee768edafbfec475ec1ee13e40d5349d145bf2e3399f0b246dfd2"}
Jul 15 10:21:06.792815 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.792780    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx"]
Jul 15 10:21:06.795969 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.795944    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx"
Jul 15 10:21:06.796486 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.796455    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh"]
Jul 15 10:21:06.799845 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.799578    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh"
Jul 15 10:21:06.799845 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.799652    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 10:21:06.799845 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.799673    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 10:21:06.799845 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.799687    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-spdf5\""
Jul 15 10:21:06.800153 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.799865    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 10:21:06.800153 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.800001    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 15 10:21:06.802034 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.802013    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 15 10:21:06.805377 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.805354    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx"]
Jul 15 10:21:06.809032 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.809002    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83c3bd76-59de-45f0-a9c9-06e04057f344-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx\" (UID: \"83c3bd76-59de-45f0-a9c9-06e04057f344\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx"
Jul 15 10:21:06.809164 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.809065    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zz2w\" (UniqueName: \"kubernetes.io/projected/83c3bd76-59de-45f0-a9c9-06e04057f344-kube-api-access-4zz2w\") pod \"managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx\" (UID: \"83c3bd76-59de-45f0-a9c9-06e04057f344\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx"
Jul 15 10:21:06.812227 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.812205    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh"]
Jul 15 10:21:06.895833 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.895798    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-msktx"]
Jul 15 10:21:06.898917 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.898894    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-msktx"
Jul 15 10:21:06.901441 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.901414    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-s7qtk\""
Jul 15 10:21:06.901582 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.901414    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 10:21:06.901654 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.901615    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 10:21:06.909273 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.909250    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-msktx"]
Jul 15 10:21:06.909546 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.909517    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83c3bd76-59de-45f0-a9c9-06e04057f344-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx\" (UID: \"83c3bd76-59de-45f0-a9c9-06e04057f344\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx"
Jul 15 10:21:06.909666 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.909599    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zz2w\" (UniqueName: \"kubernetes.io/projected/83c3bd76-59de-45f0-a9c9-06e04057f344-kube-api-access-4zz2w\") pod \"managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx\" (UID: \"83c3bd76-59de-45f0-a9c9-06e04057f344\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx"
Jul 15 10:21:06.909666 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.909650    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c8ccfbb4-32a1-4a13-b6aa-3c6675d29845-klusterlet-config\") pod \"klusterlet-addon-workmgr-6878bdfcb8-xvzwh\" (UID: \"c8ccfbb4-32a1-4a13-b6aa-3c6675d29845\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh"
Jul 15 10:21:06.909773 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.909688    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh74m\" (UniqueName: \"kubernetes.io/projected/c8ccfbb4-32a1-4a13-b6aa-3c6675d29845-kube-api-access-fh74m\") pod \"klusterlet-addon-workmgr-6878bdfcb8-xvzwh\" (UID: \"c8ccfbb4-32a1-4a13-b6aa-3c6675d29845\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh"
Jul 15 10:21:06.909773 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.909718    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8ccfbb4-32a1-4a13-b6aa-3c6675d29845-tmp\") pod \"klusterlet-addon-workmgr-6878bdfcb8-xvzwh\" (UID: \"c8ccfbb4-32a1-4a13-b6aa-3c6675d29845\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh"
Jul 15 10:21:06.912934 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.912906    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83c3bd76-59de-45f0-a9c9-06e04057f344-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx\" (UID: \"83c3bd76-59de-45f0-a9c9-06e04057f344\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx"
Jul 15 10:21:06.921767 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.921740    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zz2w\" (UniqueName: \"kubernetes.io/projected/83c3bd76-59de-45f0-a9c9-06e04057f344-kube-api-access-4zz2w\") pod \"managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx\" (UID: \"83c3bd76-59de-45f0-a9c9-06e04057f344\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx"
Jul 15 10:21:06.968289 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.968255    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7rhhh"
Jul 15 10:21:06.997701 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:06.997666    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-554ff97b4d-q2v5t"]
Jul 15 10:21:07.001234 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.001201    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.003853 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.003670    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 10:21:07.004002 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.003988    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 10:21:07.004298 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.004233    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qn4gb\""
Jul 15 10:21:07.004569 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.004550    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 10:21:07.009796 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.009771    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 10:21:07.010198 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.010173    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c8ccfbb4-32a1-4a13-b6aa-3c6675d29845-klusterlet-config\") pod \"klusterlet-addon-workmgr-6878bdfcb8-xvzwh\" (UID: \"c8ccfbb4-32a1-4a13-b6aa-3c6675d29845\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh"
Jul 15 10:21:07.010298 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.010238    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh74m\" (UniqueName: \"kubernetes.io/projected/c8ccfbb4-32a1-4a13-b6aa-3c6675d29845-kube-api-access-fh74m\") pod \"klusterlet-addon-workmgr-6878bdfcb8-xvzwh\" (UID: \"c8ccfbb4-32a1-4a13-b6aa-3c6675d29845\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh"
Jul 15 10:21:07.010298 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.010286    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8ccfbb4-32a1-4a13-b6aa-3c6675d29845-tmp\") pod \"klusterlet-addon-workmgr-6878bdfcb8-xvzwh\" (UID: \"c8ccfbb4-32a1-4a13-b6aa-3c6675d29845\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh"
Jul 15 10:21:07.010399 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.010338    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gvc2\" (UniqueName: \"kubernetes.io/projected/24646643-3ded-4ec7-bb42-ea442c25dc7a-kube-api-access-9gvc2\") pod \"downloads-68c9cbb497-msktx\" (UID: \"24646643-3ded-4ec7-bb42-ea442c25dc7a\") " pod="openshift-console/downloads-68c9cbb497-msktx"
Jul 15 10:21:07.011332 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.011307    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8ccfbb4-32a1-4a13-b6aa-3c6675d29845-tmp\") pod \"klusterlet-addon-workmgr-6878bdfcb8-xvzwh\" (UID: \"c8ccfbb4-32a1-4a13-b6aa-3c6675d29845\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh"
Jul 15 10:21:07.013990 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.013969    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c8ccfbb4-32a1-4a13-b6aa-3c6675d29845-klusterlet-config\") pod \"klusterlet-addon-workmgr-6878bdfcb8-xvzwh\" (UID: \"c8ccfbb4-32a1-4a13-b6aa-3c6675d29845\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh"
Jul 15 10:21:07.019102 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.019081    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-554ff97b4d-q2v5t"]
Jul 15 10:21:07.028083 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.028043    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh74m\" (UniqueName: \"kubernetes.io/projected/c8ccfbb4-32a1-4a13-b6aa-3c6675d29845-kube-api-access-fh74m\") pod \"klusterlet-addon-workmgr-6878bdfcb8-xvzwh\" (UID: \"c8ccfbb4-32a1-4a13-b6aa-3c6675d29845\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh"
Jul 15 10:21:07.111204 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.111089    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff9accb2-9d0c-4388-9c5a-130130b39c0e-bound-sa-token\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.111204 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.111162    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gvc2\" (UniqueName: \"kubernetes.io/projected/24646643-3ded-4ec7-bb42-ea442c25dc7a-kube-api-access-9gvc2\") pod \"downloads-68c9cbb497-msktx\" (UID: \"24646643-3ded-4ec7-bb42-ea442c25dc7a\") " pod="openshift-console/downloads-68c9cbb497-msktx"
Jul 15 10:21:07.111204 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.111197    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff9accb2-9d0c-4388-9c5a-130130b39c0e-image-registry-private-configuration\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.111489 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.111241    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff9accb2-9d0c-4388-9c5a-130130b39c0e-trusted-ca\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.111489 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.111263    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff9accb2-9d0c-4388-9c5a-130130b39c0e-installation-pull-secrets\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.111489 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.111305    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqnnd\" (UniqueName: \"kubernetes.io/projected/ff9accb2-9d0c-4388-9c5a-130130b39c0e-kube-api-access-wqnnd\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.111489 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.111349    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff9accb2-9d0c-4388-9c5a-130130b39c0e-registry-tls\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.111489 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.111365    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff9accb2-9d0c-4388-9c5a-130130b39c0e-registry-certificates\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.111489 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.111383    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff9accb2-9d0c-4388-9c5a-130130b39c0e-ca-trust-extracted\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.118736 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.118705    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx"
Jul 15 10:21:07.121796 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.121772    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gvc2\" (UniqueName: \"kubernetes.io/projected/24646643-3ded-4ec7-bb42-ea442c25dc7a-kube-api-access-9gvc2\") pod \"downloads-68c9cbb497-msktx\" (UID: \"24646643-3ded-4ec7-bb42-ea442c25dc7a\") " pod="openshift-console/downloads-68c9cbb497-msktx"
Jul 15 10:21:07.125049 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.125024    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh"
Jul 15 10:21:07.209335 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.209031    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-msktx"
Jul 15 10:21:07.212472 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.212447    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff9accb2-9d0c-4388-9c5a-130130b39c0e-installation-pull-secrets\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.212589 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.212489    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqnnd\" (UniqueName: \"kubernetes.io/projected/ff9accb2-9d0c-4388-9c5a-130130b39c0e-kube-api-access-wqnnd\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.212589 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.212517    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff9accb2-9d0c-4388-9c5a-130130b39c0e-registry-tls\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.212589 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.212534    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff9accb2-9d0c-4388-9c5a-130130b39c0e-registry-certificates\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.212589 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.212550    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff9accb2-9d0c-4388-9c5a-130130b39c0e-ca-trust-extracted\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.212589 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.212586    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff9accb2-9d0c-4388-9c5a-130130b39c0e-bound-sa-token\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.212749 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.212602    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff9accb2-9d0c-4388-9c5a-130130b39c0e-image-registry-private-configuration\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.212749 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.212625    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff9accb2-9d0c-4388-9c5a-130130b39c0e-trusted-ca\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.213760 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.213302    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff9accb2-9d0c-4388-9c5a-130130b39c0e-ca-trust-extracted\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.213879 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.213855    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff9accb2-9d0c-4388-9c5a-130130b39c0e-trusted-ca\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.215280 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.214544    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff9accb2-9d0c-4388-9c5a-130130b39c0e-registry-certificates\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.218247 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.217155    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff9accb2-9d0c-4388-9c5a-130130b39c0e-image-registry-private-configuration\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.220384 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.220339    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff9accb2-9d0c-4388-9c5a-130130b39c0e-installation-pull-secrets\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.221079 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.221057    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff9accb2-9d0c-4388-9c5a-130130b39c0e-registry-tls\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.225018 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.224975    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff9accb2-9d0c-4388-9c5a-130130b39c0e-bound-sa-token\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.227604 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.227575    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqnnd\" (UniqueName: \"kubernetes.io/projected/ff9accb2-9d0c-4388-9c5a-130130b39c0e-kube-api-access-wqnnd\") pod \"image-registry-554ff97b4d-q2v5t\" (UID: \"ff9accb2-9d0c-4388-9c5a-130130b39c0e\") " pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.277991 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.277763    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx"]
Jul 15 10:21:07.283842 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:21:07.282675    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83c3bd76_59de_45f0_a9c9_06e04057f344.slice/crio-fcc9bcb4b224d81f4cff46cba6981f33e57d5a83a469e90b66fa37fc87d2d4d6 WatchSource:0}: Error finding container fcc9bcb4b224d81f4cff46cba6981f33e57d5a83a469e90b66fa37fc87d2d4d6: Status 404 returned error can't find the container with id fcc9bcb4b224d81f4cff46cba6981f33e57d5a83a469e90b66fa37fc87d2d4d6
Jul 15 10:21:07.306537 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.306509    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh"]
Jul 15 10:21:07.309674 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:21:07.309639    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ccfbb4_32a1_4a13_b6aa_3c6675d29845.slice/crio-fadbe21244b0d58e1f97c440cb68f4104ba70412a0157a1b2c1b90ee68c1638d WatchSource:0}: Error finding container fadbe21244b0d58e1f97c440cb68f4104ba70412a0157a1b2c1b90ee68c1638d: Status 404 returned error can't find the container with id fadbe21244b0d58e1f97c440cb68f4104ba70412a0157a1b2c1b90ee68c1638d
Jul 15 10:21:07.313427 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.313403    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret\") pod \"global-pull-secret-syncer-5r2sb\" (UID: \"141455ed-ae53-465c-8979-db50257b660f\") " pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:21:07.313599 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.313577    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:07.316913 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.316580    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 10:21:07.327010 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.326770    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/141455ed-ae53-465c-8979-db50257b660f-original-pull-secret\") pod \"global-pull-secret-syncer-5r2sb\" (UID: \"141455ed-ae53-465c-8979-db50257b660f\") " pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:21:07.376596 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.376500    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-msktx"]
Jul 15 10:21:07.380892 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:21:07.380864    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24646643_3ded_4ec7_bb42_ea442c25dc7a.slice/crio-a429cef297a6d16e8ab0fe754769ff6834f08a39b1b01ada3ac73099bb4f878b WatchSource:0}: Error finding container a429cef297a6d16e8ab0fe754769ff6834f08a39b1b01ada3ac73099bb4f878b: Status 404 returned error can't find the container with id a429cef297a6d16e8ab0fe754769ff6834f08a39b1b01ada3ac73099bb4f878b
Jul 15 10:21:07.414667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.414626    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs\") pod \"network-metrics-daemon-dbd7d\" (UID: \"8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9\") " pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:21:07.417504 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.417477    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 10:21:07.428777 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.428751    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9-metrics-certs\") pod \"network-metrics-daemon-dbd7d\" (UID: \"8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9\") " pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:21:07.473350 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.473321    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-554ff97b4d-q2v5t"]
Jul 15 10:21:07.515453 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.515418    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbkxg\" (UniqueName: \"kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg\") pod \"network-check-target-lxnrt\" (UID: \"3e69daa3-77e6-44a2-9d3d-4072bdf5424d\") " pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:21:07.518289 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.518266    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 10:21:07.528898 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.528871    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 10:21:07.539912 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.539884    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbkxg\" (UniqueName: \"kubernetes.io/projected/3e69daa3-77e6-44a2-9d3d-4072bdf5424d-kube-api-access-jbkxg\") pod \"network-check-target-lxnrt\" (UID: \"3e69daa3-77e6-44a2-9d3d-4072bdf5424d\") " pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:21:07.557698 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.557658    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-krhcr\""
Jul 15 10:21:07.564833 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.564806    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbd7d"
Jul 15 10:21:07.565233 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.565212    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fdfwf\""
Jul 15 10:21:07.569007 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.568985    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r2sb"
Jul 15 10:21:07.573834 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:07.573809    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:21:08.013280 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:08.013237    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-msktx" event={"ID":"24646643-3ded-4ec7-bb42-ea442c25dc7a","Type":"ContainerStarted","Data":"a429cef297a6d16e8ab0fe754769ff6834f08a39b1b01ada3ac73099bb4f878b"}
Jul 15 10:21:08.014489 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:08.014454    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx" event={"ID":"83c3bd76-59de-45f0-a9c9-06e04057f344","Type":"ContainerStarted","Data":"fcc9bcb4b224d81f4cff46cba6981f33e57d5a83a469e90b66fa37fc87d2d4d6"}
Jul 15 10:21:08.015643 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:08.015617    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh" event={"ID":"c8ccfbb4-32a1-4a13-b6aa-3c6675d29845","Type":"ContainerStarted","Data":"fadbe21244b0d58e1f97c440cb68f4104ba70412a0157a1b2c1b90ee68c1638d"}
Jul 15 10:21:09.067678 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:21:09.067638    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff9accb2_9d0c_4388_9c5a_130130b39c0e.slice/crio-a0870a8b54257671452b34150645be24350e01274c77266029bb53cf187469c7 WatchSource:0}: Error finding container a0870a8b54257671452b34150645be24350e01274c77266029bb53cf187469c7: Status 404 returned error can't find the container with id a0870a8b54257671452b34150645be24350e01274c77266029bb53cf187469c7
Jul 15 10:21:09.256781 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:09.256616    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dbd7d"]
Jul 15 10:21:09.266827 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:21:09.266762    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5f5f8a_6db9_4f5c_ac26_12ad0a1638c9.slice/crio-f67e235c2ff251e292a1f1bcb1152b4c7230b77dd8e74af4b379407cad54e248 WatchSource:0}: Error finding container f67e235c2ff251e292a1f1bcb1152b4c7230b77dd8e74af4b379407cad54e248: Status 404 returned error can't find the container with id f67e235c2ff251e292a1f1bcb1152b4c7230b77dd8e74af4b379407cad54e248
Jul 15 10:21:09.278058 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:09.277979    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lxnrt"]
Jul 15 10:21:09.281914 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:21:09.281882    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e69daa3_77e6_44a2_9d3d_4072bdf5424d.slice/crio-577a208f2b520968a6939ebc2e2160e531cd5393d6cca3da7df51bfea3f5b1fe WatchSource:0}: Error finding container 577a208f2b520968a6939ebc2e2160e531cd5393d6cca3da7df51bfea3f5b1fe: Status 404 returned error can't find the container with id 577a208f2b520968a6939ebc2e2160e531cd5393d6cca3da7df51bfea3f5b1fe
Jul 15 10:21:09.303368 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:09.301207    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5r2sb"]
Jul 15 10:21:09.311615 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:21:09.311565    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141455ed_ae53_465c_8979_db50257b660f.slice/crio-2d8137f333502863772bb9e66660a6ff1efa8b08434a3a95d9fcf7eab9d8e031 WatchSource:0}: Error finding container 2d8137f333502863772bb9e66660a6ff1efa8b08434a3a95d9fcf7eab9d8e031: Status 404 returned error can't find the container with id 2d8137f333502863772bb9e66660a6ff1efa8b08434a3a95d9fcf7eab9d8e031
Jul 15 10:21:10.029540 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:10.029446    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dbd7d" event={"ID":"8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9","Type":"ContainerStarted","Data":"f67e235c2ff251e292a1f1bcb1152b4c7230b77dd8e74af4b379407cad54e248"}
Jul 15 10:21:10.032771 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:10.032689    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lxnrt" event={"ID":"3e69daa3-77e6-44a2-9d3d-4072bdf5424d","Type":"ContainerStarted","Data":"577a208f2b520968a6939ebc2e2160e531cd5393d6cca3da7df51bfea3f5b1fe"}
Jul 15 10:21:10.042517 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:10.041587    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k8c9s" event={"ID":"8e5304fd-c68b-43fe-8f79-049af23c39d6","Type":"ContainerStarted","Data":"48305949dfe6c2edddbc7c59f4e818733459049175193caa40595dd1d8d33094"}
Jul 15 10:21:10.045739 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:10.045062    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t" event={"ID":"ff9accb2-9d0c-4388-9c5a-130130b39c0e","Type":"ContainerStarted","Data":"7305b67272f55aeac3939954dc1cf67d0af7738a3057071dfb01b45d0b177865"}
Jul 15 10:21:10.045739 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:10.045124    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t" event={"ID":"ff9accb2-9d0c-4388-9c5a-130130b39c0e","Type":"ContainerStarted","Data":"a0870a8b54257671452b34150645be24350e01274c77266029bb53cf187469c7"}
Jul 15 10:21:10.045739 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:10.045689    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:10.048402 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:10.048339    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5r2sb" event={"ID":"141455ed-ae53-465c-8979-db50257b660f","Type":"ContainerStarted","Data":"2d8137f333502863772bb9e66660a6ff1efa8b08434a3a95d9fcf7eab9d8e031"}
Jul 15 10:21:10.068375 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:10.068155    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k8c9s" podStartSLOduration=17.940563024 podStartE2EDuration="30.068024936s" totalImagesPullingTime="12.127461912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:20:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:21:10.067940072 +0000 UTC m=+68.887581947" watchObservedRunningTime="2026-07-15 10:21:10.068024936 +0000 UTC m=+68.887666811"
Jul 15 10:21:10.091506 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:10.090988    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t" podStartSLOduration=4.090963728 podStartE2EDuration="4.090963728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:21:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:21:10.089953332 +0000 UTC m=+68.909595204" watchObservedRunningTime="2026-07-15 10:21:10.090963728 +0000 UTC m=+68.910605595"
Jul 15 10:21:11.635917 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:11.635786    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n89h2"]
Jul 15 10:21:11.679179 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:11.678570    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n89h2"
Jul 15 10:21:11.681710 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:11.681685    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 15 10:21:11.681920 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:11.681903    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mpq79\""
Jul 15 10:21:11.686707 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:11.686634    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n89h2"]
Jul 15 10:21:11.747615 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:11.747379    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2bcd61b6-e659-4167-9b2d-2c55a5c6170e-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-n89h2\" (UID: \"2bcd61b6-e659-4167-9b2d-2c55a5c6170e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n89h2"
Jul 15 10:21:11.848753 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:11.848710    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2bcd61b6-e659-4167-9b2d-2c55a5c6170e-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-n89h2\" (UID: \"2bcd61b6-e659-4167-9b2d-2c55a5c6170e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n89h2"
Jul 15 10:21:11.848984 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:21:11.848963    2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 15 10:21:11.849076 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:21:11.849058    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bcd61b6-e659-4167-9b2d-2c55a5c6170e-tls-certificates podName:2bcd61b6-e659-4167-9b2d-2c55a5c6170e nodeName:}" failed. No retries permitted until 2026-07-15 10:21:12.349016711 +0000 UTC m=+71.168658598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2bcd61b6-e659-4167-9b2d-2c55a5c6170e-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-n89h2" (UID: "2bcd61b6-e659-4167-9b2d-2c55a5c6170e") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 15 10:21:12.353319 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:12.353282    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2bcd61b6-e659-4167-9b2d-2c55a5c6170e-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-n89h2\" (UID: \"2bcd61b6-e659-4167-9b2d-2c55a5c6170e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n89h2"
Jul 15 10:21:12.356028 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:12.355998    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2bcd61b6-e659-4167-9b2d-2c55a5c6170e-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-n89h2\" (UID: \"2bcd61b6-e659-4167-9b2d-2c55a5c6170e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n89h2"
Jul 15 10:21:12.592758 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:12.592718    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n89h2"
Jul 15 10:21:15.586194 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:15.586122    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n89h2"]
Jul 15 10:21:15.593825 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:21:15.593449    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bcd61b6_e659_4167_9b2d_2c55a5c6170e.slice/crio-c13883eabd81daaf7931d5fc87759c558f5396af54bbaafdb0da3e317b5288ab WatchSource:0}: Error finding container c13883eabd81daaf7931d5fc87759c558f5396af54bbaafdb0da3e317b5288ab: Status 404 returned error can't find the container with id c13883eabd81daaf7931d5fc87759c558f5396af54bbaafdb0da3e317b5288ab
Jul 15 10:21:16.079511 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:16.079403    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dbd7d" event={"ID":"8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9","Type":"ContainerStarted","Data":"a28a5a8c9a2b78e5ec744bd25911bbffb7a36dc8b2eb316cf8cd03a41097f19f"}
Jul 15 10:21:16.079511 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:16.079477    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dbd7d" event={"ID":"8e5f5f8a-6db9-4f5c-ac26-12ad0a1638c9","Type":"ContainerStarted","Data":"87e1c6301db23cb6ad367668fb790e72df96172a9b6454bd3dd26d1d88140e35"}
Jul 15 10:21:16.082413 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:16.082382    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lxnrt" event={"ID":"3e69daa3-77e6-44a2-9d3d-4072bdf5424d","Type":"ContainerStarted","Data":"2cc248903e0c803a3c634ae2126a5868265913d0b28726bda6f2a755758f937c"}
Jul 15 10:21:16.082551 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:16.082436    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:21:16.084909 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:16.084861    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx" event={"ID":"83c3bd76-59de-45f0-a9c9-06e04057f344","Type":"ContainerStarted","Data":"69c842136ead020d6ea89cb617817cfbd017e89599baa32401bacf2928cab076"}
Jul 15 10:21:16.086714 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:16.086690    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n89h2" event={"ID":"2bcd61b6-e659-4167-9b2d-2c55a5c6170e","Type":"ContainerStarted","Data":"c13883eabd81daaf7931d5fc87759c558f5396af54bbaafdb0da3e317b5288ab"}
Jul 15 10:21:16.088513 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:16.088489    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh" event={"ID":"c8ccfbb4-32a1-4a13-b6aa-3c6675d29845","Type":"ContainerStarted","Data":"9e4783f62e0b4b48ad44b085ce82955651bf415f473116deda12062fc34dcb3f"}
Jul 15 10:21:16.088832 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:16.088812    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh"
Jul 15 10:21:16.090438 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:16.090416    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh"
Jul 15 10:21:16.098808 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:16.098759    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dbd7d" podStartSLOduration=68.96343744 podStartE2EDuration="1m15.098721944s" totalImagesPullingTime="6.135284504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:21:16.098632756 +0000 UTC m=+74.918274631" watchObservedRunningTime="2026-07-15 10:21:16.098721944 +0000 UTC m=+74.918363812"
Jul 15 10:21:16.139689 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:16.138936    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c88ff7fcd-5nvsx" podStartSLOduration=1.970566622 podStartE2EDuration="10.138905375s" totalImagesPullingTime="8.168338753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:21:16.138153004 +0000 UTC m=+74.957794879" watchObservedRunningTime="2026-07-15 10:21:16.138905375 +0000 UTC m=+74.958547249"
Jul 15 10:21:16.139689 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:16.139262    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lxnrt" podStartSLOduration=68.969527237 podStartE2EDuration="1m15.139251444s" totalImagesPullingTime="6.169724207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:21:16.120489807 +0000 UTC m=+74.940131678" watchObservedRunningTime="2026-07-15 10:21:16.139251444 +0000 UTC m=+74.958893295"
Jul 15 10:21:16.158222 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:16.158163    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6878bdfcb8-xvzwh" podStartSLOduration=1.978329092 podStartE2EDuration="10.158142033s" totalImagesPullingTime="8.179812941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:21:16.156683351 +0000 UTC m=+74.976325223" watchObservedRunningTime="2026-07-15 10:21:16.158142033 +0000 UTC m=+74.977783905"
Jul 15 10:21:18.213321 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.213294    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6674f8cd48-4gfxn"]
Jul 15 10:21:18.217334 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.216671    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.219434 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.219405    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 10:21:18.219576 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.219406    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 10:21:18.219798 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.219776    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 10:21:18.220461 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.220443    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 10:21:18.220578 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.220494    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6zk45\""
Jul 15 10:21:18.220642 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.220620    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 10:21:18.226257 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.226234    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 10:21:18.238707 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.238678    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6674f8cd48-4gfxn"]
Jul 15 10:21:18.305803 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.305771    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-config\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.305984 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.305816    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-oauth-serving-cert\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.305984 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.305864    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-serving-cert\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.305984 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.305889    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjphd\" (UniqueName: \"kubernetes.io/projected/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-kube-api-access-wjphd\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.305984 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.305914    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-service-ca\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.306194 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.305991    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-trusted-ca-bundle\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.306194 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.306021    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-oauth-config\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.408150 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.407098    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-serving-cert\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.408150 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.407173    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjphd\" (UniqueName: \"kubernetes.io/projected/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-kube-api-access-wjphd\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.408150 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.407204    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-service-ca\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.408150 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.407241    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-trusted-ca-bundle\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.408150 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.407271    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-oauth-config\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.408150 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.407315    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-config\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.408150 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.407346    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-oauth-serving-cert\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.408150 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.408144    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-oauth-serving-cert\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.408549 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.408502    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-trusted-ca-bundle\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.408817 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.408797    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-config\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.410183 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.410153    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-serving-cert\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.410443 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.410420    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-service-ca\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.414650 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.411405    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-oauth-config\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.418072 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.418050    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjphd\" (UniqueName: \"kubernetes.io/projected/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-kube-api-access-wjphd\") pod \"console-6674f8cd48-4gfxn\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") " pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.529030 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.528983    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:18.701442 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:18.701280    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6674f8cd48-4gfxn"]
Jul 15 10:21:18.704370 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:21:18.704331    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00af658_4aa4_486b_8a9e_d9a3df0bb5bd.slice/crio-0ac47552a8e32da9457b7b15c5cd9a9b7c900584fccfebb0c2cd8ca8b436819a WatchSource:0}: Error finding container 0ac47552a8e32da9457b7b15c5cd9a9b7c900584fccfebb0c2cd8ca8b436819a: Status 404 returned error can't find the container with id 0ac47552a8e32da9457b7b15c5cd9a9b7c900584fccfebb0c2cd8ca8b436819a
Jul 15 10:21:19.103679 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:19.103640    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n89h2" event={"ID":"2bcd61b6-e659-4167-9b2d-2c55a5c6170e","Type":"ContainerStarted","Data":"3d3ce967967a140002af374e0d6fd5709da37647f50c542f742fd05058c530db"}
Jul 15 10:21:19.103901 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:19.103877    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n89h2"
Jul 15 10:21:19.105309 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:19.105274    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6674f8cd48-4gfxn" event={"ID":"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd","Type":"ContainerStarted","Data":"0ac47552a8e32da9457b7b15c5cd9a9b7c900584fccfebb0c2cd8ca8b436819a"}
Jul 15 10:21:19.107614 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:19.107583    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5r2sb" event={"ID":"141455ed-ae53-465c-8979-db50257b660f","Type":"ContainerStarted","Data":"d9da4b4adcf3dbd9f9684da2aba89c46fb83f2768644e599ce292bc2a00d3236"}
Jul 15 10:21:19.110041 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:19.109998    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n89h2"
Jul 15 10:21:19.131530 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:19.131468    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n89h2" podStartSLOduration=5.402652458 podStartE2EDuration="8.13144607s" totalImagesPullingTime="2.728793612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:21:19.129733249 +0000 UTC m=+77.949375120" watchObservedRunningTime="2026-07-15 10:21:19.13144607 +0000 UTC m=+77.951087939"
Jul 15 10:21:19.169841 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:19.169788    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5r2sb" podStartSLOduration=69.147943904 podStartE2EDuration="1m18.169769624s" totalImagesPullingTime="9.02182572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:21:19.169034138 +0000 UTC m=+77.988676014" watchObservedRunningTime="2026-07-15 10:21:19.169769624 +0000 UTC m=+77.989411496"
Jul 15 10:21:22.123319 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:22.123170    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6674f8cd48-4gfxn" event={"ID":"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd","Type":"ContainerStarted","Data":"ead5a54b2f86d45a7c1c87aac2dce1143b3912b60f1fe11507ad8c039f9e8790"}
Jul 15 10:21:22.144397 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:22.144337    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6674f8cd48-4gfxn" podStartSLOduration=1.292915008 podStartE2EDuration="4.144319275s" totalImagesPullingTime="2.851404267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:21:22.14243823 +0000 UTC m=+80.962080102" watchObservedRunningTime="2026-07-15 10:21:22.144319275 +0000 UTC m=+80.963961143"
Jul 15 10:21:24.097285 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.097243    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7"]
Jul 15 10:21:24.266133 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.266078    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7"]
Jul 15 10:21:24.266133 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.266145    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4hfq6"]
Jul 15 10:21:24.266332 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.266312    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7"
Jul 15 10:21:24.270940 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.270904    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 10:21:24.270940 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.270927    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 10:21:24.271222 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.271008    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 15 10:21:24.271222 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.270904    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 10:21:24.271222 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.270910    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xgldp\""
Jul 15 10:21:24.271222 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.270904    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 15 10:21:24.282769 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.282738    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.285860 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.285838    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 10:21:24.285994 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.285838    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w2c94\""
Jul 15 10:21:24.285994 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.285838    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 10:21:24.285994 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.285897    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 10:21:24.352221 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.352139    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e55538b-79fc-44d1-9407-df40bcf048e4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-hqzw7\" (UID: \"6e55538b-79fc-44d1-9407-df40bcf048e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7"
Jul 15 10:21:24.352221 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.352175    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-node-exporter-tls\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.352221 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.352195    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-metrics-client-ca\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.352479 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.352283    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e55538b-79fc-44d1-9407-df40bcf048e4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-hqzw7\" (UID: \"6e55538b-79fc-44d1-9407-df40bcf048e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7"
Jul 15 10:21:24.352479 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.352323    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.352479 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.352350    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-node-exporter-textfile\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.352479 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.352373    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpqqz\" (UniqueName: \"kubernetes.io/projected/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-kube-api-access-fpqqz\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.352479 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.352410    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-node-exporter-wtmp\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.352479 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.352473    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-sys\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.352664 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.352537    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbvpz\" (UniqueName: \"kubernetes.io/projected/6e55538b-79fc-44d1-9407-df40bcf048e4-kube-api-access-fbvpz\") pod \"openshift-state-metrics-84bd68b896-hqzw7\" (UID: \"6e55538b-79fc-44d1-9407-df40bcf048e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7"
Jul 15 10:21:24.352664 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.352581    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-root\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.352664 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.352606    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e55538b-79fc-44d1-9407-df40bcf048e4-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-hqzw7\" (UID: \"6e55538b-79fc-44d1-9407-df40bcf048e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7"
Jul 15 10:21:24.352664 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.352627    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-node-exporter-accelerators-collector-config\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.453147 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.453083    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpqqz\" (UniqueName: \"kubernetes.io/projected/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-kube-api-access-fpqqz\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.453334 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.453162    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-node-exporter-wtmp\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.453334 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.453193    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-sys\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.453334 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.453226    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbvpz\" (UniqueName: \"kubernetes.io/projected/6e55538b-79fc-44d1-9407-df40bcf048e4-kube-api-access-fbvpz\") pod \"openshift-state-metrics-84bd68b896-hqzw7\" (UID: \"6e55538b-79fc-44d1-9407-df40bcf048e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7"
Jul 15 10:21:24.453334 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.453263    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-root\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.453334 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.453292    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e55538b-79fc-44d1-9407-df40bcf048e4-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-hqzw7\" (UID: \"6e55538b-79fc-44d1-9407-df40bcf048e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7"
Jul 15 10:21:24.453334 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.453318    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-node-exporter-accelerators-collector-config\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.453583 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.453362    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e55538b-79fc-44d1-9407-df40bcf048e4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-hqzw7\" (UID: \"6e55538b-79fc-44d1-9407-df40bcf048e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7"
Jul 15 10:21:24.453583 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.453386    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-node-exporter-tls\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.453583 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.453384    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-node-exporter-wtmp\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.453583 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.453410    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-metrics-client-ca\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.453583 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.453443    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e55538b-79fc-44d1-9407-df40bcf048e4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-hqzw7\" (UID: \"6e55538b-79fc-44d1-9407-df40bcf048e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7"
Jul 15 10:21:24.453583 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.453472    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.453583 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.453499    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-node-exporter-textfile\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.453850 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.453443    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-root\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.453904 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.453830    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-node-exporter-textfile\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.453904 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.453394    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-sys\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.454229 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.454200    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e55538b-79fc-44d1-9407-df40bcf048e4-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-hqzw7\" (UID: \"6e55538b-79fc-44d1-9407-df40bcf048e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7"
Jul 15 10:21:24.454408 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.454361    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-metrics-client-ca\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.455023 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.454975    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-node-exporter-accelerators-collector-config\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.456565 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.456541    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e55538b-79fc-44d1-9407-df40bcf048e4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-hqzw7\" (UID: \"6e55538b-79fc-44d1-9407-df40bcf048e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7"
Jul 15 10:21:24.456658 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.456627    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.456724 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.456699    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e55538b-79fc-44d1-9407-df40bcf048e4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-hqzw7\" (UID: \"6e55538b-79fc-44d1-9407-df40bcf048e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7"
Jul 15 10:21:24.457549 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.457522    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-node-exporter-tls\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.463341 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.463300    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpqqz\" (UniqueName: \"kubernetes.io/projected/b4cfb5f6-ca86-42d0-9738-dc58e9d64764-kube-api-access-fpqqz\") pod \"node-exporter-4hfq6\" (UID: \"b4cfb5f6-ca86-42d0-9738-dc58e9d64764\") " pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:24.463474 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.463354    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbvpz\" (UniqueName: \"kubernetes.io/projected/6e55538b-79fc-44d1-9407-df40bcf048e4-kube-api-access-fbvpz\") pod \"openshift-state-metrics-84bd68b896-hqzw7\" (UID: \"6e55538b-79fc-44d1-9407-df40bcf048e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7"
Jul 15 10:21:24.576926 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.576887    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7"
Jul 15 10:21:24.594543 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:24.594508    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4hfq6"
Jul 15 10:21:28.480823 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.480782    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"]
Jul 15 10:21:28.720499 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.720459    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:28.720693 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.720521    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"]
Jul 15 10:21:28.720693 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.720554    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:28.720693 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.720480    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.720693 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.720622    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:28.724890 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.724858    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 15 10:21:28.725252 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.725228    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 10:21:28.725803 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.725316    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 15 10:21:28.725803 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.725230    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 15 10:21:28.725803 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.725511    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5hg7ko8ek1n86\""
Jul 15 10:21:28.725803 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.725577    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-hw5bf\""
Jul 15 10:21:28.725803 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.725738    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:21:28.792072 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.792030    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b449311f-82bb-4d91-ae8f-8010ad6a19b2-secret-metrics-server-client-certs\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.792309 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.792085    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b449311f-82bb-4d91-ae8f-8010ad6a19b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.792309 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.792184    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b449311f-82bb-4d91-ae8f-8010ad6a19b2-secret-metrics-server-tls\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.792309 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.792216    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8sjn\" (UniqueName: \"kubernetes.io/projected/b449311f-82bb-4d91-ae8f-8010ad6a19b2-kube-api-access-h8sjn\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.792309 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.792294    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b449311f-82bb-4d91-ae8f-8010ad6a19b2-audit-log\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.792540 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.792516    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b449311f-82bb-4d91-ae8f-8010ad6a19b2-metrics-server-audit-profiles\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.792663 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.792636    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b449311f-82bb-4d91-ae8f-8010ad6a19b2-client-ca-bundle\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.853843 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:21:28.853790    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4cfb5f6_ca86_42d0_9738_dc58e9d64764.slice/crio-f412bce9112282d6bcf7a89576ae9a444a136856a75d73a3cd1fefdbdc7f98ac WatchSource:0}: Error finding container f412bce9112282d6bcf7a89576ae9a444a136856a75d73a3cd1fefdbdc7f98ac: Status 404 returned error can't find the container with id f412bce9112282d6bcf7a89576ae9a444a136856a75d73a3cd1fefdbdc7f98ac
Jul 15 10:21:28.893795 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.893719    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b449311f-82bb-4d91-ae8f-8010ad6a19b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.893927 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.893827    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b449311f-82bb-4d91-ae8f-8010ad6a19b2-secret-metrics-server-tls\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.893927 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.893877    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8sjn\" (UniqueName: \"kubernetes.io/projected/b449311f-82bb-4d91-ae8f-8010ad6a19b2-kube-api-access-h8sjn\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.893927 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.893918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b449311f-82bb-4d91-ae8f-8010ad6a19b2-audit-log\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.894087 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.893955    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b449311f-82bb-4d91-ae8f-8010ad6a19b2-metrics-server-audit-profiles\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.894087 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.893986    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b449311f-82bb-4d91-ae8f-8010ad6a19b2-client-ca-bundle\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.894087 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.894033    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b449311f-82bb-4d91-ae8f-8010ad6a19b2-secret-metrics-server-client-certs\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.895083 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.894696    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b449311f-82bb-4d91-ae8f-8010ad6a19b2-audit-log\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.895083 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.894781    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b449311f-82bb-4d91-ae8f-8010ad6a19b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.895470 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.895393    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b449311f-82bb-4d91-ae8f-8010ad6a19b2-metrics-server-audit-profiles\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.898139 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.898064    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b449311f-82bb-4d91-ae8f-8010ad6a19b2-secret-metrics-server-client-certs\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.898839 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.898811    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b449311f-82bb-4d91-ae8f-8010ad6a19b2-client-ca-bundle\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.898924 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.898873    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b449311f-82bb-4d91-ae8f-8010ad6a19b2-secret-metrics-server-tls\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.914289 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.914252    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8sjn\" (UniqueName: \"kubernetes.io/projected/b449311f-82bb-4d91-ae8f-8010ad6a19b2-kube-api-access-h8sjn\") pod \"metrics-server-58cc6c9c45-hqtr4\" (UID: \"b449311f-82bb-4d91-ae8f-8010ad6a19b2\") " pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:28.915466 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.915443    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-zthlj"]
Jul 15 10:21:28.931561 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.931526    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-zthlj"]
Jul 15 10:21:28.931684 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.931625    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zthlj"
Jul 15 10:21:28.935794 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.935765    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-d2ld7\""
Jul 15 10:21:28.935948 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.935764    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 15 10:21:28.987718 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.987626    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7"]
Jul 15 10:21:28.990333 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:21:28.990304    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e55538b_79fc_44d1_9407_df40bcf048e4.slice/crio-c7cfd784584fbce6a1a1052e8184143584f8e6ed7eeda43c224ceb7a08b27d01 WatchSource:0}: Error finding container c7cfd784584fbce6a1a1052e8184143584f8e6ed7eeda43c224ceb7a08b27d01: Status 404 returned error can't find the container with id c7cfd784584fbce6a1a1052e8184143584f8e6ed7eeda43c224ceb7a08b27d01
Jul 15 10:21:28.994588 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.994564    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aec4a18c-eb9a-4052-85b5-3837f8667689-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-zthlj\" (UID: \"aec4a18c-eb9a-4052-85b5-3837f8667689\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zthlj"
Jul 15 10:21:28.994694 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:28.994627    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn6kk\" (UniqueName: \"kubernetes.io/projected/aec4a18c-eb9a-4052-85b5-3837f8667689-kube-api-access-hn6kk\") pod \"monitoring-plugin-5f68df7f58-zthlj\" (UID: \"aec4a18c-eb9a-4052-85b5-3837f8667689\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zthlj"
Jul 15 10:21:29.033196 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:29.033162    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:29.096038 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:29.095997    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aec4a18c-eb9a-4052-85b5-3837f8667689-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-zthlj\" (UID: \"aec4a18c-eb9a-4052-85b5-3837f8667689\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zthlj"
Jul 15 10:21:29.096282 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:29.096071    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn6kk\" (UniqueName: \"kubernetes.io/projected/aec4a18c-eb9a-4052-85b5-3837f8667689-kube-api-access-hn6kk\") pod \"monitoring-plugin-5f68df7f58-zthlj\" (UID: \"aec4a18c-eb9a-4052-85b5-3837f8667689\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zthlj"
Jul 15 10:21:29.096282 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:21:29.096197    2568 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 15 10:21:29.096397 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:21:29.096288    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aec4a18c-eb9a-4052-85b5-3837f8667689-monitoring-plugin-cert podName:aec4a18c-eb9a-4052-85b5-3837f8667689 nodeName:}" failed. No retries permitted until 2026-07-15 10:21:29.596266557 +0000 UTC m=+88.415908421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/aec4a18c-eb9a-4052-85b5-3837f8667689-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-zthlj" (UID: "aec4a18c-eb9a-4052-85b5-3837f8667689") : secret "monitoring-plugin-cert" not found
Jul 15 10:21:29.105756 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:29.105729    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn6kk\" (UniqueName: \"kubernetes.io/projected/aec4a18c-eb9a-4052-85b5-3837f8667689-kube-api-access-hn6kk\") pod \"monitoring-plugin-5f68df7f58-zthlj\" (UID: \"aec4a18c-eb9a-4052-85b5-3837f8667689\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zthlj"
Jul 15 10:21:29.160656 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:29.160613    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4hfq6" event={"ID":"b4cfb5f6-ca86-42d0-9738-dc58e9d64764","Type":"ContainerStarted","Data":"f412bce9112282d6bcf7a89576ae9a444a136856a75d73a3cd1fefdbdc7f98ac"}
Jul 15 10:21:29.161856 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:29.161829    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7" event={"ID":"6e55538b-79fc-44d1-9407-df40bcf048e4","Type":"ContainerStarted","Data":"c7cfd784584fbce6a1a1052e8184143584f8e6ed7eeda43c224ceb7a08b27d01"}
Jul 15 10:21:29.413800 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:29.413765    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"]
Jul 15 10:21:29.417256 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:21:29.417223    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb449311f_82bb_4d91_ae8f_8010ad6a19b2.slice/crio-0a2d9caf29cbbb7f9b395fb3cd0190e760fb6355046d1f64f5c8732931183f82 WatchSource:0}: Error finding container 0a2d9caf29cbbb7f9b395fb3cd0190e760fb6355046d1f64f5c8732931183f82: Status 404 returned error can't find the container with id 0a2d9caf29cbbb7f9b395fb3cd0190e760fb6355046d1f64f5c8732931183f82
Jul 15 10:21:29.604184 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:29.604061    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aec4a18c-eb9a-4052-85b5-3837f8667689-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-zthlj\" (UID: \"aec4a18c-eb9a-4052-85b5-3837f8667689\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zthlj"
Jul 15 10:21:29.606776 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:29.606743    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aec4a18c-eb9a-4052-85b5-3837f8667689-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-zthlj\" (UID: \"aec4a18c-eb9a-4052-85b5-3837f8667689\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zthlj"
Jul 15 10:21:29.845327 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:29.845291    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zthlj"
Jul 15 10:21:30.026860 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:30.026811    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-zthlj"]
Jul 15 10:21:30.167989 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:30.167907    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zthlj" event={"ID":"aec4a18c-eb9a-4052-85b5-3837f8667689","Type":"ContainerStarted","Data":"48f5eced626825510bef69fa47d292ddc5d9bcf7361d64d4cd0ac0037e85b47c"}
Jul 15 10:21:30.170602 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:30.170564    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7" event={"ID":"6e55538b-79fc-44d1-9407-df40bcf048e4","Type":"ContainerStarted","Data":"de98e541f54b94519861d15310e7edb139975cfc511cb12019549867c0d390e6"}
Jul 15 10:21:30.170769 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:30.170640    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7" event={"ID":"6e55538b-79fc-44d1-9407-df40bcf048e4","Type":"ContainerStarted","Data":"90097b5aa87df9a6e66e612f41e9fa4f236e42b3d10b5ff1de20b109fc8c41d8"}
Jul 15 10:21:30.172283 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:30.172247    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4" event={"ID":"b449311f-82bb-4d91-ae8f-8010ad6a19b2","Type":"ContainerStarted","Data":"0a2d9caf29cbbb7f9b395fb3cd0190e760fb6355046d1f64f5c8732931183f82"}
Jul 15 10:21:30.174178 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:30.174143    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-msktx" event={"ID":"24646643-3ded-4ec7-bb42-ea442c25dc7a","Type":"ContainerStarted","Data":"4179b036756d94bae7ab9a1fbed7808203cba2c445df45d0d0c89eca2804e181"}
Jul 15 10:21:30.175414 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:30.175385    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-msktx"
Jul 15 10:21:30.188932 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:30.188900    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-msktx"
Jul 15 10:21:30.194257 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:30.194182    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-msktx" podStartSLOduration=2.277416846 podStartE2EDuration="24.194156946s" totalImagesPullingTime="21.9167401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:21:30.192547725 +0000 UTC m=+89.012189618" watchObservedRunningTime="2026-07-15 10:21:30.194156946 +0000 UTC m=+89.013798818"
Jul 15 10:21:31.182969 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:31.182321    2568 generic.go:356] "Generic (PLEG): container finished" podID="b4cfb5f6-ca86-42d0-9738-dc58e9d64764" containerID="08554aab5ab94ae4842e80c5e881c1eae722759762daafeef6a6607cd2e031bf" exitCode=0
Jul 15 10:21:31.182969 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:31.182657    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4hfq6" event={"ID":"b4cfb5f6-ca86-42d0-9738-dc58e9d64764","Type":"ContainerDied","Data":"08554aab5ab94ae4842e80c5e881c1eae722759762daafeef6a6607cd2e031bf"}
Jul 15 10:21:32.068443 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:32.068411    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-554ff97b4d-q2v5t"
Jul 15 10:21:33.195838 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:33.195800    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4hfq6" event={"ID":"b4cfb5f6-ca86-42d0-9738-dc58e9d64764","Type":"ContainerStarted","Data":"651493e6e1b533d4b3e105f20ecfa53f36172ef38df8461770bcb7475cdfab6b"}
Jul 15 10:21:33.196270 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:33.195870    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4hfq6" event={"ID":"b4cfb5f6-ca86-42d0-9738-dc58e9d64764","Type":"ContainerStarted","Data":"fbccced185f55251554f473811d3f563f66920f7e6d3975d3bea7ed5c5d14c22"}
Jul 15 10:21:33.199318 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:33.199286    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7" event={"ID":"6e55538b-79fc-44d1-9407-df40bcf048e4","Type":"ContainerStarted","Data":"fa075e186d576b54a4b1a7009a87140592932fcefe106696b9fdb084066eb15a"}
Jul 15 10:21:33.201451 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:33.201397    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4" event={"ID":"b449311f-82bb-4d91-ae8f-8010ad6a19b2","Type":"ContainerStarted","Data":"144b0c8939fed14c63322ccbc3de5a5e243bad8c5aff28276bfacbcf658bc804"}
Jul 15 10:21:33.226148 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:33.226079    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4hfq6" podStartSLOduration=7.796775047 podStartE2EDuration="9.226055251s" totalImagesPullingTime="1.28404744s" totalInitContainerRuntime="145.232764ms" isStatefulPod=true podCreationTimestamp="2026-07-15 10:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:21:33.224840134 +0000 UTC m=+92.044482033" watchObservedRunningTime="2026-07-15 10:21:33.226055251 +0000 UTC m=+92.045697123"
Jul 15 10:21:33.267746 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:33.266782    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hqzw7" podStartSLOduration=6.09466677 podStartE2EDuration="9.266758181s" totalImagesPullingTime="3.172091411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:21:33.265291997 +0000 UTC m=+92.084934106" watchObservedRunningTime="2026-07-15 10:21:33.266758181 +0000 UTC m=+92.086400056"
Jul 15 10:21:33.299432 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:33.299358    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4" podStartSLOduration=2.051793259 podStartE2EDuration="5.299335068s" totalImagesPullingTime="3.247541809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:21:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:21:33.297452316 +0000 UTC m=+92.117094191" watchObservedRunningTime="2026-07-15 10:21:33.299335068 +0000 UTC m=+92.118976942"
Jul 15 10:21:34.215882 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.215820    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zthlj" event={"ID":"aec4a18c-eb9a-4052-85b5-3837f8667689","Type":"ContainerStarted","Data":"38337255eeaa78e27b3ec67bf554bc25195199f7e081d48d448ca4d50659b249"}
Jul 15 10:21:34.216444 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.216089    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zthlj"
Jul 15 10:21:34.222745 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.222716    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zthlj"
Jul 15 10:21:34.236190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.236089    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zthlj" podStartSLOduration=3.222275772 podStartE2EDuration="6.236065737s" totalImagesPullingTime="3.013789965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:21:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:21:34.235311859 +0000 UTC m=+93.054953732" watchObservedRunningTime="2026-07-15 10:21:34.236065737 +0000 UTC m=+93.055707610"
Jul 15 10:21:34.323997 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.323954    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5857946c97-wzncr"]
Jul 15 10:21:34.350771 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.350738    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5857946c97-wzncr"]
Jul 15 10:21:34.351048 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.350859    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.450823 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.450784    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3a026ee-82da-455e-817a-f30614150cab-console-oauth-config\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.451043 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.450832    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-trusted-ca-bundle\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.451043 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.450860    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-console-config\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.451043 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.450910    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-oauth-serving-cert\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.451043 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.450956    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3a026ee-82da-455e-817a-f30614150cab-console-serving-cert\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.451275 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.451066    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-service-ca\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.451275 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.451168    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df4ns\" (UniqueName: \"kubernetes.io/projected/f3a026ee-82da-455e-817a-f30614150cab-kube-api-access-df4ns\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.552409 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.552367    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-service-ca\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.552681 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.552448    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df4ns\" (UniqueName: \"kubernetes.io/projected/f3a026ee-82da-455e-817a-f30614150cab-kube-api-access-df4ns\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.552681 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.552501    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3a026ee-82da-455e-817a-f30614150cab-console-oauth-config\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.552681 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.552523    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-trusted-ca-bundle\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.552681 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.552547    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-console-config\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.552681 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.552576    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-oauth-serving-cert\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.552984 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.552706    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3a026ee-82da-455e-817a-f30614150cab-console-serving-cert\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.553279 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.553250    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-service-ca\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.553519 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.553490    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-oauth-serving-cert\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.553621 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.553489    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-console-config\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.553827 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.553805    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-trusted-ca-bundle\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.555994 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.555968    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3a026ee-82da-455e-817a-f30614150cab-console-serving-cert\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.556725 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.556697    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3a026ee-82da-455e-817a-f30614150cab-console-oauth-config\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.563483 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.563446    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df4ns\" (UniqueName: \"kubernetes.io/projected/f3a026ee-82da-455e-817a-f30614150cab-kube-api-access-df4ns\") pod \"console-5857946c97-wzncr\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") " pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.663415 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.663371    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:34.865267 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:34.865238    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5857946c97-wzncr"]
Jul 15 10:21:34.870291 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:21:34.870257    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a026ee_82da_455e_817a_f30614150cab.slice/crio-4885eaa9f1f98736456cf5a9d1720a003207f3b86b3713f2f6310cb14f575b00 WatchSource:0}: Error finding container 4885eaa9f1f98736456cf5a9d1720a003207f3b86b3713f2f6310cb14f575b00: Status 404 returned error can't find the container with id 4885eaa9f1f98736456cf5a9d1720a003207f3b86b3713f2f6310cb14f575b00
Jul 15 10:21:35.222771 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:35.222678    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5857946c97-wzncr" event={"ID":"f3a026ee-82da-455e-817a-f30614150cab","Type":"ContainerStarted","Data":"5f5a2b2459ce0ae7ee11e696e9ca7b0976558ceaf2a4d214e6e95bc1ee9af689"}
Jul 15 10:21:35.222771 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:35.222739    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5857946c97-wzncr" event={"ID":"f3a026ee-82da-455e-817a-f30614150cab","Type":"ContainerStarted","Data":"4885eaa9f1f98736456cf5a9d1720a003207f3b86b3713f2f6310cb14f575b00"}
Jul 15 10:21:44.663542 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:44.663501    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:44.663991 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:44.663565    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:44.668640 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:44.668617    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:44.693512 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:44.693454    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5857946c97-wzncr" podStartSLOduration=10.693436958 podStartE2EDuration="10.693436958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:21:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:21:35.250903664 +0000 UTC m=+94.070545535" watchObservedRunningTime="2026-07-15 10:21:44.693436958 +0000 UTC m=+103.513078894"
Jul 15 10:21:45.266298 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:45.266266    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:21:45.322442 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:45.322410    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6674f8cd48-4gfxn"]
Jul 15 10:21:47.095362 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:47.095332    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lxnrt"
Jul 15 10:21:49.033786 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:49.033748    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:21:49.034270 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:21:49.033808    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:22:09.039164 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:09.039132    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:22:09.042886 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:09.042861    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-58cc6c9c45-hqtr4"
Jul 15 10:22:10.350473 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.350433    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6674f8cd48-4gfxn" podUID="c00af658-4aa4-486b-8a9e-d9a3df0bb5bd" containerName="console" containerID="cri-o://ead5a54b2f86d45a7c1c87aac2dce1143b3912b60f1fe11507ad8c039f9e8790" gracePeriod=15
Jul 15 10:22:10.656340 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.656304    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:22:10.741690 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.741650    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-oauth-config\") pod \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") "
Jul 15 10:22:10.741882 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.741712    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-config\") pod \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") "
Jul 15 10:22:10.741882 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.741730    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-serving-cert\") pod \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") "
Jul 15 10:22:10.741882 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.741754    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-service-ca\") pod \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") "
Jul 15 10:22:10.741882 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.741779    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-oauth-serving-cert\") pod \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") "
Jul 15 10:22:10.741882 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.741797    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-trusted-ca-bundle\") pod \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") "
Jul 15 10:22:10.741882 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.741831    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjphd\" (UniqueName: \"kubernetes.io/projected/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-kube-api-access-wjphd\") pod \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\" (UID: \"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd\") "
Jul 15 10:22:10.742230 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.742204    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c00af658-4aa4-486b-8a9e-d9a3df0bb5bd" (UID: "c00af658-4aa4-486b-8a9e-d9a3df0bb5bd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:22:10.742307 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.742281    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-service-ca" (OuterVolumeSpecName: "service-ca") pod "c00af658-4aa4-486b-8a9e-d9a3df0bb5bd" (UID: "c00af658-4aa4-486b-8a9e-d9a3df0bb5bd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:22:10.742386 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.742312    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-config" (OuterVolumeSpecName: "console-config") pod "c00af658-4aa4-486b-8a9e-d9a3df0bb5bd" (UID: "c00af658-4aa4-486b-8a9e-d9a3df0bb5bd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:22:10.742386 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.742377    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c00af658-4aa4-486b-8a9e-d9a3df0bb5bd" (UID: "c00af658-4aa4-486b-8a9e-d9a3df0bb5bd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:22:10.744473 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.744437    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-kube-api-access-wjphd" (OuterVolumeSpecName: "kube-api-access-wjphd") pod "c00af658-4aa4-486b-8a9e-d9a3df0bb5bd" (UID: "c00af658-4aa4-486b-8a9e-d9a3df0bb5bd"). InnerVolumeSpecName "kube-api-access-wjphd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:22:10.744589 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.744569    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c00af658-4aa4-486b-8a9e-d9a3df0bb5bd" (UID: "c00af658-4aa4-486b-8a9e-d9a3df0bb5bd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:22:10.744635 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.744619    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c00af658-4aa4-486b-8a9e-d9a3df0bb5bd" (UID: "c00af658-4aa4-486b-8a9e-d9a3df0bb5bd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:22:10.843326 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.843281    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:22:10.843326 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.843315    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-oauth-serving-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:22:10.843326 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.843328    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-trusted-ca-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:22:10.843326 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.843336    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjphd\" (UniqueName: \"kubernetes.io/projected/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-kube-api-access-wjphd\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:22:10.843583 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.843346    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-oauth-config\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:22:10.843583 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.843355    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-config\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:22:10.843583 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:10.843365    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd-console-serving-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:22:11.361495 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:11.361458    2568 generic.go:356] "Generic (PLEG): container finished" podID="c00af658-4aa4-486b-8a9e-d9a3df0bb5bd" containerID="ead5a54b2f86d45a7c1c87aac2dce1143b3912b60f1fe11507ad8c039f9e8790" exitCode=0
Jul 15 10:22:11.361874 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:11.361501    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6674f8cd48-4gfxn"
Jul 15 10:22:11.361874 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:11.361540    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6674f8cd48-4gfxn" event={"ID":"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd","Type":"ContainerDied","Data":"ead5a54b2f86d45a7c1c87aac2dce1143b3912b60f1fe11507ad8c039f9e8790"}
Jul 15 10:22:11.361874 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:11.361591    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6674f8cd48-4gfxn" event={"ID":"c00af658-4aa4-486b-8a9e-d9a3df0bb5bd","Type":"ContainerDied","Data":"0ac47552a8e32da9457b7b15c5cd9a9b7c900584fccfebb0c2cd8ca8b436819a"}
Jul 15 10:22:11.371381 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:11.371353    2568 scope.go:117] "RemoveContainer" containerID="ead5a54b2f86d45a7c1c87aac2dce1143b3912b60f1fe11507ad8c039f9e8790"
Jul 15 10:22:11.380308 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:11.380282    2568 scope.go:117] "RemoveContainer" containerID="ead5a54b2f86d45a7c1c87aac2dce1143b3912b60f1fe11507ad8c039f9e8790"
Jul 15 10:22:11.380629 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:22:11.380608    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ead5a54b2f86d45a7c1c87aac2dce1143b3912b60f1fe11507ad8c039f9e8790\": container with ID starting with ead5a54b2f86d45a7c1c87aac2dce1143b3912b60f1fe11507ad8c039f9e8790 not found: ID does not exist" containerID="ead5a54b2f86d45a7c1c87aac2dce1143b3912b60f1fe11507ad8c039f9e8790"
Jul 15 10:22:11.380680 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:11.380641    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ead5a54b2f86d45a7c1c87aac2dce1143b3912b60f1fe11507ad8c039f9e8790"} err="failed to get container status \"ead5a54b2f86d45a7c1c87aac2dce1143b3912b60f1fe11507ad8c039f9e8790\": rpc error: code = NotFound desc = could not find container \"ead5a54b2f86d45a7c1c87aac2dce1143b3912b60f1fe11507ad8c039f9e8790\": container with ID starting with ead5a54b2f86d45a7c1c87aac2dce1143b3912b60f1fe11507ad8c039f9e8790 not found: ID does not exist"
Jul 15 10:22:11.384768 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:11.384741    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6674f8cd48-4gfxn"]
Jul 15 10:22:11.391456 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:11.391427    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6674f8cd48-4gfxn"]
Jul 15 10:22:11.648692 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:11.648600    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c00af658-4aa4-486b-8a9e-d9a3df0bb5bd" path="/var/lib/kubelet/pods/c00af658-4aa4-486b-8a9e-d9a3df0bb5bd/volumes"
Jul 15 10:22:45.190410 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.190373    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-679dc85cbf-fhbh2"]
Jul 15 10:22:45.190855 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.190683    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00af658-4aa4-486b-8a9e-d9a3df0bb5bd" containerName="console"
Jul 15 10:22:45.190855 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.190696    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00af658-4aa4-486b-8a9e-d9a3df0bb5bd" containerName="console"
Jul 15 10:22:45.190855 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.190780    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00af658-4aa4-486b-8a9e-d9a3df0bb5bd" containerName="console"
Jul 15 10:22:45.194275 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.194257    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.205817 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.205788    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-679dc85cbf-fhbh2"]
Jul 15 10:22:45.342983 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.342938    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-trusted-ca-bundle\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.342983 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.342986    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9v6s\" (UniqueName: \"kubernetes.io/projected/1f03af58-f3cf-4c6e-8717-d159b47a6761-kube-api-access-k9v6s\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.343299 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.343008    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-config\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.343299 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.343068    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-serving-cert\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.343299 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.343159    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-service-ca\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.343299 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.343185    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-oauth-serving-cert\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.343299 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.343282    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-oauth-config\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.444494 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.444408    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9v6s\" (UniqueName: \"kubernetes.io/projected/1f03af58-f3cf-4c6e-8717-d159b47a6761-kube-api-access-k9v6s\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.444494 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.444450    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-config\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.444494 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.444468    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-serving-cert\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.444698 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.444501    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-service-ca\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.444698 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.444523    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-oauth-serving-cert\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.444698 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.444584    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-oauth-config\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.445017 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.444986    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-trusted-ca-bundle\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.445312 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.445286    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-config\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.445312 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.445299    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-oauth-serving-cert\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.445433 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.445392    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-service-ca\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.445851 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.445832    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-trusted-ca-bundle\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.447745 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.447714    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-oauth-config\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.447835 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.447815    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-serving-cert\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.454347 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.454327    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9v6s\" (UniqueName: \"kubernetes.io/projected/1f03af58-f3cf-4c6e-8717-d159b47a6761-kube-api-access-k9v6s\") pod \"console-679dc85cbf-fhbh2\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") " pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.503737 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.503707    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:45.641139 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:45.641089    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-679dc85cbf-fhbh2"]
Jul 15 10:22:45.643774 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:22:45.643735    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f03af58_f3cf_4c6e_8717_d159b47a6761.slice/crio-0458926277cf1ca39bc703bbeca1749a15b7adbdd8dbe0455b01611020b2cefa WatchSource:0}: Error finding container 0458926277cf1ca39bc703bbeca1749a15b7adbdd8dbe0455b01611020b2cefa: Status 404 returned error can't find the container with id 0458926277cf1ca39bc703bbeca1749a15b7adbdd8dbe0455b01611020b2cefa
Jul 15 10:22:46.497924 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:46.497892    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679dc85cbf-fhbh2" event={"ID":"1f03af58-f3cf-4c6e-8717-d159b47a6761","Type":"ContainerStarted","Data":"b6cabc3af806a246375e284bb209bb2aeee9b189957e58ad597deabe30bef105"}
Jul 15 10:22:46.498325 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:46.497942    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679dc85cbf-fhbh2" event={"ID":"1f03af58-f3cf-4c6e-8717-d159b47a6761","Type":"ContainerStarted","Data":"0458926277cf1ca39bc703bbeca1749a15b7adbdd8dbe0455b01611020b2cefa"}
Jul 15 10:22:46.518746 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:46.518690    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-679dc85cbf-fhbh2" podStartSLOduration=1.518675221 podStartE2EDuration="1.518675221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:22:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:22:46.517533899 +0000 UTC m=+165.337175768" watchObservedRunningTime="2026-07-15 10:22:46.518675221 +0000 UTC m=+165.338317092"
Jul 15 10:22:55.504693 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:55.504604    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:55.504693 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:55.504664    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:55.509650 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:55.509620    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:55.534628 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:55.534601    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:22:55.587335 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:22:55.587303    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5857946c97-wzncr"]
Jul 15 10:23:20.608191 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:20.608133    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5857946c97-wzncr" podUID="f3a026ee-82da-455e-817a-f30614150cab" containerName="console" containerID="cri-o://5f5a2b2459ce0ae7ee11e696e9ca7b0976558ceaf2a4d214e6e95bc1ee9af689" gracePeriod=15
Jul 15 10:23:20.868254 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:20.868184    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:23:20.924154 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:20.924095    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3a026ee-82da-455e-817a-f30614150cab-console-oauth-config\") pod \"f3a026ee-82da-455e-817a-f30614150cab\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") "
Jul 15 10:23:20.924154 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:20.924155    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-oauth-serving-cert\") pod \"f3a026ee-82da-455e-817a-f30614150cab\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") "
Jul 15 10:23:20.924420 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:20.924257    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3a026ee-82da-455e-817a-f30614150cab-console-serving-cert\") pod \"f3a026ee-82da-455e-817a-f30614150cab\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") "
Jul 15 10:23:20.924420 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:20.924278    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-console-config\") pod \"f3a026ee-82da-455e-817a-f30614150cab\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") "
Jul 15 10:23:20.924420 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:20.924304    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-trusted-ca-bundle\") pod \"f3a026ee-82da-455e-817a-f30614150cab\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") "
Jul 15 10:23:20.924420 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:20.924322    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df4ns\" (UniqueName: \"kubernetes.io/projected/f3a026ee-82da-455e-817a-f30614150cab-kube-api-access-df4ns\") pod \"f3a026ee-82da-455e-817a-f30614150cab\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") "
Jul 15 10:23:20.924618 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:20.924452    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-service-ca\") pod \"f3a026ee-82da-455e-817a-f30614150cab\" (UID: \"f3a026ee-82da-455e-817a-f30614150cab\") "
Jul 15 10:23:20.924669 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:20.924628    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f3a026ee-82da-455e-817a-f30614150cab" (UID: "f3a026ee-82da-455e-817a-f30614150cab"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:23:20.924786 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:20.924754    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-oauth-serving-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:23:20.924786 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:20.924751    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-console-config" (OuterVolumeSpecName: "console-config") pod "f3a026ee-82da-455e-817a-f30614150cab" (UID: "f3a026ee-82da-455e-817a-f30614150cab"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:23:20.924909 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:20.924773    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f3a026ee-82da-455e-817a-f30614150cab" (UID: "f3a026ee-82da-455e-817a-f30614150cab"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:23:20.925174 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:20.925149    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-service-ca" (OuterVolumeSpecName: "service-ca") pod "f3a026ee-82da-455e-817a-f30614150cab" (UID: "f3a026ee-82da-455e-817a-f30614150cab"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:23:20.926488 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:20.926463    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a026ee-82da-455e-817a-f30614150cab-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f3a026ee-82da-455e-817a-f30614150cab" (UID: "f3a026ee-82da-455e-817a-f30614150cab"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:23:20.926587 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:20.926561    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a026ee-82da-455e-817a-f30614150cab-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f3a026ee-82da-455e-817a-f30614150cab" (UID: "f3a026ee-82da-455e-817a-f30614150cab"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:23:20.926624 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:20.926583    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3a026ee-82da-455e-817a-f30614150cab-kube-api-access-df4ns" (OuterVolumeSpecName: "kube-api-access-df4ns") pod "f3a026ee-82da-455e-817a-f30614150cab" (UID: "f3a026ee-82da-455e-817a-f30614150cab"). InnerVolumeSpecName "kube-api-access-df4ns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:23:21.026160 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:21.026095    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3a026ee-82da-455e-817a-f30614150cab-console-oauth-config\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:23:21.026160 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:21.026156    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3a026ee-82da-455e-817a-f30614150cab-console-serving-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:23:21.026160 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:21.026166    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-console-config\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:23:21.026397 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:21.026175    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-trusted-ca-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:23:21.026397 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:21.026183    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df4ns\" (UniqueName: \"kubernetes.io/projected/f3a026ee-82da-455e-817a-f30614150cab-kube-api-access-df4ns\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:23:21.026397 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:21.026192    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3a026ee-82da-455e-817a-f30614150cab-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:23:21.625245 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:21.625209    2568 generic.go:356] "Generic (PLEG): container finished" podID="f3a026ee-82da-455e-817a-f30614150cab" containerID="5f5a2b2459ce0ae7ee11e696e9ca7b0976558ceaf2a4d214e6e95bc1ee9af689" exitCode=0
Jul 15 10:23:21.625665 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:21.625258    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5857946c97-wzncr"
Jul 15 10:23:21.625665 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:21.625295    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5857946c97-wzncr" event={"ID":"f3a026ee-82da-455e-817a-f30614150cab","Type":"ContainerDied","Data":"5f5a2b2459ce0ae7ee11e696e9ca7b0976558ceaf2a4d214e6e95bc1ee9af689"}
Jul 15 10:23:21.625665 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:21.625352    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5857946c97-wzncr" event={"ID":"f3a026ee-82da-455e-817a-f30614150cab","Type":"ContainerDied","Data":"4885eaa9f1f98736456cf5a9d1720a003207f3b86b3713f2f6310cb14f575b00"}
Jul 15 10:23:21.625665 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:21.625374    2568 scope.go:117] "RemoveContainer" containerID="5f5a2b2459ce0ae7ee11e696e9ca7b0976558ceaf2a4d214e6e95bc1ee9af689"
Jul 15 10:23:21.634196 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:21.634178    2568 scope.go:117] "RemoveContainer" containerID="5f5a2b2459ce0ae7ee11e696e9ca7b0976558ceaf2a4d214e6e95bc1ee9af689"
Jul 15 10:23:21.634472 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:23:21.634455    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f5a2b2459ce0ae7ee11e696e9ca7b0976558ceaf2a4d214e6e95bc1ee9af689\": container with ID starting with 5f5a2b2459ce0ae7ee11e696e9ca7b0976558ceaf2a4d214e6e95bc1ee9af689 not found: ID does not exist" containerID="5f5a2b2459ce0ae7ee11e696e9ca7b0976558ceaf2a4d214e6e95bc1ee9af689"
Jul 15 10:23:21.634519 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:21.634481    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f5a2b2459ce0ae7ee11e696e9ca7b0976558ceaf2a4d214e6e95bc1ee9af689"} err="failed to get container status \"5f5a2b2459ce0ae7ee11e696e9ca7b0976558ceaf2a4d214e6e95bc1ee9af689\": rpc error: code = NotFound desc = could not find container \"5f5a2b2459ce0ae7ee11e696e9ca7b0976558ceaf2a4d214e6e95bc1ee9af689\": container with ID starting with 5f5a2b2459ce0ae7ee11e696e9ca7b0976558ceaf2a4d214e6e95bc1ee9af689 not found: ID does not exist"
Jul 15 10:23:21.652725 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:21.652697    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5857946c97-wzncr"]
Jul 15 10:23:21.654883 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:21.654858    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5857946c97-wzncr"]
Jul 15 10:23:23.646859 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:23.646801    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3a026ee-82da-455e-817a-f30614150cab" path="/var/lib/kubelet/pods/f3a026ee-82da-455e-817a-f30614150cab/volumes"
Jul 15 10:23:54.208684 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.208648    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn"]
Jul 15 10:23:54.209220 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.208915    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a026ee-82da-455e-817a-f30614150cab" containerName="console"
Jul 15 10:23:54.209220 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.208926    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a026ee-82da-455e-817a-f30614150cab" containerName="console"
Jul 15 10:23:54.209220 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.208974    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3a026ee-82da-455e-817a-f30614150cab" containerName="console"
Jul 15 10:23:54.211919 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.211901    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn"
Jul 15 10:23:54.214583 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.214560    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 10:23:54.214860 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.214825    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 10:23:54.215505 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.215492    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mpw9v\""
Jul 15 10:23:54.223360 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.223329    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn"]
Jul 15 10:23:54.389776 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.389739    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59f63079-440c-44e8-87cc-f7f1d0d720a1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn\" (UID: \"59f63079-440c-44e8-87cc-f7f1d0d720a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn"
Jul 15 10:23:54.389776 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.389780    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59f63079-440c-44e8-87cc-f7f1d0d720a1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn\" (UID: \"59f63079-440c-44e8-87cc-f7f1d0d720a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn"
Jul 15 10:23:54.389988 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.389870    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4297p\" (UniqueName: \"kubernetes.io/projected/59f63079-440c-44e8-87cc-f7f1d0d720a1-kube-api-access-4297p\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn\" (UID: \"59f63079-440c-44e8-87cc-f7f1d0d720a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn"
Jul 15 10:23:54.490482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.490394    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4297p\" (UniqueName: \"kubernetes.io/projected/59f63079-440c-44e8-87cc-f7f1d0d720a1-kube-api-access-4297p\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn\" (UID: \"59f63079-440c-44e8-87cc-f7f1d0d720a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn"
Jul 15 10:23:54.490482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.490456    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59f63079-440c-44e8-87cc-f7f1d0d720a1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn\" (UID: \"59f63079-440c-44e8-87cc-f7f1d0d720a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn"
Jul 15 10:23:54.490482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.490482    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59f63079-440c-44e8-87cc-f7f1d0d720a1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn\" (UID: \"59f63079-440c-44e8-87cc-f7f1d0d720a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn"
Jul 15 10:23:54.490798 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.490781    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59f63079-440c-44e8-87cc-f7f1d0d720a1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn\" (UID: \"59f63079-440c-44e8-87cc-f7f1d0d720a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn"
Jul 15 10:23:54.490948 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.490917    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59f63079-440c-44e8-87cc-f7f1d0d720a1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn\" (UID: \"59f63079-440c-44e8-87cc-f7f1d0d720a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn"
Jul 15 10:23:54.503404 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.503373    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4297p\" (UniqueName: \"kubernetes.io/projected/59f63079-440c-44e8-87cc-f7f1d0d720a1-kube-api-access-4297p\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn\" (UID: \"59f63079-440c-44e8-87cc-f7f1d0d720a1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn"
Jul 15 10:23:54.522195 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.522153    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn"
Jul 15 10:23:54.660608 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.660556    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn"]
Jul 15 10:23:54.663070 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:23:54.663045    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f63079_440c_44e8_87cc_f7f1d0d720a1.slice/crio-5b0c14bac297e36f3b3c5d1f1cf7360e0eb6f3f94df583226d7be2f074c4be30 WatchSource:0}: Error finding container 5b0c14bac297e36f3b3c5d1f1cf7360e0eb6f3f94df583226d7be2f074c4be30: Status 404 returned error can't find the container with id 5b0c14bac297e36f3b3c5d1f1cf7360e0eb6f3f94df583226d7be2f074c4be30
Jul 15 10:23:54.746084 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:23:54.746046    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn" event={"ID":"59f63079-440c-44e8-87cc-f7f1d0d720a1","Type":"ContainerStarted","Data":"5b0c14bac297e36f3b3c5d1f1cf7360e0eb6f3f94df583226d7be2f074c4be30"}
Jul 15 10:24:01.775915 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:01.775819    2568 generic.go:356] "Generic (PLEG): container finished" podID="59f63079-440c-44e8-87cc-f7f1d0d720a1" containerID="23a1a502d516d551aa142ed2ecf40aca9924637cc1d0b3b357925374aac191d2" exitCode=0
Jul 15 10:24:01.776387 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:01.775907    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn" event={"ID":"59f63079-440c-44e8-87cc-f7f1d0d720a1","Type":"ContainerDied","Data":"23a1a502d516d551aa142ed2ecf40aca9924637cc1d0b3b357925374aac191d2"}
Jul 15 10:24:03.786633 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:03.786597    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn" event={"ID":"59f63079-440c-44e8-87cc-f7f1d0d720a1","Type":"ContainerStarted","Data":"960cee6364d6edcef765b680a953d21e8fbcd47473acb18ed8c888ba36257b8f"}
Jul 15 10:24:04.793456 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:04.793419    2568 generic.go:356] "Generic (PLEG): container finished" podID="59f63079-440c-44e8-87cc-f7f1d0d720a1" containerID="960cee6364d6edcef765b680a953d21e8fbcd47473acb18ed8c888ba36257b8f" exitCode=0
Jul 15 10:24:04.794066 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:04.793505    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn" event={"ID":"59f63079-440c-44e8-87cc-f7f1d0d720a1","Type":"ContainerDied","Data":"960cee6364d6edcef765b680a953d21e8fbcd47473acb18ed8c888ba36257b8f"}
Jul 15 10:24:11.823303 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:11.823264    2568 generic.go:356] "Generic (PLEG): container finished" podID="59f63079-440c-44e8-87cc-f7f1d0d720a1" containerID="3cebfdf955e9169d551939c081cb92ce29ea1dcb4fe147aaea3cc7857a20526d" exitCode=0
Jul 15 10:24:11.823718 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:11.823356    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn" event={"ID":"59f63079-440c-44e8-87cc-f7f1d0d720a1","Type":"ContainerDied","Data":"3cebfdf955e9169d551939c081cb92ce29ea1dcb4fe147aaea3cc7857a20526d"}
Jul 15 10:24:12.954153 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:12.954106    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn"
Jul 15 10:24:13.038520 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:13.038488    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4297p\" (UniqueName: \"kubernetes.io/projected/59f63079-440c-44e8-87cc-f7f1d0d720a1-kube-api-access-4297p\") pod \"59f63079-440c-44e8-87cc-f7f1d0d720a1\" (UID: \"59f63079-440c-44e8-87cc-f7f1d0d720a1\") "
Jul 15 10:24:13.038705 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:13.038532    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59f63079-440c-44e8-87cc-f7f1d0d720a1-bundle\") pod \"59f63079-440c-44e8-87cc-f7f1d0d720a1\" (UID: \"59f63079-440c-44e8-87cc-f7f1d0d720a1\") "
Jul 15 10:24:13.038705 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:13.038569    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59f63079-440c-44e8-87cc-f7f1d0d720a1-util\") pod \"59f63079-440c-44e8-87cc-f7f1d0d720a1\" (UID: \"59f63079-440c-44e8-87cc-f7f1d0d720a1\") "
Jul 15 10:24:13.039213 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:13.039184    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59f63079-440c-44e8-87cc-f7f1d0d720a1-bundle" (OuterVolumeSpecName: "bundle") pod "59f63079-440c-44e8-87cc-f7f1d0d720a1" (UID: "59f63079-440c-44e8-87cc-f7f1d0d720a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:24:13.040834 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:13.040815    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59f63079-440c-44e8-87cc-f7f1d0d720a1-kube-api-access-4297p" (OuterVolumeSpecName: "kube-api-access-4297p") pod "59f63079-440c-44e8-87cc-f7f1d0d720a1" (UID: "59f63079-440c-44e8-87cc-f7f1d0d720a1"). InnerVolumeSpecName "kube-api-access-4297p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:24:13.042754 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:13.042727    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59f63079-440c-44e8-87cc-f7f1d0d720a1-util" (OuterVolumeSpecName: "util") pod "59f63079-440c-44e8-87cc-f7f1d0d720a1" (UID: "59f63079-440c-44e8-87cc-f7f1d0d720a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:24:13.139497 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:13.139397    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4297p\" (UniqueName: \"kubernetes.io/projected/59f63079-440c-44e8-87cc-f7f1d0d720a1-kube-api-access-4297p\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:24:13.139497 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:13.139440    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59f63079-440c-44e8-87cc-f7f1d0d720a1-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:24:13.139497 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:13.139452    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59f63079-440c-44e8-87cc-f7f1d0d720a1-util\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:24:13.832833 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:13.832804    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn"
Jul 15 10:24:13.832833 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:13.832821    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022qgn" event={"ID":"59f63079-440c-44e8-87cc-f7f1d0d720a1","Type":"ContainerDied","Data":"5b0c14bac297e36f3b3c5d1f1cf7360e0eb6f3f94df583226d7be2f074c4be30"}
Jul 15 10:24:13.833028 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:13.832864    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b0c14bac297e36f3b3c5d1f1cf7360e0eb6f3f94df583226d7be2f074c4be30"
Jul 15 10:24:22.110801 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.110721    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h"]
Jul 15 10:24:22.111283 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.111024    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59f63079-440c-44e8-87cc-f7f1d0d720a1" containerName="extract"
Jul 15 10:24:22.111283 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.111035    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="59f63079-440c-44e8-87cc-f7f1d0d720a1" containerName="extract"
Jul 15 10:24:22.111283 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.111048    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59f63079-440c-44e8-87cc-f7f1d0d720a1" containerName="pull"
Jul 15 10:24:22.111283 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.111053    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="59f63079-440c-44e8-87cc-f7f1d0d720a1" containerName="pull"
Jul 15 10:24:22.111283 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.111069    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59f63079-440c-44e8-87cc-f7f1d0d720a1" containerName="util"
Jul 15 10:24:22.111283 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.111074    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="59f63079-440c-44e8-87cc-f7f1d0d720a1" containerName="util"
Jul 15 10:24:22.111283 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.111138    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="59f63079-440c-44e8-87cc-f7f1d0d720a1" containerName="extract"
Jul 15 10:24:22.119401 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.119378    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h"
Jul 15 10:24:22.122196 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.122174    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 10:24:22.123106 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.123090    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mpw9v\""
Jul 15 10:24:22.123180 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.123091    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 10:24:22.129514 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.129486    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h"]
Jul 15 10:24:22.215642 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.215600    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e00333f8-d642-4f1f-bb19-3433533f6cc9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h\" (UID: \"e00333f8-d642-4f1f-bb19-3433533f6cc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h"
Jul 15 10:24:22.215642 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.215643    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frggt\" (UniqueName: \"kubernetes.io/projected/e00333f8-d642-4f1f-bb19-3433533f6cc9-kube-api-access-frggt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h\" (UID: \"e00333f8-d642-4f1f-bb19-3433533f6cc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h"
Jul 15 10:24:22.215857 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.215721    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e00333f8-d642-4f1f-bb19-3433533f6cc9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h\" (UID: \"e00333f8-d642-4f1f-bb19-3433533f6cc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h"
Jul 15 10:24:22.316461 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.316422    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e00333f8-d642-4f1f-bb19-3433533f6cc9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h\" (UID: \"e00333f8-d642-4f1f-bb19-3433533f6cc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h"
Jul 15 10:24:22.316461 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.316461    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frggt\" (UniqueName: \"kubernetes.io/projected/e00333f8-d642-4f1f-bb19-3433533f6cc9-kube-api-access-frggt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h\" (UID: \"e00333f8-d642-4f1f-bb19-3433533f6cc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h"
Jul 15 10:24:22.316671 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.316519    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e00333f8-d642-4f1f-bb19-3433533f6cc9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h\" (UID: \"e00333f8-d642-4f1f-bb19-3433533f6cc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h"
Jul 15 10:24:22.316880 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.316854    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e00333f8-d642-4f1f-bb19-3433533f6cc9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h\" (UID: \"e00333f8-d642-4f1f-bb19-3433533f6cc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h"
Jul 15 10:24:22.316918 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.316878    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e00333f8-d642-4f1f-bb19-3433533f6cc9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h\" (UID: \"e00333f8-d642-4f1f-bb19-3433533f6cc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h"
Jul 15 10:24:22.335533 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.335496    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frggt\" (UniqueName: \"kubernetes.io/projected/e00333f8-d642-4f1f-bb19-3433533f6cc9-kube-api-access-frggt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h\" (UID: \"e00333f8-d642-4f1f-bb19-3433533f6cc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h"
Jul 15 10:24:22.428743 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.428652    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h"
Jul 15 10:24:22.605415 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.605385    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h"]
Jul 15 10:24:22.609701 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:24:22.609658    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode00333f8_d642_4f1f_bb19_3433533f6cc9.slice/crio-de0d2d2595854f4b92c56148cb9ac911915e2fccc48ed9550c22cec2d1c8a993 WatchSource:0}: Error finding container de0d2d2595854f4b92c56148cb9ac911915e2fccc48ed9550c22cec2d1c8a993: Status 404 returned error can't find the container with id de0d2d2595854f4b92c56148cb9ac911915e2fccc48ed9550c22cec2d1c8a993
Jul 15 10:24:22.866364 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.866327    2568 generic.go:356] "Generic (PLEG): container finished" podID="e00333f8-d642-4f1f-bb19-3433533f6cc9" containerID="c36d562ab992b2260a8b9838f8fc92e1805b48c12fdcd4ec1219e6d522d24044" exitCode=0
Jul 15 10:24:22.866534 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.866400    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h" event={"ID":"e00333f8-d642-4f1f-bb19-3433533f6cc9","Type":"ContainerDied","Data":"c36d562ab992b2260a8b9838f8fc92e1805b48c12fdcd4ec1219e6d522d24044"}
Jul 15 10:24:22.866534 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:22.866442    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h" event={"ID":"e00333f8-d642-4f1f-bb19-3433533f6cc9","Type":"ContainerStarted","Data":"de0d2d2595854f4b92c56148cb9ac911915e2fccc48ed9550c22cec2d1c8a993"}
Jul 15 10:24:24.215688 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:24.215650    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kdgls"]
Jul 15 10:24:24.221987 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:24.221960    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kdgls"
Jul 15 10:24:24.224766 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:24.224743    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4c89s\""
Jul 15 10:24:24.225798 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:24.225774    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 10:24:24.225927 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:24.225778    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 10:24:24.235624 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:24.235600    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kdgls"]
Jul 15 10:24:24.336953 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:24.336917    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cff5ed0c-b56d-4763-bda2-d6dd17682ca3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kdgls\" (UID: \"cff5ed0c-b56d-4763-bda2-d6dd17682ca3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kdgls"
Jul 15 10:24:24.336953 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:24.336956    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpb87\" (UniqueName: \"kubernetes.io/projected/cff5ed0c-b56d-4763-bda2-d6dd17682ca3-kube-api-access-cpb87\") pod \"cert-manager-cainjector-559cdd8c87-kdgls\" (UID: \"cff5ed0c-b56d-4763-bda2-d6dd17682ca3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kdgls"
Jul 15 10:24:24.438439 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:24.438403    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cff5ed0c-b56d-4763-bda2-d6dd17682ca3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kdgls\" (UID: \"cff5ed0c-b56d-4763-bda2-d6dd17682ca3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kdgls"
Jul 15 10:24:24.438439 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:24.438444    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpb87\" (UniqueName: \"kubernetes.io/projected/cff5ed0c-b56d-4763-bda2-d6dd17682ca3-kube-api-access-cpb87\") pod \"cert-manager-cainjector-559cdd8c87-kdgls\" (UID: \"cff5ed0c-b56d-4763-bda2-d6dd17682ca3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kdgls"
Jul 15 10:24:24.454603 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:24.454562    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cff5ed0c-b56d-4763-bda2-d6dd17682ca3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kdgls\" (UID: \"cff5ed0c-b56d-4763-bda2-d6dd17682ca3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kdgls"
Jul 15 10:24:24.458076 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:24.458043    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpb87\" (UniqueName: \"kubernetes.io/projected/cff5ed0c-b56d-4763-bda2-d6dd17682ca3-kube-api-access-cpb87\") pod \"cert-manager-cainjector-559cdd8c87-kdgls\" (UID: \"cff5ed0c-b56d-4763-bda2-d6dd17682ca3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kdgls"
Jul 15 10:24:24.532889 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:24.532830    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kdgls"
Jul 15 10:24:24.957733 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:24.957698    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kdgls"]
Jul 15 10:24:24.960871 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:24:24.960844    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcff5ed0c_b56d_4763_bda2_d6dd17682ca3.slice/crio-0db5a01f11d2bf36cbf5a6399aee617e6c78ee52cb2d6f2b7aff7781b04620c7 WatchSource:0}: Error finding container 0db5a01f11d2bf36cbf5a6399aee617e6c78ee52cb2d6f2b7aff7781b04620c7: Status 404 returned error can't find the container with id 0db5a01f11d2bf36cbf5a6399aee617e6c78ee52cb2d6f2b7aff7781b04620c7
Jul 15 10:24:25.881021 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:25.880986    2568 generic.go:356] "Generic (PLEG): container finished" podID="e00333f8-d642-4f1f-bb19-3433533f6cc9" containerID="5b8f6ddca670c905a89b99b275b2259c1962f8f8ed6b4238645a980e417c4902" exitCode=0
Jul 15 10:24:25.881518 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:25.881074    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h" event={"ID":"e00333f8-d642-4f1f-bb19-3433533f6cc9","Type":"ContainerDied","Data":"5b8f6ddca670c905a89b99b275b2259c1962f8f8ed6b4238645a980e417c4902"}
Jul 15 10:24:25.882427 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:25.882403    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kdgls" event={"ID":"cff5ed0c-b56d-4763-bda2-d6dd17682ca3","Type":"ContainerStarted","Data":"0db5a01f11d2bf36cbf5a6399aee617e6c78ee52cb2d6f2b7aff7781b04620c7"}
Jul 15 10:24:26.890457 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:26.890413    2568 generic.go:356] "Generic (PLEG): container finished" podID="e00333f8-d642-4f1f-bb19-3433533f6cc9" containerID="6b446b18e99f2a6e0ef0574dfc78dd558d10b60abfefeadc08b0462027a710de" exitCode=0
Jul 15 10:24:26.890872 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:26.890498    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h" event={"ID":"e00333f8-d642-4f1f-bb19-3433533f6cc9","Type":"ContainerDied","Data":"6b446b18e99f2a6e0ef0574dfc78dd558d10b60abfefeadc08b0462027a710de"}
Jul 15 10:24:28.026064 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:28.026038    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h"
Jul 15 10:24:28.176041 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:28.175936    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frggt\" (UniqueName: \"kubernetes.io/projected/e00333f8-d642-4f1f-bb19-3433533f6cc9-kube-api-access-frggt\") pod \"e00333f8-d642-4f1f-bb19-3433533f6cc9\" (UID: \"e00333f8-d642-4f1f-bb19-3433533f6cc9\") "
Jul 15 10:24:28.176234 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:28.176050    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e00333f8-d642-4f1f-bb19-3433533f6cc9-bundle\") pod \"e00333f8-d642-4f1f-bb19-3433533f6cc9\" (UID: \"e00333f8-d642-4f1f-bb19-3433533f6cc9\") "
Jul 15 10:24:28.176234 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:28.176088    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e00333f8-d642-4f1f-bb19-3433533f6cc9-util\") pod \"e00333f8-d642-4f1f-bb19-3433533f6cc9\" (UID: \"e00333f8-d642-4f1f-bb19-3433533f6cc9\") "
Jul 15 10:24:28.176508 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:28.176477    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e00333f8-d642-4f1f-bb19-3433533f6cc9-bundle" (OuterVolumeSpecName: "bundle") pod "e00333f8-d642-4f1f-bb19-3433533f6cc9" (UID: "e00333f8-d642-4f1f-bb19-3433533f6cc9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:24:28.178537 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:28.178509    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e00333f8-d642-4f1f-bb19-3433533f6cc9-kube-api-access-frggt" (OuterVolumeSpecName: "kube-api-access-frggt") pod "e00333f8-d642-4f1f-bb19-3433533f6cc9" (UID: "e00333f8-d642-4f1f-bb19-3433533f6cc9"). InnerVolumeSpecName "kube-api-access-frggt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:24:28.231052 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:28.231004    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e00333f8-d642-4f1f-bb19-3433533f6cc9-util" (OuterVolumeSpecName: "util") pod "e00333f8-d642-4f1f-bb19-3433533f6cc9" (UID: "e00333f8-d642-4f1f-bb19-3433533f6cc9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:24:28.277156 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:28.277081    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e00333f8-d642-4f1f-bb19-3433533f6cc9-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:24:28.277156 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:28.277157    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e00333f8-d642-4f1f-bb19-3433533f6cc9-util\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:24:28.277345 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:28.277169    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frggt\" (UniqueName: \"kubernetes.io/projected/e00333f8-d642-4f1f-bb19-3433533f6cc9-kube-api-access-frggt\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:24:28.900715 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:28.900681    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h"
Jul 15 10:24:28.900892 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:28.900684    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7k7h" event={"ID":"e00333f8-d642-4f1f-bb19-3433533f6cc9","Type":"ContainerDied","Data":"de0d2d2595854f4b92c56148cb9ac911915e2fccc48ed9550c22cec2d1c8a993"}
Jul 15 10:24:28.900892 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:28.900803    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de0d2d2595854f4b92c56148cb9ac911915e2fccc48ed9550c22cec2d1c8a993"
Jul 15 10:24:28.902192 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:28.902160    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kdgls" event={"ID":"cff5ed0c-b56d-4763-bda2-d6dd17682ca3","Type":"ContainerStarted","Data":"88284ae4c4c1ef4f6e5360b2bc8351f6cdf7101512c607cbc8f2018d4653c5aa"}
Jul 15 10:24:29.108715 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:29.108665    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kdgls" podStartSLOduration=2.219104754 podStartE2EDuration="5.108646655s" totalImagesPullingTime="2.889541901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:24:28.929954566 +0000 UTC m=+267.749596436" watchObservedRunningTime="2026-07-15 10:24:29.108646655 +0000 UTC m=+267.928288525"
Jul 15 10:24:41.127391 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.127349    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst"]
Jul 15 10:24:41.127773 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.127619    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e00333f8-d642-4f1f-bb19-3433533f6cc9" containerName="pull"
Jul 15 10:24:41.127773 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.127629    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e00333f8-d642-4f1f-bb19-3433533f6cc9" containerName="pull"
Jul 15 10:24:41.127773 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.127648    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e00333f8-d642-4f1f-bb19-3433533f6cc9" containerName="extract"
Jul 15 10:24:41.127773 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.127653    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e00333f8-d642-4f1f-bb19-3433533f6cc9" containerName="extract"
Jul 15 10:24:41.127773 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.127663    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e00333f8-d642-4f1f-bb19-3433533f6cc9" containerName="util"
Jul 15 10:24:41.127773 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.127669    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e00333f8-d642-4f1f-bb19-3433533f6cc9" containerName="util"
Jul 15 10:24:41.127773 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.127721    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e00333f8-d642-4f1f-bb19-3433533f6cc9" containerName="extract"
Jul 15 10:24:41.131379 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.131360    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst"
Jul 15 10:24:41.135398 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.135373    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mpw9v\""
Jul 15 10:24:41.135529 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.135479    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 10:24:41.136401 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.136376    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 10:24:41.150571 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.150542    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst"]
Jul 15 10:24:41.279761 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.279720    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/965d5c4b-7040-4c04-a56d-c9b14d7dde05-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst\" (UID: \"965d5c4b-7040-4c04-a56d-c9b14d7dde05\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst"
Jul 15 10:24:41.279969 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.279807    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7v9b\" (UniqueName: \"kubernetes.io/projected/965d5c4b-7040-4c04-a56d-c9b14d7dde05-kube-api-access-w7v9b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst\" (UID: \"965d5c4b-7040-4c04-a56d-c9b14d7dde05\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst"
Jul 15 10:24:41.279969 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.279834    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/965d5c4b-7040-4c04-a56d-c9b14d7dde05-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst\" (UID: \"965d5c4b-7040-4c04-a56d-c9b14d7dde05\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst"
Jul 15 10:24:41.381096 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.380992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7v9b\" (UniqueName: \"kubernetes.io/projected/965d5c4b-7040-4c04-a56d-c9b14d7dde05-kube-api-access-w7v9b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst\" (UID: \"965d5c4b-7040-4c04-a56d-c9b14d7dde05\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst"
Jul 15 10:24:41.381096 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.381060    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/965d5c4b-7040-4c04-a56d-c9b14d7dde05-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst\" (UID: \"965d5c4b-7040-4c04-a56d-c9b14d7dde05\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst"
Jul 15 10:24:41.381096 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.381093    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/965d5c4b-7040-4c04-a56d-c9b14d7dde05-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst\" (UID: \"965d5c4b-7040-4c04-a56d-c9b14d7dde05\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst"
Jul 15 10:24:41.381483 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.381458    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/965d5c4b-7040-4c04-a56d-c9b14d7dde05-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst\" (UID: \"965d5c4b-7040-4c04-a56d-c9b14d7dde05\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst"
Jul 15 10:24:41.381558 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.381496    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/965d5c4b-7040-4c04-a56d-c9b14d7dde05-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst\" (UID: \"965d5c4b-7040-4c04-a56d-c9b14d7dde05\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst"
Jul 15 10:24:41.392293 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.392267    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7v9b\" (UniqueName: \"kubernetes.io/projected/965d5c4b-7040-4c04-a56d-c9b14d7dde05-kube-api-access-w7v9b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst\" (UID: \"965d5c4b-7040-4c04-a56d-c9b14d7dde05\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst"
Jul 15 10:24:41.440478 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.440438    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst"
Jul 15 10:24:41.601584 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.601551    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst"]
Jul 15 10:24:41.605165 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:24:41.605140    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod965d5c4b_7040_4c04_a56d_c9b14d7dde05.slice/crio-baee392ae51fc79fc8b5f5984a425e929f36ebf70971f37e90d51c830c310402 WatchSource:0}: Error finding container baee392ae51fc79fc8b5f5984a425e929f36ebf70971f37e90d51c830c310402: Status 404 returned error can't find the container with id baee392ae51fc79fc8b5f5984a425e929f36ebf70971f37e90d51c830c310402
Jul 15 10:24:41.955351 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.955258    2568 generic.go:356] "Generic (PLEG): container finished" podID="965d5c4b-7040-4c04-a56d-c9b14d7dde05" containerID="ef0b87f64a9363f9684dfdeae47d44b3af485c8924457a787265bb1c00124f06" exitCode=0
Jul 15 10:24:41.955503 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.955342    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst" event={"ID":"965d5c4b-7040-4c04-a56d-c9b14d7dde05","Type":"ContainerDied","Data":"ef0b87f64a9363f9684dfdeae47d44b3af485c8924457a787265bb1c00124f06"}
Jul 15 10:24:41.955503 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:41.955395    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst" event={"ID":"965d5c4b-7040-4c04-a56d-c9b14d7dde05","Type":"ContainerStarted","Data":"baee392ae51fc79fc8b5f5984a425e929f36ebf70971f37e90d51c830c310402"}
Jul 15 10:24:42.668898 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:42.668829    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mhkj5"]
Jul 15 10:24:42.671862 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:42.671845    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mhkj5"
Jul 15 10:24:42.674630 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:42.674603    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-k6l52\""
Jul 15 10:24:42.685075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:42.685051    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mhkj5"]
Jul 15 10:24:42.691420 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:42.691393    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksj9v\" (UniqueName: \"kubernetes.io/projected/9a613d8b-014b-4cea-af75-f9c7244cdba1-kube-api-access-ksj9v\") pod \"cert-manager-55b4d954d5-mhkj5\" (UID: \"9a613d8b-014b-4cea-af75-f9c7244cdba1\") " pod="cert-manager/cert-manager-55b4d954d5-mhkj5"
Jul 15 10:24:42.691528 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:42.691468    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a613d8b-014b-4cea-af75-f9c7244cdba1-bound-sa-token\") pod \"cert-manager-55b4d954d5-mhkj5\" (UID: \"9a613d8b-014b-4cea-af75-f9c7244cdba1\") " pod="cert-manager/cert-manager-55b4d954d5-mhkj5"
Jul 15 10:24:42.792412 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:42.792375    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksj9v\" (UniqueName: \"kubernetes.io/projected/9a613d8b-014b-4cea-af75-f9c7244cdba1-kube-api-access-ksj9v\") pod \"cert-manager-55b4d954d5-mhkj5\" (UID: \"9a613d8b-014b-4cea-af75-f9c7244cdba1\") " pod="cert-manager/cert-manager-55b4d954d5-mhkj5"
Jul 15 10:24:42.792585 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:42.792458    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a613d8b-014b-4cea-af75-f9c7244cdba1-bound-sa-token\") pod \"cert-manager-55b4d954d5-mhkj5\" (UID: \"9a613d8b-014b-4cea-af75-f9c7244cdba1\") " pod="cert-manager/cert-manager-55b4d954d5-mhkj5"
Jul 15 10:24:42.807909 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:42.807884    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksj9v\" (UniqueName: \"kubernetes.io/projected/9a613d8b-014b-4cea-af75-f9c7244cdba1-kube-api-access-ksj9v\") pod \"cert-manager-55b4d954d5-mhkj5\" (UID: \"9a613d8b-014b-4cea-af75-f9c7244cdba1\") " pod="cert-manager/cert-manager-55b4d954d5-mhkj5"
Jul 15 10:24:42.810028 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:42.809994    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a613d8b-014b-4cea-af75-f9c7244cdba1-bound-sa-token\") pod \"cert-manager-55b4d954d5-mhkj5\" (UID: \"9a613d8b-014b-4cea-af75-f9c7244cdba1\") " pod="cert-manager/cert-manager-55b4d954d5-mhkj5"
Jul 15 10:24:42.961398 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:42.961287    2568 generic.go:356] "Generic (PLEG): container finished" podID="965d5c4b-7040-4c04-a56d-c9b14d7dde05" containerID="585c97c0362574fba0da92f08aa5eb8e271c7383a0f9d585552cf31cf00dc57e" exitCode=0
Jul 15 10:24:42.961398 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:42.961352    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst" event={"ID":"965d5c4b-7040-4c04-a56d-c9b14d7dde05","Type":"ContainerDied","Data":"585c97c0362574fba0da92f08aa5eb8e271c7383a0f9d585552cf31cf00dc57e"}
Jul 15 10:24:42.980732 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:42.980708    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mhkj5"
Jul 15 10:24:43.145382 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:43.145307    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mhkj5"]
Jul 15 10:24:43.180198 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:24:43.180166    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a613d8b_014b_4cea_af75_f9c7244cdba1.slice/crio-cf06b4e17feaa533258e82d09337bce7656444c8fe7056cd1621daff7e4831cc WatchSource:0}: Error finding container cf06b4e17feaa533258e82d09337bce7656444c8fe7056cd1621daff7e4831cc: Status 404 returned error can't find the container with id cf06b4e17feaa533258e82d09337bce7656444c8fe7056cd1621daff7e4831cc
Jul 15 10:24:43.967370 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:43.967334    2568 generic.go:356] "Generic (PLEG): container finished" podID="965d5c4b-7040-4c04-a56d-c9b14d7dde05" containerID="a7c1809f27d657156bf3aeb71c2375b6a73584ad5f55a7c7e482bca0be9a937d" exitCode=0
Jul 15 10:24:43.967773 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:43.967423    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst" event={"ID":"965d5c4b-7040-4c04-a56d-c9b14d7dde05","Type":"ContainerDied","Data":"a7c1809f27d657156bf3aeb71c2375b6a73584ad5f55a7c7e482bca0be9a937d"}
Jul 15 10:24:43.968822 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:43.968800    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mhkj5" event={"ID":"9a613d8b-014b-4cea-af75-f9c7244cdba1","Type":"ContainerStarted","Data":"952a601d52daff760ae9645375dac505c1f7b0bb24a8bd7b2dd13dabae33125e"}
Jul 15 10:24:43.968934 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:43.968830    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mhkj5" event={"ID":"9a613d8b-014b-4cea-af75-f9c7244cdba1","Type":"ContainerStarted","Data":"cf06b4e17feaa533258e82d09337bce7656444c8fe7056cd1621daff7e4831cc"}
Jul 15 10:24:44.020688 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:44.020637    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-mhkj5" podStartSLOduration=2.020623081 podStartE2EDuration="2.020623081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:24:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:24:44.020034873 +0000 UTC m=+282.839676755" watchObservedRunningTime="2026-07-15 10:24:44.020623081 +0000 UTC m=+282.840264952"
Jul 15 10:24:45.110967 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:45.110943    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst"
Jul 15 10:24:45.208226 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:45.208192    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/965d5c4b-7040-4c04-a56d-c9b14d7dde05-bundle\") pod \"965d5c4b-7040-4c04-a56d-c9b14d7dde05\" (UID: \"965d5c4b-7040-4c04-a56d-c9b14d7dde05\") "
Jul 15 10:24:45.208226 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:45.208232    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7v9b\" (UniqueName: \"kubernetes.io/projected/965d5c4b-7040-4c04-a56d-c9b14d7dde05-kube-api-access-w7v9b\") pod \"965d5c4b-7040-4c04-a56d-c9b14d7dde05\" (UID: \"965d5c4b-7040-4c04-a56d-c9b14d7dde05\") "
Jul 15 10:24:45.208433 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:45.208257    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/965d5c4b-7040-4c04-a56d-c9b14d7dde05-util\") pod \"965d5c4b-7040-4c04-a56d-c9b14d7dde05\" (UID: \"965d5c4b-7040-4c04-a56d-c9b14d7dde05\") "
Jul 15 10:24:45.208900 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:45.208871    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/965d5c4b-7040-4c04-a56d-c9b14d7dde05-bundle" (OuterVolumeSpecName: "bundle") pod "965d5c4b-7040-4c04-a56d-c9b14d7dde05" (UID: "965d5c4b-7040-4c04-a56d-c9b14d7dde05"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:24:45.210397 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:45.210373    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/965d5c4b-7040-4c04-a56d-c9b14d7dde05-kube-api-access-w7v9b" (OuterVolumeSpecName: "kube-api-access-w7v9b") pod "965d5c4b-7040-4c04-a56d-c9b14d7dde05" (UID: "965d5c4b-7040-4c04-a56d-c9b14d7dde05"). InnerVolumeSpecName "kube-api-access-w7v9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:24:45.214202 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:45.214169    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/965d5c4b-7040-4c04-a56d-c9b14d7dde05-util" (OuterVolumeSpecName: "util") pod "965d5c4b-7040-4c04-a56d-c9b14d7dde05" (UID: "965d5c4b-7040-4c04-a56d-c9b14d7dde05"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:24:45.309302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:45.309265    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/965d5c4b-7040-4c04-a56d-c9b14d7dde05-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:24:45.309302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:45.309295    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7v9b\" (UniqueName: \"kubernetes.io/projected/965d5c4b-7040-4c04-a56d-c9b14d7dde05-kube-api-access-w7v9b\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:24:45.309302 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:45.309305    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/965d5c4b-7040-4c04-a56d-c9b14d7dde05-util\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:24:45.978775 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:45.978695    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst"
Jul 15 10:24:45.978775 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:45.978705    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvkst" event={"ID":"965d5c4b-7040-4c04-a56d-c9b14d7dde05","Type":"ContainerDied","Data":"baee392ae51fc79fc8b5f5984a425e929f36ebf70971f37e90d51c830c310402"}
Jul 15 10:24:45.978775 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:45.978747    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="baee392ae51fc79fc8b5f5984a425e929f36ebf70971f37e90d51c830c310402"
Jul 15 10:24:54.105492 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.101022    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"]
Jul 15 10:24:54.105492 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.101684    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="965d5c4b-7040-4c04-a56d-c9b14d7dde05" containerName="pull"
Jul 15 10:24:54.105492 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.101702    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="965d5c4b-7040-4c04-a56d-c9b14d7dde05" containerName="pull"
Jul 15 10:24:54.105492 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.101738    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="965d5c4b-7040-4c04-a56d-c9b14d7dde05" containerName="util"
Jul 15 10:24:54.105492 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.101746    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="965d5c4b-7040-4c04-a56d-c9b14d7dde05" containerName="util"
Jul 15 10:24:54.105492 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.101763    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="965d5c4b-7040-4c04-a56d-c9b14d7dde05" containerName="extract"
Jul 15 10:24:54.105492 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.101772    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="965d5c4b-7040-4c04-a56d-c9b14d7dde05" containerName="extract"
Jul 15 10:24:54.105492 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.101911    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="965d5c4b-7040-4c04-a56d-c9b14d7dde05" containerName="extract"
Jul 15 10:24:54.106754 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.106730    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:24:54.114753 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.114734    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 10:24:54.115814 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.115799    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 10:24:54.116014 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.115999    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 10:24:54.116099 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.116054    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xgzvh\""
Jul 15 10:24:54.116099 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.116071    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 10:24:54.124558 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.124532    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"]
Jul 15 10:24:54.178658 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.178618    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eff584cf-e96b-4235-b839-206180ab4e9f-tmp\") pod \"opendatahub-operator-controller-manager-656947bb4-lp8tc\" (UID: \"eff584cf-e96b-4235-b839-206180ab4e9f\") " pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:24:54.178658 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.178654    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eff584cf-e96b-4235-b839-206180ab4e9f-webhook-cert\") pod \"opendatahub-operator-controller-manager-656947bb4-lp8tc\" (UID: \"eff584cf-e96b-4235-b839-206180ab4e9f\") " pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:24:54.178886 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.178678    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eff584cf-e96b-4235-b839-206180ab4e9f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-656947bb4-lp8tc\" (UID: \"eff584cf-e96b-4235-b839-206180ab4e9f\") " pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:24:54.178886 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.178739    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eff584cf-e96b-4235-b839-206180ab4e9f-manifests\") pod \"opendatahub-operator-controller-manager-656947bb4-lp8tc\" (UID: \"eff584cf-e96b-4235-b839-206180ab4e9f\") " pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:24:54.178886 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.178771    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zkzm\" (UniqueName: \"kubernetes.io/projected/eff584cf-e96b-4235-b839-206180ab4e9f-kube-api-access-5zkzm\") pod \"opendatahub-operator-controller-manager-656947bb4-lp8tc\" (UID: \"eff584cf-e96b-4235-b839-206180ab4e9f\") " pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:24:54.279999 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.279945    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eff584cf-e96b-4235-b839-206180ab4e9f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-656947bb4-lp8tc\" (UID: \"eff584cf-e96b-4235-b839-206180ab4e9f\") " pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:24:54.279999 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.280004    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eff584cf-e96b-4235-b839-206180ab4e9f-manifests\") pod \"opendatahub-operator-controller-manager-656947bb4-lp8tc\" (UID: \"eff584cf-e96b-4235-b839-206180ab4e9f\") " pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:24:54.280264 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.280140    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zkzm\" (UniqueName: \"kubernetes.io/projected/eff584cf-e96b-4235-b839-206180ab4e9f-kube-api-access-5zkzm\") pod \"opendatahub-operator-controller-manager-656947bb4-lp8tc\" (UID: \"eff584cf-e96b-4235-b839-206180ab4e9f\") " pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:24:54.280300 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.280266    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eff584cf-e96b-4235-b839-206180ab4e9f-tmp\") pod \"opendatahub-operator-controller-manager-656947bb4-lp8tc\" (UID: \"eff584cf-e96b-4235-b839-206180ab4e9f\") " pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:24:54.280338 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.280295    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eff584cf-e96b-4235-b839-206180ab4e9f-webhook-cert\") pod \"opendatahub-operator-controller-manager-656947bb4-lp8tc\" (UID: \"eff584cf-e96b-4235-b839-206180ab4e9f\") " pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:24:54.280371 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.280355    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eff584cf-e96b-4235-b839-206180ab4e9f-manifests\") pod \"opendatahub-operator-controller-manager-656947bb4-lp8tc\" (UID: \"eff584cf-e96b-4235-b839-206180ab4e9f\") " pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:24:54.282529 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.282505    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eff584cf-e96b-4235-b839-206180ab4e9f-tmp\") pod \"opendatahub-operator-controller-manager-656947bb4-lp8tc\" (UID: \"eff584cf-e96b-4235-b839-206180ab4e9f\") " pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:24:54.282666 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.282648    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eff584cf-e96b-4235-b839-206180ab4e9f-webhook-cert\") pod \"opendatahub-operator-controller-manager-656947bb4-lp8tc\" (UID: \"eff584cf-e96b-4235-b839-206180ab4e9f\") " pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:24:54.282718 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.282697    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eff584cf-e96b-4235-b839-206180ab4e9f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-656947bb4-lp8tc\" (UID: \"eff584cf-e96b-4235-b839-206180ab4e9f\") " pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:24:54.297783 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.297744    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zkzm\" (UniqueName: \"kubernetes.io/projected/eff584cf-e96b-4235-b839-206180ab4e9f-kube-api-access-5zkzm\") pod \"opendatahub-operator-controller-manager-656947bb4-lp8tc\" (UID: \"eff584cf-e96b-4235-b839-206180ab4e9f\") " pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:24:54.417477 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.417384    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:24:54.595294 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:54.595271    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"]
Jul 15 10:24:54.597044 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:24:54.597017    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff584cf_e96b_4235_b839_206180ab4e9f.slice/crio-c040356682d08a538e7dd594996e5cea56f04dfa8df921867e0d7abee5a6d2e6 WatchSource:0}: Error finding container c040356682d08a538e7dd594996e5cea56f04dfa8df921867e0d7abee5a6d2e6: Status 404 returned error can't find the container with id c040356682d08a538e7dd594996e5cea56f04dfa8df921867e0d7abee5a6d2e6
Jul 15 10:24:55.016199 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:24:55.016165    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc" event={"ID":"eff584cf-e96b-4235-b839-206180ab4e9f","Type":"ContainerStarted","Data":"c040356682d08a538e7dd594996e5cea56f04dfa8df921867e0d7abee5a6d2e6"}
Jul 15 10:25:00.044209 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:00.044168    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc" event={"ID":"eff584cf-e96b-4235-b839-206180ab4e9f","Type":"ContainerStarted","Data":"0bd11a428184ca182c8c579de57495ce9c320ea3ba785c7ba439d759c5ffbdfa"}
Jul 15 10:25:01.049963 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:01.049926    2568 generic.go:356] "Generic (PLEG): container finished" podID="eff584cf-e96b-4235-b839-206180ab4e9f" containerID="0bd11a428184ca182c8c579de57495ce9c320ea3ba785c7ba439d759c5ffbdfa" exitCode=0
Jul 15 10:25:01.050461 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:01.049988    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc" event={"ID":"eff584cf-e96b-4235-b839-206180ab4e9f","Type":"ContainerDied","Data":"0bd11a428184ca182c8c579de57495ce9c320ea3ba785c7ba439d759c5ffbdfa"}
Jul 15 10:25:01.509151 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:01.509101    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:25:01.514573 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:01.514547    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:25:01.515035 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:01.515014    2568 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 10:25:02.057385 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:02.057352    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc" event={"ID":"eff584cf-e96b-4235-b839-206180ab4e9f","Type":"ContainerStarted","Data":"d3c83f08ddb98801dc6478f88fbe99dab0db586a93fa6551b94545636197caba"}
Jul 15 10:25:02.059794 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:02.057480    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:25:02.091996 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:02.091926    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc" podStartSLOduration=1.722795512 podStartE2EDuration="8.091909778s" totalImagesPullingTime="5.312717245s" totalInitContainerRuntime="1.056397021s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:24:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:25:02.090535841 +0000 UTC m=+300.910177712" watchObservedRunningTime="2026-07-15 10:25:02.091909778 +0000 UTC m=+300.911551650"
Jul 15 10:25:13.064671 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:13.064633    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-656947bb4-lp8tc"
Jul 15 10:25:15.814795 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:15.814760    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-57fpv"]
Jul 15 10:25:15.822823 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:15.822800    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-57fpv"
Jul 15 10:25:15.825481 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:15.825454    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 15 10:25:15.825580 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:15.825539    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-9rxkj\""
Jul 15 10:25:15.841032 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:15.841007    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-57fpv"]
Jul 15 10:25:15.960813 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:15.960771    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24xck\" (UniqueName: \"kubernetes.io/projected/9373b6ed-a7b7-4dc5-a38f-2c67845957a9-kube-api-access-24xck\") pod \"odh-model-controller-7998c67dc4-57fpv\" (UID: \"9373b6ed-a7b7-4dc5-a38f-2c67845957a9\") " pod="opendatahub/odh-model-controller-7998c67dc4-57fpv"
Jul 15 10:25:15.960993 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:15.960821    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9373b6ed-a7b7-4dc5-a38f-2c67845957a9-cert\") pod \"odh-model-controller-7998c67dc4-57fpv\" (UID: \"9373b6ed-a7b7-4dc5-a38f-2c67845957a9\") " pod="opendatahub/odh-model-controller-7998c67dc4-57fpv"
Jul 15 10:25:16.061763 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:16.061726    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24xck\" (UniqueName: \"kubernetes.io/projected/9373b6ed-a7b7-4dc5-a38f-2c67845957a9-kube-api-access-24xck\") pod \"odh-model-controller-7998c67dc4-57fpv\" (UID: \"9373b6ed-a7b7-4dc5-a38f-2c67845957a9\") " pod="opendatahub/odh-model-controller-7998c67dc4-57fpv"
Jul 15 10:25:16.061763 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:16.061770    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9373b6ed-a7b7-4dc5-a38f-2c67845957a9-cert\") pod \"odh-model-controller-7998c67dc4-57fpv\" (UID: \"9373b6ed-a7b7-4dc5-a38f-2c67845957a9\") " pod="opendatahub/odh-model-controller-7998c67dc4-57fpv"
Jul 15 10:25:16.061986 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:25:16.061868    2568 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 15 10:25:16.061986 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:25:16.061921    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9373b6ed-a7b7-4dc5-a38f-2c67845957a9-cert podName:9373b6ed-a7b7-4dc5-a38f-2c67845957a9 nodeName:}" failed. No retries permitted until 2026-07-15 10:25:16.561905548 +0000 UTC m=+315.381547397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9373b6ed-a7b7-4dc5-a38f-2c67845957a9-cert") pod "odh-model-controller-7998c67dc4-57fpv" (UID: "9373b6ed-a7b7-4dc5-a38f-2c67845957a9") : secret "odh-model-controller-webhook-cert" not found
Jul 15 10:25:16.087204 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:16.087129    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24xck\" (UniqueName: \"kubernetes.io/projected/9373b6ed-a7b7-4dc5-a38f-2c67845957a9-kube-api-access-24xck\") pod \"odh-model-controller-7998c67dc4-57fpv\" (UID: \"9373b6ed-a7b7-4dc5-a38f-2c67845957a9\") " pod="opendatahub/odh-model-controller-7998c67dc4-57fpv"
Jul 15 10:25:16.566811 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:16.566769    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9373b6ed-a7b7-4dc5-a38f-2c67845957a9-cert\") pod \"odh-model-controller-7998c67dc4-57fpv\" (UID: \"9373b6ed-a7b7-4dc5-a38f-2c67845957a9\") " pod="opendatahub/odh-model-controller-7998c67dc4-57fpv"
Jul 15 10:25:16.569372 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:16.569343    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9373b6ed-a7b7-4dc5-a38f-2c67845957a9-cert\") pod \"odh-model-controller-7998c67dc4-57fpv\" (UID: \"9373b6ed-a7b7-4dc5-a38f-2c67845957a9\") " pod="opendatahub/odh-model-controller-7998c67dc4-57fpv"
Jul 15 10:25:16.732961 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:16.732925    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-57fpv"
Jul 15 10:25:16.916307 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:16.916143    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-57fpv"]
Jul 15 10:25:16.919088 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:25:16.919046    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9373b6ed_a7b7_4dc5_a38f_2c67845957a9.slice/crio-3a5170955e58702146cfa125d639acecc4ec5cd3c2bbe8fb5e6910823e426b07 WatchSource:0}: Error finding container 3a5170955e58702146cfa125d639acecc4ec5cd3c2bbe8fb5e6910823e426b07: Status 404 returned error can't find the container with id 3a5170955e58702146cfa125d639acecc4ec5cd3c2bbe8fb5e6910823e426b07
Jul 15 10:25:16.920623 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:16.920606    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 10:25:17.124584 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:17.124491    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-57fpv" event={"ID":"9373b6ed-a7b7-4dc5-a38f-2c67845957a9","Type":"ContainerStarted","Data":"3a5170955e58702146cfa125d639acecc4ec5cd3c2bbe8fb5e6910823e426b07"}
Jul 15 10:25:17.392976 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:17.392897    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gnx2f"]
Jul 15 10:25:17.397506 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:17.397488    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gnx2f"
Jul 15 10:25:17.405599 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:17.405579    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 15 10:25:17.439252 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:17.439215    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gnx2f"]
Jul 15 10:25:17.473559 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:17.473520    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwhw5\" (UniqueName: \"kubernetes.io/projected/01d7e671-9d90-4b42-8dbe-4710b0dbaeac-kube-api-access-zwhw5\") pod \"model-serving-api-54d89bd5fc-gnx2f\" (UID: \"01d7e671-9d90-4b42-8dbe-4710b0dbaeac\") " pod="opendatahub/model-serving-api-54d89bd5fc-gnx2f"
Jul 15 10:25:17.473728 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:17.473581    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01d7e671-9d90-4b42-8dbe-4710b0dbaeac-tls-certs\") pod \"model-serving-api-54d89bd5fc-gnx2f\" (UID: \"01d7e671-9d90-4b42-8dbe-4710b0dbaeac\") " pod="opendatahub/model-serving-api-54d89bd5fc-gnx2f"
Jul 15 10:25:17.574928 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:17.574867    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwhw5\" (UniqueName: \"kubernetes.io/projected/01d7e671-9d90-4b42-8dbe-4710b0dbaeac-kube-api-access-zwhw5\") pod \"model-serving-api-54d89bd5fc-gnx2f\" (UID: \"01d7e671-9d90-4b42-8dbe-4710b0dbaeac\") " pod="opendatahub/model-serving-api-54d89bd5fc-gnx2f"
Jul 15 10:25:17.575100 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:17.574955    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01d7e671-9d90-4b42-8dbe-4710b0dbaeac-tls-certs\") pod \"model-serving-api-54d89bd5fc-gnx2f\" (UID: \"01d7e671-9d90-4b42-8dbe-4710b0dbaeac\") " pod="opendatahub/model-serving-api-54d89bd5fc-gnx2f"
Jul 15 10:25:17.577638 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:17.577613    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01d7e671-9d90-4b42-8dbe-4710b0dbaeac-tls-certs\") pod \"model-serving-api-54d89bd5fc-gnx2f\" (UID: \"01d7e671-9d90-4b42-8dbe-4710b0dbaeac\") " pod="opendatahub/model-serving-api-54d89bd5fc-gnx2f"
Jul 15 10:25:17.586719 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:17.586691    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwhw5\" (UniqueName: \"kubernetes.io/projected/01d7e671-9d90-4b42-8dbe-4710b0dbaeac-kube-api-access-zwhw5\") pod \"model-serving-api-54d89bd5fc-gnx2f\" (UID: \"01d7e671-9d90-4b42-8dbe-4710b0dbaeac\") " pod="opendatahub/model-serving-api-54d89bd5fc-gnx2f"
Jul 15 10:25:17.708148 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:17.708036    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gnx2f"
Jul 15 10:25:17.850696 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:17.850671    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gnx2f"]
Jul 15 10:25:17.852255 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:25:17.852229    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d7e671_9d90_4b42_8dbe_4710b0dbaeac.slice/crio-6d23860059a99d084234b05e875d3e5ae61aaf99edb8e2c12c36cb091daae948 WatchSource:0}: Error finding container 6d23860059a99d084234b05e875d3e5ae61aaf99edb8e2c12c36cb091daae948: Status 404 returned error can't find the container with id 6d23860059a99d084234b05e875d3e5ae61aaf99edb8e2c12c36cb091daae948
Jul 15 10:25:18.132796 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:18.132761    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gnx2f" event={"ID":"01d7e671-9d90-4b42-8dbe-4710b0dbaeac","Type":"ContainerStarted","Data":"6d23860059a99d084234b05e875d3e5ae61aaf99edb8e2c12c36cb091daae948"}
Jul 15 10:25:21.156478 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:21.156439    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gnx2f" event={"ID":"01d7e671-9d90-4b42-8dbe-4710b0dbaeac","Type":"ContainerStarted","Data":"6a65becdad00e58ac7dc6848f82f64f0c6423a9ca7cadab21dd0ccf7bdfe642d"}
Jul 15 10:25:21.156905 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:21.156532    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gnx2f"
Jul 15 10:25:21.158062 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:21.158033    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-57fpv" event={"ID":"9373b6ed-a7b7-4dc5-a38f-2c67845957a9","Type":"ContainerStarted","Data":"d1d47f3e5dbf3a7a8698364436b355c182324dc2428c67023f831ff0d23617ae"}
Jul 15 10:25:21.158235 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:21.158156    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-57fpv"
Jul 15 10:25:21.178791 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:21.178570    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gnx2f" podStartSLOduration=1.442013993 podStartE2EDuration="4.178548952s" totalImagesPullingTime="2.736534959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:25:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:25:21.177673497 +0000 UTC m=+319.997315380" watchObservedRunningTime="2026-07-15 10:25:21.178548952 +0000 UTC m=+319.998190826"
Jul 15 10:25:21.205130 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:21.205056    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-57fpv" podStartSLOduration=2.5323290309999997 podStartE2EDuration="6.205039886s" totalImagesPullingTime="3.672710855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:25:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:25:21.204078624 +0000 UTC m=+320.023720497" watchObservedRunningTime="2026-07-15 10:25:21.205039886 +0000 UTC m=+320.024681756"
Jul 15 10:25:24.190936 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.190879    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"]
Jul 15 10:25:24.194056 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.194038    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"
Jul 15 10:25:24.197888 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.197863    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 10:25:24.198044 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.197864    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 10:25:24.198044 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.197918    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 10:25:24.198044 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.197929    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 10:25:24.198044 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.197925    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 10:25:24.198044 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.197864    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mm624\""
Jul 15 10:25:24.213444 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.213415    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"]
Jul 15 10:25:24.339475 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.339432    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06220b24-e647-4843-8e15-5c208c06efdd-cert\") pod \"lws-controller-manager-587d8d67f-s5tb7\" (UID: \"06220b24-e647-4843-8e15-5c208c06efdd\") " pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"
Jul 15 10:25:24.339475 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.339476    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gftc7\" (UniqueName: \"kubernetes.io/projected/06220b24-e647-4843-8e15-5c208c06efdd-kube-api-access-gftc7\") pod \"lws-controller-manager-587d8d67f-s5tb7\" (UID: \"06220b24-e647-4843-8e15-5c208c06efdd\") " pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"
Jul 15 10:25:24.339720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.339617    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/06220b24-e647-4843-8e15-5c208c06efdd-metrics-cert\") pod \"lws-controller-manager-587d8d67f-s5tb7\" (UID: \"06220b24-e647-4843-8e15-5c208c06efdd\") " pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"
Jul 15 10:25:24.339720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.339650    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/06220b24-e647-4843-8e15-5c208c06efdd-manager-config\") pod \"lws-controller-manager-587d8d67f-s5tb7\" (UID: \"06220b24-e647-4843-8e15-5c208c06efdd\") " pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"
Jul 15 10:25:24.440454 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.440415    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/06220b24-e647-4843-8e15-5c208c06efdd-metrics-cert\") pod \"lws-controller-manager-587d8d67f-s5tb7\" (UID: \"06220b24-e647-4843-8e15-5c208c06efdd\") " pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"
Jul 15 10:25:24.440454 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.440449    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/06220b24-e647-4843-8e15-5c208c06efdd-manager-config\") pod \"lws-controller-manager-587d8d67f-s5tb7\" (UID: \"06220b24-e647-4843-8e15-5c208c06efdd\") " pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"
Jul 15 10:25:24.440649 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.440485    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06220b24-e647-4843-8e15-5c208c06efdd-cert\") pod \"lws-controller-manager-587d8d67f-s5tb7\" (UID: \"06220b24-e647-4843-8e15-5c208c06efdd\") " pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"
Jul 15 10:25:24.440649 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.440505    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gftc7\" (UniqueName: \"kubernetes.io/projected/06220b24-e647-4843-8e15-5c208c06efdd-kube-api-access-gftc7\") pod \"lws-controller-manager-587d8d67f-s5tb7\" (UID: \"06220b24-e647-4843-8e15-5c208c06efdd\") " pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"
Jul 15 10:25:24.441381 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.441192    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/06220b24-e647-4843-8e15-5c208c06efdd-manager-config\") pod \"lws-controller-manager-587d8d67f-s5tb7\" (UID: \"06220b24-e647-4843-8e15-5c208c06efdd\") " pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"
Jul 15 10:25:24.443147 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.443124    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06220b24-e647-4843-8e15-5c208c06efdd-cert\") pod \"lws-controller-manager-587d8d67f-s5tb7\" (UID: \"06220b24-e647-4843-8e15-5c208c06efdd\") " pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"
Jul 15 10:25:24.443254 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.443217    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/06220b24-e647-4843-8e15-5c208c06efdd-metrics-cert\") pod \"lws-controller-manager-587d8d67f-s5tb7\" (UID: \"06220b24-e647-4843-8e15-5c208c06efdd\") " pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"
Jul 15 10:25:24.454156 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.454103    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gftc7\" (UniqueName: \"kubernetes.io/projected/06220b24-e647-4843-8e15-5c208c06efdd-kube-api-access-gftc7\") pod \"lws-controller-manager-587d8d67f-s5tb7\" (UID: \"06220b24-e647-4843-8e15-5c208c06efdd\") " pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"
Jul 15 10:25:24.503362 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.503329    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"
Jul 15 10:25:24.668078 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.668049    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"]
Jul 15 10:25:24.669368 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:25:24.669335    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06220b24_e647_4843_8e15_5c208c06efdd.slice/crio-bfb3e309aa6260165e805eb225d24be36521535441949f787a773d78c1982092 WatchSource:0}: Error finding container bfb3e309aa6260165e805eb225d24be36521535441949f787a773d78c1982092: Status 404 returned error can't find the container with id bfb3e309aa6260165e805eb225d24be36521535441949f787a773d78c1982092
Jul 15 10:25:24.922136 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.922080    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"]
Jul 15 10:25:24.926396 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.926377    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:24.929277 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.929254    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 10:25:24.929406 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.929275    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 10:25:24.929518 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.929501    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 10:25:24.930320 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.930298    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 10:25:24.930434 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.930332    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 10:25:24.930434 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.930341    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 10:25:24.930434 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.930351    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-f2vt4\""
Jul 15 10:25:24.942144 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:24.942104    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"]
Jul 15 10:25:25.045527 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.045489    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.045822 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.045554    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.045822 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.045605    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.045822 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.045641    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttsh4\" (UniqueName: \"kubernetes.io/projected/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-kube-api-access-ttsh4\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.045822 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.045667    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.045822 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.045690    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.045822 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.045712    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.146423 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.146391    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.146610 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.146435    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.146610 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.146454    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.146610 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.146474    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttsh4\" (UniqueName: \"kubernetes.io/projected/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-kube-api-access-ttsh4\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.146610 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.146499    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.146610 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.146525    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.146610 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.146545    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.147325 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.147299    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.149099 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.149063    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.149218 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.149171    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.149307 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.149287    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.149381 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.149367    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.158258 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.158234    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttsh4\" (UniqueName: \"kubernetes.io/projected/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-kube-api-access-ttsh4\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.160131 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.160097    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92996e10-e666-4c5f-bd3b-c4943f2fb7cb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-crccp\" (UID: \"92996e10-e666-4c5f-bd3b-c4943f2fb7cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.177975 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.177902    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7" event={"ID":"06220b24-e647-4843-8e15-5c208c06efdd","Type":"ContainerStarted","Data":"bfb3e309aa6260165e805eb225d24be36521535441949f787a773d78c1982092"}
Jul 15 10:25:25.236931 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.236893    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:25.407965 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:25.407887    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"]
Jul 15 10:25:25.410658 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:25:25.410612    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92996e10_e666_4c5f_bd3b_c4943f2fb7cb.slice/crio-5a8f97ba10355183e6849e1cdfdc70d25f6b51aed602d18bcb07c92a6d2bcf40 WatchSource:0}: Error finding container 5a8f97ba10355183e6849e1cdfdc70d25f6b51aed602d18bcb07c92a6d2bcf40: Status 404 returned error can't find the container with id 5a8f97ba10355183e6849e1cdfdc70d25f6b51aed602d18bcb07c92a6d2bcf40
Jul 15 10:25:26.184026 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:26.183959    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp" event={"ID":"92996e10-e666-4c5f-bd3b-c4943f2fb7cb","Type":"ContainerStarted","Data":"5a8f97ba10355183e6849e1cdfdc70d25f6b51aed602d18bcb07c92a6d2bcf40"}
Jul 15 10:25:26.185420 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:26.185392    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7" event={"ID":"06220b24-e647-4843-8e15-5c208c06efdd","Type":"ContainerStarted","Data":"c1b227dfce872e97d6b696f0bb573a48e50283ff1cf3a308657b900da4bafe7a"}
Jul 15 10:25:26.185587 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:26.185520    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"
Jul 15 10:25:26.237651 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:26.237591    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7" podStartSLOduration=0.837486933 podStartE2EDuration="2.237576127s" totalImagesPullingTime="1.400089194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:25:26.235208698 +0000 UTC m=+325.054850571" watchObservedRunningTime="2026-07-15 10:25:26.237576127 +0000 UTC m=+325.057217998"
Jul 15 10:25:28.066785 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:28.066744    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:25:28.067073 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:28.066832    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:25:28.200770 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:28.200732    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp" event={"ID":"92996e10-e666-4c5f-bd3b-c4943f2fb7cb","Type":"ContainerStarted","Data":"582ee90512d546a73ed58e83c76933255bd7970bbf8d5b5b712a78e8f4920cc9"}
Jul 15 10:25:28.200942 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:28.200856    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:28.270815 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:28.270762    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp" podStartSLOduration=1.617610801 podStartE2EDuration="4.270741127s" totalImagesPullingTime="2.653130326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:25:28.268139177 +0000 UTC m=+327.087781039" watchObservedRunningTime="2026-07-15 10:25:28.270741127 +0000 UTC m=+327.090382998"
Jul 15 10:25:29.207717 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:29.207687    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-crccp"
Jul 15 10:25:32.166536 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:32.166505    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-57fpv"
Jul 15 10:25:32.168784 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:32.168759    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gnx2f"
Jul 15 10:25:37.193746 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:25:37.193715    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-587d8d67f-s5tb7"
Jul 15 10:26:32.105638 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.105580    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv"]
Jul 15 10:26:32.109152 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.109129    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv"
Jul 15 10:26:32.111828 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.111799    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 10:26:32.111828 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.111826    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z7ndj\""
Jul 15 10:26:32.112011 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.111798    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 10:26:32.113440 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.113419    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9c96d45-ae54-498f-a174-bb01bcc96a23-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv\" (UID: \"c9c96d45-ae54-498f-a174-bb01bcc96a23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv"
Jul 15 10:26:32.113559 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.113449    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpxkt\" (UniqueName: \"kubernetes.io/projected/c9c96d45-ae54-498f-a174-bb01bcc96a23-kube-api-access-cpxkt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv\" (UID: \"c9c96d45-ae54-498f-a174-bb01bcc96a23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv"
Jul 15 10:26:32.113559 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.113489    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9c96d45-ae54-498f-a174-bb01bcc96a23-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv\" (UID: \"c9c96d45-ae54-498f-a174-bb01bcc96a23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv"
Jul 15 10:26:32.119538 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.119514    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv"]
Jul 15 10:26:32.214478 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.214436    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpxkt\" (UniqueName: \"kubernetes.io/projected/c9c96d45-ae54-498f-a174-bb01bcc96a23-kube-api-access-cpxkt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv\" (UID: \"c9c96d45-ae54-498f-a174-bb01bcc96a23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv"
Jul 15 10:26:32.214660 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.214511    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9c96d45-ae54-498f-a174-bb01bcc96a23-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv\" (UID: \"c9c96d45-ae54-498f-a174-bb01bcc96a23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv"
Jul 15 10:26:32.214660 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.214594    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9c96d45-ae54-498f-a174-bb01bcc96a23-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv\" (UID: \"c9c96d45-ae54-498f-a174-bb01bcc96a23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv"
Jul 15 10:26:32.215010 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.214987    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9c96d45-ae54-498f-a174-bb01bcc96a23-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv\" (UID: \"c9c96d45-ae54-498f-a174-bb01bcc96a23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv"
Jul 15 10:26:32.215053 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.215009    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9c96d45-ae54-498f-a174-bb01bcc96a23-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv\" (UID: \"c9c96d45-ae54-498f-a174-bb01bcc96a23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv"
Jul 15 10:26:32.224878 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.224849    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpxkt\" (UniqueName: \"kubernetes.io/projected/c9c96d45-ae54-498f-a174-bb01bcc96a23-kube-api-access-cpxkt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv\" (UID: \"c9c96d45-ae54-498f-a174-bb01bcc96a23\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv"
Jul 15 10:26:32.419178 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.419074    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv"
Jul 15 10:26:32.525140 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.525089    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm"]
Jul 15 10:26:32.528736 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.528710    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm"
Jul 15 10:26:32.540945 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.540909    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm"]
Jul 15 10:26:32.569011 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.568702    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv"]
Jul 15 10:26:32.574137 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:26:32.574090    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9c96d45_ae54_498f_a174_bb01bcc96a23.slice/crio-f2a72c11dc7f3a233cb8f493d2a2598fd57c1051efd5036029cfe8a7c2b605f3 WatchSource:0}: Error finding container f2a72c11dc7f3a233cb8f493d2a2598fd57c1051efd5036029cfe8a7c2b605f3: Status 404 returned error can't find the container with id f2a72c11dc7f3a233cb8f493d2a2598fd57c1051efd5036029cfe8a7c2b605f3
Jul 15 10:26:32.618364 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.618332    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfx4l\" (UniqueName: \"kubernetes.io/projected/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-kube-api-access-pfx4l\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm\" (UID: \"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm"
Jul 15 10:26:32.618513 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.618377    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm\" (UID: \"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm"
Jul 15 10:26:32.618513 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.618466    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm\" (UID: \"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm"
Jul 15 10:26:32.719400 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.719363    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfx4l\" (UniqueName: \"kubernetes.io/projected/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-kube-api-access-pfx4l\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm\" (UID: \"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm"
Jul 15 10:26:32.719590 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.719410    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm\" (UID: \"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm"
Jul 15 10:26:32.719590 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.719479    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm\" (UID: \"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm"
Jul 15 10:26:32.719790 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.719765    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm\" (UID: \"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm"
Jul 15 10:26:32.719847 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.719833    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm\" (UID: \"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm"
Jul 15 10:26:32.729407 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.729378    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfx4l\" (UniqueName: \"kubernetes.io/projected/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-kube-api-access-pfx4l\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm\" (UID: \"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm"
Jul 15 10:26:32.842228 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.842106    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm"
Jul 15 10:26:32.925489 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.925451    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6"]
Jul 15 10:26:32.929222 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.929175    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6"
Jul 15 10:26:32.942507 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.942421    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6"]
Jul 15 10:26:32.989435 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:32.989408    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm"]
Jul 15 10:26:32.991448 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:26:32.991425    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae1dc92_2cdb_49e1_82c7_8b1ada016b41.slice/crio-289f97608f274ca1865df26e487e0d50be3c00f592caa7df807dc53b7130f6c2 WatchSource:0}: Error finding container 289f97608f274ca1865df26e487e0d50be3c00f592caa7df807dc53b7130f6c2: Status 404 returned error can't find the container with id 289f97608f274ca1865df26e487e0d50be3c00f592caa7df807dc53b7130f6c2
Jul 15 10:26:33.021247 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.021220    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a33674c4-292d-49e5-a88d-cb1770e8eee2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6\" (UID: \"a33674c4-292d-49e5-a88d-cb1770e8eee2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6"
Jul 15 10:26:33.021348 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.021271    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28xsl\" (UniqueName: \"kubernetes.io/projected/a33674c4-292d-49e5-a88d-cb1770e8eee2-kube-api-access-28xsl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6\" (UID: \"a33674c4-292d-49e5-a88d-cb1770e8eee2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6"
Jul 15 10:26:33.021348 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.021297    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a33674c4-292d-49e5-a88d-cb1770e8eee2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6\" (UID: \"a33674c4-292d-49e5-a88d-cb1770e8eee2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6"
Jul 15 10:26:33.121698 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.121660    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a33674c4-292d-49e5-a88d-cb1770e8eee2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6\" (UID: \"a33674c4-292d-49e5-a88d-cb1770e8eee2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6"
Jul 15 10:26:33.122199 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.121727    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28xsl\" (UniqueName: \"kubernetes.io/projected/a33674c4-292d-49e5-a88d-cb1770e8eee2-kube-api-access-28xsl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6\" (UID: \"a33674c4-292d-49e5-a88d-cb1770e8eee2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6"
Jul 15 10:26:33.122199 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.121752    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a33674c4-292d-49e5-a88d-cb1770e8eee2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6\" (UID: \"a33674c4-292d-49e5-a88d-cb1770e8eee2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6"
Jul 15 10:26:33.122199 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.122099    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a33674c4-292d-49e5-a88d-cb1770e8eee2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6\" (UID: \"a33674c4-292d-49e5-a88d-cb1770e8eee2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6"
Jul 15 10:26:33.122199 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.122150    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a33674c4-292d-49e5-a88d-cb1770e8eee2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6\" (UID: \"a33674c4-292d-49e5-a88d-cb1770e8eee2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6"
Jul 15 10:26:33.132567 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.132544    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28xsl\" (UniqueName: \"kubernetes.io/projected/a33674c4-292d-49e5-a88d-cb1770e8eee2-kube-api-access-28xsl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6\" (UID: \"a33674c4-292d-49e5-a88d-cb1770e8eee2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6"
Jul 15 10:26:33.240947 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.240917    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6"
Jul 15 10:26:33.311493 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.311461    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh"]
Jul 15 10:26:33.315184 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.315163    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh"
Jul 15 10:26:33.323031 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.322999    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh\" (UID: \"86d243ec-3643-4e6f-8b0e-b2b2a894c44a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh"
Jul 15 10:26:33.323194 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.323073    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs86j\" (UniqueName: \"kubernetes.io/projected/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-kube-api-access-zs86j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh\" (UID: \"86d243ec-3643-4e6f-8b0e-b2b2a894c44a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh"
Jul 15 10:26:33.323194 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.323146    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh\" (UID: \"86d243ec-3643-4e6f-8b0e-b2b2a894c44a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh"
Jul 15 10:26:33.335027 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.334983    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh"]
Jul 15 10:26:33.386396 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.386363    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6"]
Jul 15 10:26:33.388073 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:26:33.388051    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda33674c4_292d_49e5_a88d_cb1770e8eee2.slice/crio-f67cc02baa316442138b08bee7371c15f6a6251beae1d7fabf1a56bc43ff103a WatchSource:0}: Error finding container f67cc02baa316442138b08bee7371c15f6a6251beae1d7fabf1a56bc43ff103a: Status 404 returned error can't find the container with id f67cc02baa316442138b08bee7371c15f6a6251beae1d7fabf1a56bc43ff103a
Jul 15 10:26:33.423605 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.423573    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh\" (UID: \"86d243ec-3643-4e6f-8b0e-b2b2a894c44a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh"
Jul 15 10:26:33.423753 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.423614    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs86j\" (UniqueName: \"kubernetes.io/projected/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-kube-api-access-zs86j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh\" (UID: \"86d243ec-3643-4e6f-8b0e-b2b2a894c44a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh"
Jul 15 10:26:33.423753 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.423646    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh\" (UID: \"86d243ec-3643-4e6f-8b0e-b2b2a894c44a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh"
Jul 15 10:26:33.424045 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.424023    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh\" (UID: \"86d243ec-3643-4e6f-8b0e-b2b2a894c44a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh"
Jul 15 10:26:33.424085 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.424046    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh\" (UID: \"86d243ec-3643-4e6f-8b0e-b2b2a894c44a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh"
Jul 15 10:26:33.434433 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.434407    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs86j\" (UniqueName: \"kubernetes.io/projected/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-kube-api-access-zs86j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh\" (UID: \"86d243ec-3643-4e6f-8b0e-b2b2a894c44a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh"
Jul 15 10:26:33.510585 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.510556    2568 generic.go:356] "Generic (PLEG): container finished" podID="0ae1dc92-2cdb-49e1-82c7-8b1ada016b41" containerID="a399ade3d33713285fb2f47ece61338f0a2d0d239f3b51bd6453f971211aaf15" exitCode=0
Jul 15 10:26:33.510746 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.510629    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm" event={"ID":"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41","Type":"ContainerDied","Data":"a399ade3d33713285fb2f47ece61338f0a2d0d239f3b51bd6453f971211aaf15"}
Jul 15 10:26:33.510746 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.510680    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm" event={"ID":"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41","Type":"ContainerStarted","Data":"289f97608f274ca1865df26e487e0d50be3c00f592caa7df807dc53b7130f6c2"}
Jul 15 10:26:33.512305 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.512280    2568 generic.go:356] "Generic (PLEG): container finished" podID="c9c96d45-ae54-498f-a174-bb01bcc96a23" containerID="069d64ddc2b14a31874a0f0b3533d6be1bff10dcd091269fbbbb1a23fec99a9d" exitCode=0
Jul 15 10:26:33.512447 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.512361    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv" event={"ID":"c9c96d45-ae54-498f-a174-bb01bcc96a23","Type":"ContainerDied","Data":"069d64ddc2b14a31874a0f0b3533d6be1bff10dcd091269fbbbb1a23fec99a9d"}
Jul 15 10:26:33.512447 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.512401    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv" event={"ID":"c9c96d45-ae54-498f-a174-bb01bcc96a23","Type":"ContainerStarted","Data":"f2a72c11dc7f3a233cb8f493d2a2598fd57c1051efd5036029cfe8a7c2b605f3"}
Jul 15 10:26:33.514096 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.513904    2568 generic.go:356] "Generic (PLEG): container finished" podID="a33674c4-292d-49e5-a88d-cb1770e8eee2" containerID="c8b43ab99477e82470ec3ae46b3046e914124147d0e717b4f0c08b70481b43ee" exitCode=0
Jul 15 10:26:33.514096 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.513949    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6" event={"ID":"a33674c4-292d-49e5-a88d-cb1770e8eee2","Type":"ContainerDied","Data":"c8b43ab99477e82470ec3ae46b3046e914124147d0e717b4f0c08b70481b43ee"}
Jul 15 10:26:33.514096 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.513987    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6" event={"ID":"a33674c4-292d-49e5-a88d-cb1770e8eee2","Type":"ContainerStarted","Data":"f67cc02baa316442138b08bee7371c15f6a6251beae1d7fabf1a56bc43ff103a"}
Jul 15 10:26:33.625092 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.625056    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh"
Jul 15 10:26:33.766311 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:33.766286    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh"]
Jul 15 10:26:33.768269 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:26:33.768242    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d243ec_3643_4e6f_8b0e_b2b2a894c44a.slice/crio-da6661945f7714e46cf07f7da6fb8813c73ee4a500079a4565252fd2acb568ec WatchSource:0}: Error finding container da6661945f7714e46cf07f7da6fb8813c73ee4a500079a4565252fd2acb568ec: Status 404 returned error can't find the container with id da6661945f7714e46cf07f7da6fb8813c73ee4a500079a4565252fd2acb568ec
Jul 15 10:26:34.521729 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:34.521698    2568 generic.go:356] "Generic (PLEG): container finished" podID="0ae1dc92-2cdb-49e1-82c7-8b1ada016b41" containerID="e62e29a9dee018873e12f587654d3f9cc00f755d05d7b084be469386bd9b2493" exitCode=0
Jul 15 10:26:34.522203 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:34.521778    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm" event={"ID":"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41","Type":"ContainerDied","Data":"e62e29a9dee018873e12f587654d3f9cc00f755d05d7b084be469386bd9b2493"}
Jul 15 10:26:34.523436 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:34.523417    2568 generic.go:356] "Generic (PLEG): container finished" podID="86d243ec-3643-4e6f-8b0e-b2b2a894c44a" containerID="0bcc80668ec3366bb86321ab42012789fa8373b7cfc13d830bc53211888ea0d2" exitCode=0
Jul 15 10:26:34.523492 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:34.523458    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh" event={"ID":"86d243ec-3643-4e6f-8b0e-b2b2a894c44a","Type":"ContainerDied","Data":"0bcc80668ec3366bb86321ab42012789fa8373b7cfc13d830bc53211888ea0d2"}
Jul 15 10:26:34.523524 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:34.523491    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh" event={"ID":"86d243ec-3643-4e6f-8b0e-b2b2a894c44a","Type":"ContainerStarted","Data":"da6661945f7714e46cf07f7da6fb8813c73ee4a500079a4565252fd2acb568ec"}
Jul 15 10:26:35.531957 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:35.531921    2568 generic.go:356] "Generic (PLEG): container finished" podID="0ae1dc92-2cdb-49e1-82c7-8b1ada016b41" containerID="14ed67419dae924c380cc96fc5334e977decb7c0f373f8bb6a69ca6b530f3345" exitCode=0
Jul 15 10:26:35.532433 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:35.532036    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm" event={"ID":"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41","Type":"ContainerDied","Data":"14ed67419dae924c380cc96fc5334e977decb7c0f373f8bb6a69ca6b530f3345"}
Jul 15 10:26:35.534323 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:35.534289    2568 generic.go:356] "Generic (PLEG): container finished" podID="86d243ec-3643-4e6f-8b0e-b2b2a894c44a" containerID="ea0864a63a187159397c915be71975a407f57586614c9967dd537fac3bbdda3f" exitCode=0
Jul 15 10:26:35.534454 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:35.534371    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh" event={"ID":"86d243ec-3643-4e6f-8b0e-b2b2a894c44a","Type":"ContainerDied","Data":"ea0864a63a187159397c915be71975a407f57586614c9967dd537fac3bbdda3f"}
Jul 15 10:26:36.541475 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:36.541442    2568 generic.go:356] "Generic (PLEG): container finished" podID="86d243ec-3643-4e6f-8b0e-b2b2a894c44a" containerID="2d1249c897c6a53305838fe7530ffdbeda1224abbfe21db50c2859e94d253017" exitCode=0
Jul 15 10:26:36.541897 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:36.541534    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh" event={"ID":"86d243ec-3643-4e6f-8b0e-b2b2a894c44a","Type":"ContainerDied","Data":"2d1249c897c6a53305838fe7530ffdbeda1224abbfe21db50c2859e94d253017"}
Jul 15 10:26:36.543193 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:36.543165    2568 generic.go:356] "Generic (PLEG): container finished" podID="a33674c4-292d-49e5-a88d-cb1770e8eee2" containerID="9c5be903940609a260c442845785425a43e1c5af4469913b6f4559b013d5e208" exitCode=0
Jul 15 10:26:36.543288 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:36.543251    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6" event={"ID":"a33674c4-292d-49e5-a88d-cb1770e8eee2","Type":"ContainerDied","Data":"9c5be903940609a260c442845785425a43e1c5af4469913b6f4559b013d5e208"}
Jul 15 10:26:36.545200 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:36.545177    2568 generic.go:356] "Generic (PLEG): container finished" podID="c9c96d45-ae54-498f-a174-bb01bcc96a23" containerID="da67e6af7ad1d608cc477648ea0406029a725421e37edc6310bd05bbd5cf10fe" exitCode=0
Jul 15 10:26:36.545283 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:36.545260    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv" event={"ID":"c9c96d45-ae54-498f-a174-bb01bcc96a23","Type":"ContainerDied","Data":"da67e6af7ad1d608cc477648ea0406029a725421e37edc6310bd05bbd5cf10fe"}
Jul 15 10:26:36.698428 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:36.698396    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm"
Jul 15 10:26:36.751568 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:36.751536    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-util\") pod \"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41\" (UID: \"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41\") "
Jul 15 10:26:36.751729 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:36.751632    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfx4l\" (UniqueName: \"kubernetes.io/projected/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-kube-api-access-pfx4l\") pod \"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41\" (UID: \"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41\") "
Jul 15 10:26:36.751729 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:36.751658    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-bundle\") pod \"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41\" (UID: \"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41\") "
Jul 15 10:26:36.752229 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:36.752198    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-bundle" (OuterVolumeSpecName: "bundle") pod "0ae1dc92-2cdb-49e1-82c7-8b1ada016b41" (UID: "0ae1dc92-2cdb-49e1-82c7-8b1ada016b41"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:26:36.754270 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:36.754236    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-kube-api-access-pfx4l" (OuterVolumeSpecName: "kube-api-access-pfx4l") pod "0ae1dc92-2cdb-49e1-82c7-8b1ada016b41" (UID: "0ae1dc92-2cdb-49e1-82c7-8b1ada016b41"). InnerVolumeSpecName "kube-api-access-pfx4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:26:36.757871 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:36.757840    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-util" (OuterVolumeSpecName: "util") pod "0ae1dc92-2cdb-49e1-82c7-8b1ada016b41" (UID: "0ae1dc92-2cdb-49e1-82c7-8b1ada016b41"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:26:36.852428 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:36.852386    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfx4l\" (UniqueName: \"kubernetes.io/projected/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-kube-api-access-pfx4l\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:26:36.852428 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:36.852426    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:26:36.852428 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:36.852439    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ae1dc92-2cdb-49e1-82c7-8b1ada016b41-util\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:26:37.552666 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:37.552626    2568 generic.go:356] "Generic (PLEG): container finished" podID="a33674c4-292d-49e5-a88d-cb1770e8eee2" containerID="a1dc70352169b6f1d078b26b23eaf044a5c69ce50ce885e7304d9c05a00c6b4e" exitCode=0
Jul 15 10:26:37.553082 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:37.552711    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6" event={"ID":"a33674c4-292d-49e5-a88d-cb1770e8eee2","Type":"ContainerDied","Data":"a1dc70352169b6f1d078b26b23eaf044a5c69ce50ce885e7304d9c05a00c6b4e"}
Jul 15 10:26:37.554449 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:37.554427    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm" event={"ID":"0ae1dc92-2cdb-49e1-82c7-8b1ada016b41","Type":"ContainerDied","Data":"289f97608f274ca1865df26e487e0d50be3c00f592caa7df807dc53b7130f6c2"}
Jul 15 10:26:37.554550 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:37.554467    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="289f97608f274ca1865df26e487e0d50be3c00f592caa7df807dc53b7130f6c2"
Jul 15 10:26:37.554550 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:37.554433    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm"
Jul 15 10:26:37.556628 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:37.556607    2568 generic.go:356] "Generic (PLEG): container finished" podID="c9c96d45-ae54-498f-a174-bb01bcc96a23" containerID="762149ab0917491934fbbbab50096451765730234b80a425417823d8cbc28f30" exitCode=0
Jul 15 10:26:37.556727 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:37.556660    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv" event={"ID":"c9c96d45-ae54-498f-a174-bb01bcc96a23","Type":"ContainerDied","Data":"762149ab0917491934fbbbab50096451765730234b80a425417823d8cbc28f30"}
Jul 15 10:26:37.698731 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:37.698702    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh"
Jul 15 10:26:37.759742 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:37.759712    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-util\") pod \"86d243ec-3643-4e6f-8b0e-b2b2a894c44a\" (UID: \"86d243ec-3643-4e6f-8b0e-b2b2a894c44a\") "
Jul 15 10:26:37.759936 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:37.759767    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zs86j\" (UniqueName: \"kubernetes.io/projected/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-kube-api-access-zs86j\") pod \"86d243ec-3643-4e6f-8b0e-b2b2a894c44a\" (UID: \"86d243ec-3643-4e6f-8b0e-b2b2a894c44a\") "
Jul 15 10:26:37.759936 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:37.759838    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-bundle\") pod \"86d243ec-3643-4e6f-8b0e-b2b2a894c44a\" (UID: \"86d243ec-3643-4e6f-8b0e-b2b2a894c44a\") "
Jul 15 10:26:37.760386 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:37.760360    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-bundle" (OuterVolumeSpecName: "bundle") pod "86d243ec-3643-4e6f-8b0e-b2b2a894c44a" (UID: "86d243ec-3643-4e6f-8b0e-b2b2a894c44a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:26:37.761963 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:37.761939    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-kube-api-access-zs86j" (OuterVolumeSpecName: "kube-api-access-zs86j") pod "86d243ec-3643-4e6f-8b0e-b2b2a894c44a" (UID: "86d243ec-3643-4e6f-8b0e-b2b2a894c44a"). InnerVolumeSpecName "kube-api-access-zs86j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:26:37.764961 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:37.764921    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-util" (OuterVolumeSpecName: "util") pod "86d243ec-3643-4e6f-8b0e-b2b2a894c44a" (UID: "86d243ec-3643-4e6f-8b0e-b2b2a894c44a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:26:37.860636 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:37.860586    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-util\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:26:37.860636 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:37.860623    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs86j\" (UniqueName: \"kubernetes.io/projected/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-kube-api-access-zs86j\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:26:37.860636 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:37.860634    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d243ec-3643-4e6f-8b0e-b2b2a894c44a-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:26:38.562935 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.562905    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh"
Jul 15 10:26:38.562935 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.562931    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh" event={"ID":"86d243ec-3643-4e6f-8b0e-b2b2a894c44a","Type":"ContainerDied","Data":"da6661945f7714e46cf07f7da6fb8813c73ee4a500079a4565252fd2acb568ec"}
Jul 15 10:26:38.563380 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.562974    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da6661945f7714e46cf07f7da6fb8813c73ee4a500079a4565252fd2acb568ec"
Jul 15 10:26:38.715322 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.715293    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv"
Jul 15 10:26:38.739499 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.739472    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6"
Jul 15 10:26:38.779274 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.779247    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a33674c4-292d-49e5-a88d-cb1770e8eee2-util\") pod \"a33674c4-292d-49e5-a88d-cb1770e8eee2\" (UID: \"a33674c4-292d-49e5-a88d-cb1770e8eee2\") "
Jul 15 10:26:38.779465 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.779303    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9c96d45-ae54-498f-a174-bb01bcc96a23-bundle\") pod \"c9c96d45-ae54-498f-a174-bb01bcc96a23\" (UID: \"c9c96d45-ae54-498f-a174-bb01bcc96a23\") "
Jul 15 10:26:38.779465 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.779341    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpxkt\" (UniqueName: \"kubernetes.io/projected/c9c96d45-ae54-498f-a174-bb01bcc96a23-kube-api-access-cpxkt\") pod \"c9c96d45-ae54-498f-a174-bb01bcc96a23\" (UID: \"c9c96d45-ae54-498f-a174-bb01bcc96a23\") "
Jul 15 10:26:38.779465 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.779371    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9c96d45-ae54-498f-a174-bb01bcc96a23-util\") pod \"c9c96d45-ae54-498f-a174-bb01bcc96a23\" (UID: \"c9c96d45-ae54-498f-a174-bb01bcc96a23\") "
Jul 15 10:26:38.779465 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.779412    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28xsl\" (UniqueName: \"kubernetes.io/projected/a33674c4-292d-49e5-a88d-cb1770e8eee2-kube-api-access-28xsl\") pod \"a33674c4-292d-49e5-a88d-cb1770e8eee2\" (UID: \"a33674c4-292d-49e5-a88d-cb1770e8eee2\") "
Jul 15 10:26:38.780098 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.780046    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9c96d45-ae54-498f-a174-bb01bcc96a23-bundle" (OuterVolumeSpecName: "bundle") pod "c9c96d45-ae54-498f-a174-bb01bcc96a23" (UID: "c9c96d45-ae54-498f-a174-bb01bcc96a23"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:26:38.780437 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.780385    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a33674c4-292d-49e5-a88d-cb1770e8eee2-bundle\") pod \"a33674c4-292d-49e5-a88d-cb1770e8eee2\" (UID: \"a33674c4-292d-49e5-a88d-cb1770e8eee2\") "
Jul 15 10:26:38.780880 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.780855    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9c96d45-ae54-498f-a174-bb01bcc96a23-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:26:38.781461 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.781437    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a33674c4-292d-49e5-a88d-cb1770e8eee2-bundle" (OuterVolumeSpecName: "bundle") pod "a33674c4-292d-49e5-a88d-cb1770e8eee2" (UID: "a33674c4-292d-49e5-a88d-cb1770e8eee2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:26:38.782344 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.782309    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a33674c4-292d-49e5-a88d-cb1770e8eee2-kube-api-access-28xsl" (OuterVolumeSpecName: "kube-api-access-28xsl") pod "a33674c4-292d-49e5-a88d-cb1770e8eee2" (UID: "a33674c4-292d-49e5-a88d-cb1770e8eee2"). InnerVolumeSpecName "kube-api-access-28xsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:26:38.783016 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.782993    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9c96d45-ae54-498f-a174-bb01bcc96a23-kube-api-access-cpxkt" (OuterVolumeSpecName: "kube-api-access-cpxkt") pod "c9c96d45-ae54-498f-a174-bb01bcc96a23" (UID: "c9c96d45-ae54-498f-a174-bb01bcc96a23"). InnerVolumeSpecName "kube-api-access-cpxkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:26:38.786409 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.786362    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9c96d45-ae54-498f-a174-bb01bcc96a23-util" (OuterVolumeSpecName: "util") pod "c9c96d45-ae54-498f-a174-bb01bcc96a23" (UID: "c9c96d45-ae54-498f-a174-bb01bcc96a23"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:26:38.827522 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.827426    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a33674c4-292d-49e5-a88d-cb1770e8eee2-util" (OuterVolumeSpecName: "util") pod "a33674c4-292d-49e5-a88d-cb1770e8eee2" (UID: "a33674c4-292d-49e5-a88d-cb1770e8eee2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:26:38.882163 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.882101    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpxkt\" (UniqueName: \"kubernetes.io/projected/c9c96d45-ae54-498f-a174-bb01bcc96a23-kube-api-access-cpxkt\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:26:38.882163 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.882155    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9c96d45-ae54-498f-a174-bb01bcc96a23-util\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:26:38.882163 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.882165    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28xsl\" (UniqueName: \"kubernetes.io/projected/a33674c4-292d-49e5-a88d-cb1770e8eee2-kube-api-access-28xsl\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:26:38.882163 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.882174    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a33674c4-292d-49e5-a88d-cb1770e8eee2-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:26:38.882414 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:38.882182    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a33674c4-292d-49e5-a88d-cb1770e8eee2-util\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:26:39.569752 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:39.569713    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv"
Jul 15 10:26:39.570273 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:39.569749    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv" event={"ID":"c9c96d45-ae54-498f-a174-bb01bcc96a23","Type":"ContainerDied","Data":"f2a72c11dc7f3a233cb8f493d2a2598fd57c1051efd5036029cfe8a7c2b605f3"}
Jul 15 10:26:39.570273 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:39.569803    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2a72c11dc7f3a233cb8f493d2a2598fd57c1051efd5036029cfe8a7c2b605f3"
Jul 15 10:26:39.571744 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:39.571722    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6" event={"ID":"a33674c4-292d-49e5-a88d-cb1770e8eee2","Type":"ContainerDied","Data":"f67cc02baa316442138b08bee7371c15f6a6251beae1d7fabf1a56bc43ff103a"}
Jul 15 10:26:39.571844 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:39.571755    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6"
Jul 15 10:26:39.571844 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:39.571758    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f67cc02baa316442138b08bee7371c15f6a6251beae1d7fabf1a56bc43ff103a"
Jul 15 10:26:46.989285 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:26:46.989249    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-679dc85cbf-fhbh2"]
Jul 15 10:27:12.016859 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.016797    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-679dc85cbf-fhbh2" podUID="1f03af58-f3cf-4c6e-8717-d159b47a6761" containerName="console" containerID="cri-o://b6cabc3af806a246375e284bb209bb2aeee9b189957e58ad597deabe30bef105" gracePeriod=15
Jul 15 10:27:12.268928 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.268864    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:27:12.373421 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.373391    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-oauth-config\") pod \"1f03af58-f3cf-4c6e-8717-d159b47a6761\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") "
Jul 15 10:27:12.373619 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.373445    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9v6s\" (UniqueName: \"kubernetes.io/projected/1f03af58-f3cf-4c6e-8717-d159b47a6761-kube-api-access-k9v6s\") pod \"1f03af58-f3cf-4c6e-8717-d159b47a6761\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") "
Jul 15 10:27:12.373619 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.373477    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-oauth-serving-cert\") pod \"1f03af58-f3cf-4c6e-8717-d159b47a6761\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") "
Jul 15 10:27:12.373619 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.373504    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-config\") pod \"1f03af58-f3cf-4c6e-8717-d159b47a6761\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") "
Jul 15 10:27:12.373619 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.373522    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-service-ca\") pod \"1f03af58-f3cf-4c6e-8717-d159b47a6761\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") "
Jul 15 10:27:12.373619 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.373551    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-trusted-ca-bundle\") pod \"1f03af58-f3cf-4c6e-8717-d159b47a6761\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") "
Jul 15 10:27:12.373868 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.373649    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-serving-cert\") pod \"1f03af58-f3cf-4c6e-8717-d159b47a6761\" (UID: \"1f03af58-f3cf-4c6e-8717-d159b47a6761\") "
Jul 15 10:27:12.374048 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.374010    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f03af58-f3cf-4c6e-8717-d159b47a6761" (UID: "1f03af58-f3cf-4c6e-8717-d159b47a6761"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:27:12.374048 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.374022    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1f03af58-f3cf-4c6e-8717-d159b47a6761" (UID: "1f03af58-f3cf-4c6e-8717-d159b47a6761"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:27:12.374222 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.374018    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-config" (OuterVolumeSpecName: "console-config") pod "1f03af58-f3cf-4c6e-8717-d159b47a6761" (UID: "1f03af58-f3cf-4c6e-8717-d159b47a6761"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:27:12.374222 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.374075    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f03af58-f3cf-4c6e-8717-d159b47a6761" (UID: "1f03af58-f3cf-4c6e-8717-d159b47a6761"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:27:12.376026 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.375994    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f03af58-f3cf-4c6e-8717-d159b47a6761" (UID: "1f03af58-f3cf-4c6e-8717-d159b47a6761"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:27:12.376457 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.376436    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f03af58-f3cf-4c6e-8717-d159b47a6761-kube-api-access-k9v6s" (OuterVolumeSpecName: "kube-api-access-k9v6s") pod "1f03af58-f3cf-4c6e-8717-d159b47a6761" (UID: "1f03af58-f3cf-4c6e-8717-d159b47a6761"). InnerVolumeSpecName "kube-api-access-k9v6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:27:12.376457 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.376441    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f03af58-f3cf-4c6e-8717-d159b47a6761" (UID: "1f03af58-f3cf-4c6e-8717-d159b47a6761"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:27:12.474489 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.474451    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-oauth-config\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:27:12.474489 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.474482    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9v6s\" (UniqueName: \"kubernetes.io/projected/1f03af58-f3cf-4c6e-8717-d159b47a6761-kube-api-access-k9v6s\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:27:12.474489 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.474491    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-oauth-serving-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:27:12.474489 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.474500    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-config\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:27:12.474742 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.474507    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:27:12.474742 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.474515    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f03af58-f3cf-4c6e-8717-d159b47a6761-trusted-ca-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:27:12.474742 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.474523    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f03af58-f3cf-4c6e-8717-d159b47a6761-console-serving-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:27:12.731636 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.731544    2568 generic.go:356] "Generic (PLEG): container finished" podID="1f03af58-f3cf-4c6e-8717-d159b47a6761" containerID="b6cabc3af806a246375e284bb209bb2aeee9b189957e58ad597deabe30bef105" exitCode=0
Jul 15 10:27:12.731636 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.731589    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679dc85cbf-fhbh2" event={"ID":"1f03af58-f3cf-4c6e-8717-d159b47a6761","Type":"ContainerDied","Data":"b6cabc3af806a246375e284bb209bb2aeee9b189957e58ad597deabe30bef105"}
Jul 15 10:27:12.731636 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.731628    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679dc85cbf-fhbh2" event={"ID":"1f03af58-f3cf-4c6e-8717-d159b47a6761","Type":"ContainerDied","Data":"0458926277cf1ca39bc703bbeca1749a15b7adbdd8dbe0455b01611020b2cefa"}
Jul 15 10:27:12.731875 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.731648    2568 scope.go:117] "RemoveContainer" containerID="b6cabc3af806a246375e284bb209bb2aeee9b189957e58ad597deabe30bef105"
Jul 15 10:27:12.731875 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.731591    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679dc85cbf-fhbh2"
Jul 15 10:27:12.740907 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.740888    2568 scope.go:117] "RemoveContainer" containerID="b6cabc3af806a246375e284bb209bb2aeee9b189957e58ad597deabe30bef105"
Jul 15 10:27:12.741211 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:27:12.741176    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6cabc3af806a246375e284bb209bb2aeee9b189957e58ad597deabe30bef105\": container with ID starting with b6cabc3af806a246375e284bb209bb2aeee9b189957e58ad597deabe30bef105 not found: ID does not exist" containerID="b6cabc3af806a246375e284bb209bb2aeee9b189957e58ad597deabe30bef105"
Jul 15 10:27:12.741253 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.741219    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6cabc3af806a246375e284bb209bb2aeee9b189957e58ad597deabe30bef105"} err="failed to get container status \"b6cabc3af806a246375e284bb209bb2aeee9b189957e58ad597deabe30bef105\": rpc error: code = NotFound desc = could not find container \"b6cabc3af806a246375e284bb209bb2aeee9b189957e58ad597deabe30bef105\": container with ID starting with b6cabc3af806a246375e284bb209bb2aeee9b189957e58ad597deabe30bef105 not found: ID does not exist"
Jul 15 10:27:12.755373 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.755334    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-679dc85cbf-fhbh2"]
Jul 15 10:27:12.759917 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:12.759892    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-679dc85cbf-fhbh2"]
Jul 15 10:27:13.647384 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:27:13.647346    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f03af58-f3cf-4c6e-8717-d159b47a6761" path="/var/lib/kubelet/pods/1f03af58-f3cf-4c6e-8717-d159b47a6761/volumes"
Jul 15 10:28:13.343076 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343039    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343404    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a33674c4-292d-49e5-a88d-cb1770e8eee2" containerName="util"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343415    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a33674c4-292d-49e5-a88d-cb1770e8eee2" containerName="util"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343428    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a33674c4-292d-49e5-a88d-cb1770e8eee2" containerName="pull"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343433    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a33674c4-292d-49e5-a88d-cb1770e8eee2" containerName="pull"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343441    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ae1dc92-2cdb-49e1-82c7-8b1ada016b41" containerName="extract"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343446    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ae1dc92-2cdb-49e1-82c7-8b1ada016b41" containerName="extract"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343452    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a33674c4-292d-49e5-a88d-cb1770e8eee2" containerName="extract"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343457    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a33674c4-292d-49e5-a88d-cb1770e8eee2" containerName="extract"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343464    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9c96d45-ae54-498f-a174-bb01bcc96a23" containerName="extract"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343469    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9c96d45-ae54-498f-a174-bb01bcc96a23" containerName="extract"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343476    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9c96d45-ae54-498f-a174-bb01bcc96a23" containerName="util"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343483    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9c96d45-ae54-498f-a174-bb01bcc96a23" containerName="util"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343488    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ae1dc92-2cdb-49e1-82c7-8b1ada016b41" containerName="pull"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343493    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ae1dc92-2cdb-49e1-82c7-8b1ada016b41" containerName="pull"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343498    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9c96d45-ae54-498f-a174-bb01bcc96a23" containerName="pull"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343503    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9c96d45-ae54-498f-a174-bb01bcc96a23" containerName="pull"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343508    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d243ec-3643-4e6f-8b0e-b2b2a894c44a" containerName="pull"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343513    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d243ec-3643-4e6f-8b0e-b2b2a894c44a" containerName="pull"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343519    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f03af58-f3cf-4c6e-8717-d159b47a6761" containerName="console"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343524    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f03af58-f3cf-4c6e-8717-d159b47a6761" containerName="console"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343531    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d243ec-3643-4e6f-8b0e-b2b2a894c44a" containerName="extract"
Jul 15 10:28:13.343523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343536    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d243ec-3643-4e6f-8b0e-b2b2a894c44a" containerName="extract"
Jul 15 10:28:13.344220 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343541    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ae1dc92-2cdb-49e1-82c7-8b1ada016b41" containerName="util"
Jul 15 10:28:13.344220 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343546    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ae1dc92-2cdb-49e1-82c7-8b1ada016b41" containerName="util"
Jul 15 10:28:13.344220 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343551    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d243ec-3643-4e6f-8b0e-b2b2a894c44a" containerName="util"
Jul 15 10:28:13.344220 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343555    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d243ec-3643-4e6f-8b0e-b2b2a894c44a" containerName="util"
Jul 15 10:28:13.344220 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343604    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f03af58-f3cf-4c6e-8717-d159b47a6761" containerName="console"
Jul 15 10:28:13.344220 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343614    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="86d243ec-3643-4e6f-8b0e-b2b2a894c44a" containerName="extract"
Jul 15 10:28:13.344220 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343621    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ae1dc92-2cdb-49e1-82c7-8b1ada016b41" containerName="extract"
Jul 15 10:28:13.344220 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343625    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a33674c4-292d-49e5-a88d-cb1770e8eee2" containerName="extract"
Jul 15 10:28:13.344220 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.343630    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9c96d45-ae54-498f-a174-bb01bcc96a23" containerName="extract"
Jul 15 10:28:13.347728 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.347709    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"
Jul 15 10:28:13.350356 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.350328    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z7ndj\""
Jul 15 10:28:13.350513 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.350355    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 10:28:13.350513 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.350355    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 10:28:13.351280 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.351263    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 10:28:13.358492 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.358473    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:28:13.369245 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.369221    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:28:13.441865 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.441827    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3c5b720b-ac89-4c77-8de9-b8502dff3223-config-file\") pod \"limitador-limitador-54d6d988d5-mxbk2\" (UID: \"3c5b720b-ac89-4c77-8de9-b8502dff3223\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"
Jul 15 10:28:13.441865 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.441872    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22k8g\" (UniqueName: \"kubernetes.io/projected/3c5b720b-ac89-4c77-8de9-b8502dff3223-kube-api-access-22k8g\") pod \"limitador-limitador-54d6d988d5-mxbk2\" (UID: \"3c5b720b-ac89-4c77-8de9-b8502dff3223\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"
Jul 15 10:28:13.543208 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.543166    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3c5b720b-ac89-4c77-8de9-b8502dff3223-config-file\") pod \"limitador-limitador-54d6d988d5-mxbk2\" (UID: \"3c5b720b-ac89-4c77-8de9-b8502dff3223\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"
Jul 15 10:28:13.543377 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.543226    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22k8g\" (UniqueName: \"kubernetes.io/projected/3c5b720b-ac89-4c77-8de9-b8502dff3223-kube-api-access-22k8g\") pod \"limitador-limitador-54d6d988d5-mxbk2\" (UID: \"3c5b720b-ac89-4c77-8de9-b8502dff3223\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"
Jul 15 10:28:13.543804 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.543784    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3c5b720b-ac89-4c77-8de9-b8502dff3223-config-file\") pod \"limitador-limitador-54d6d988d5-mxbk2\" (UID: \"3c5b720b-ac89-4c77-8de9-b8502dff3223\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"
Jul 15 10:28:13.553687 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.553661    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22k8g\" (UniqueName: \"kubernetes.io/projected/3c5b720b-ac89-4c77-8de9-b8502dff3223-kube-api-access-22k8g\") pod \"limitador-limitador-54d6d988d5-mxbk2\" (UID: \"3c5b720b-ac89-4c77-8de9-b8502dff3223\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"
Jul 15 10:28:13.659963 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.659870    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"
Jul 15 10:28:13.799731 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:13.799707    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:28:13.801466 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:28:13.801435    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c5b720b_ac89_4c77_8de9_b8502dff3223.slice/crio-4dcdfba4cb9e45bdf9f03162e41bd1d0ff0c3802b07534f81c3379c5bdbf8929 WatchSource:0}: Error finding container 4dcdfba4cb9e45bdf9f03162e41bd1d0ff0c3802b07534f81c3379c5bdbf8929: Status 404 returned error can't find the container with id 4dcdfba4cb9e45bdf9f03162e41bd1d0ff0c3802b07534f81c3379c5bdbf8929
Jul 15 10:28:14.036393 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:14.036355    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mxbk2" event={"ID":"3c5b720b-ac89-4c77-8de9-b8502dff3223","Type":"ContainerStarted","Data":"4dcdfba4cb9e45bdf9f03162e41bd1d0ff0c3802b07534f81c3379c5bdbf8929"}
Jul 15 10:28:17.055183 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:17.055146    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mxbk2" event={"ID":"3c5b720b-ac89-4c77-8de9-b8502dff3223","Type":"ContainerStarted","Data":"6bea5fc7787368badf075737fe0e75d3b3a7291af6c73725bdf78dd07178d0bd"}
Jul 15 10:28:17.055562 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:17.055253    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"
Jul 15 10:28:17.078657 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:17.078581    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-mxbk2" podStartSLOduration=1.22656704 podStartE2EDuration="4.078563268s" totalImagesPullingTime="2.851996228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:28:17.076843373 +0000 UTC m=+495.896485246" watchObservedRunningTime="2026-07-15 10:28:17.078563268 +0000 UTC m=+495.898205139"
Jul 15 10:28:28.061189 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:28:28.061158    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"
Jul 15 10:29:27.238704 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:29:27.238663    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:29:46.587887 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:29:46.587849    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:30:01.541066 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:30:01.541036    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:30:01.543104 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:30:01.543074    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:30:04.301701 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:30:04.301665    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:30:15.889686 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:30:15.889551    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:30:27.391946 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:30:27.391863    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:30:36.097667 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:30:36.097633    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:30:45.195076 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:30:45.195039    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:32:35.609418 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:32:35.609376    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:32:45.593826 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:32:45.593785    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:32:55.591263 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:32:55.591219    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:33:04.996071 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:33:04.996030    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:33:15.299800 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:33:15.299739    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:33:42.005136 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:33:42.005037    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:33:53.593762 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:33:53.593729    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:34:30.791615 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:34:30.791581    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:34:41.590133 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:34:41.590081    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:34:51.702450 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:34:51.702407    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:34:57.997921 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:34:57.997838    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:35:01.574001 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:35:01.573970    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:35:01.574477 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:35:01.574421    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:35:07.902601 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:35:07.902562    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:35:17.114460 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:35:17.114422    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:35:29.096716 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:35:29.096678    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:35:39.206708 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:35:39.206673    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:36:04.402378 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:36:04.402325    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:36:14.590236 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:36:14.590197    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:36:39.924345 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:36:39.924259    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:36:49.694705 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:36:49.694663    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:37:05.098359 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:37:05.098320    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:37:16.006268 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:37:16.006234    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:37:25.599068 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:37:25.599030    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:37:35.493434 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:37:35.493398    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:37:44.298169 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:37:44.298131    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:39:33.096252 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:39:33.096177    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:39:42.101535 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:39:42.101498    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:39:53.500493 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:39:53.500460    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:40:01.603550 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:40:01.603524    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:40:01.604300 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:40:01.604273    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:40:06.910746 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:40:06.910716    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:40:16.734831 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:40:16.734802    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:40:25.695425 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:40:25.695385    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:40:35.421257 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:40:35.421223    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:40:46.199252 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:40:46.199212    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:40:57.701348 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:40:57.701271    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:41:06.404312 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:41:06.404279    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:41:16.703370 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:41:16.700708    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:41:38.810787 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:41:38.810754    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:41:47.900556 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:41:47.900520    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:41:59.397502 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:41:59.397468    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:42:11.392655 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:42:11.392623    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:42:26.806638 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:42:26.806562    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:42:37.605435 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:42:37.605394    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:42:46.596478 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:42:46.596443    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:42:57.148535 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:42:57.148499    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:43:06.011754 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:43:06.011720    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:43:15.200460 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:43:15.200424    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:43:29.190604 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:43:29.190569    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:43:37.907273 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:43:37.907241    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:43:47.410389 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:43:47.410349    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:43:58.288977 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:43:58.288900    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:44:11.286250 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:44:11.286211    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:44:20.197392 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:44:20.197359    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:44:31.284623 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:44:31.284585    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:44:45.387840 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:44:45.387805    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:44:54.398125 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:44:54.398072    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:45:00.165902 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:00.165868    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735205-jdsrn"]
Jul 15 10:45:00.168998 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:00.168980    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735205-jdsrn"
Jul 15 10:45:00.173978 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:00.173958    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zj826\""
Jul 15 10:45:00.178133 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:00.178095    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735205-jdsrn"
Jul 15 10:45:00.261888 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:00.261844    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735205-jdsrn"]
Jul 15 10:45:00.511066 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:00.511036    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735205-jdsrn"]
Jul 15 10:45:00.514328 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:45:00.514304    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f74ea10_a4d3_4ab5_a950_06ad44e21c8f.slice/crio-a64f7a79b3597add8998593d52a23067a28cf556973a64f84a386d2024f8dd7b WatchSource:0}: Error finding container a64f7a79b3597add8998593d52a23067a28cf556973a64f84a386d2024f8dd7b: Status 404 returned error can't find the container with id a64f7a79b3597add8998593d52a23067a28cf556973a64f84a386d2024f8dd7b
Jul 15 10:45:00.516521 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:00.516502    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 10:45:00.896296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:00.896261    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735205-jdsrn" event={"ID":"9f74ea10-a4d3-4ab5-a950-06ad44e21c8f","Type":"ContainerStarted","Data":"a64f7a79b3597add8998593d52a23067a28cf556973a64f84a386d2024f8dd7b"}
Jul 15 10:45:01.638120 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:01.638088    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:45:01.639818 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:01.639794    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:45:03.912018 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:03.911985    2568 generic.go:356] "Generic (PLEG): container finished" podID="9f74ea10-a4d3-4ab5-a950-06ad44e21c8f" containerID="92211e698f1d072c9ccc290fd6eca6e454b37f17aca684b9a1918437e6594453" exitCode=0
Jul 15 10:45:03.912355 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:03.912057    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735205-jdsrn" event={"ID":"9f74ea10-a4d3-4ab5-a950-06ad44e21c8f","Type":"ContainerDied","Data":"92211e698f1d072c9ccc290fd6eca6e454b37f17aca684b9a1918437e6594453"}
Jul 15 10:45:05.042051 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:05.042029    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735205-jdsrn"
Jul 15 10:45:05.922089 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:05.921999    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735205-jdsrn" event={"ID":"9f74ea10-a4d3-4ab5-a950-06ad44e21c8f","Type":"ContainerDied","Data":"a64f7a79b3597add8998593d52a23067a28cf556973a64f84a386d2024f8dd7b"}
Jul 15 10:45:05.922089 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:05.922043    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a64f7a79b3597add8998593d52a23067a28cf556973a64f84a386d2024f8dd7b"
Jul 15 10:45:05.922089 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:05.922059    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735205-jdsrn"
Jul 15 10:45:07.859318 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:07.859280    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"]
Jul 15 10:45:07.859661 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:07.859607    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f74ea10-a4d3-4ab5-a950-06ad44e21c8f" containerName="cleanup"
Jul 15 10:45:07.859661 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:07.859620    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f74ea10-a4d3-4ab5-a950-06ad44e21c8f" containerName="cleanup"
Jul 15 10:45:07.859729 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:07.859671    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f74ea10-a4d3-4ab5-a950-06ad44e21c8f" containerName="cleanup"
Jul 15 10:45:07.862562 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:07.862547    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"
Jul 15 10:45:07.865492 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:07.865472    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 10:45:07.865593 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:07.865501    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zk7pv\""
Jul 15 10:45:07.866504 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:07.866483    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5b874627-serving-cert\""
Jul 15 10:45:07.866556 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:07.866528    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 10:45:07.878664 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:07.878631    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"]
Jul 15 10:45:07.947749 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:07.947725    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20ea925f-7888-494d-bbfe-9b2385a64bd4-maas-api-tls\") pod \"maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt\" (UID: \"20ea925f-7888-494d-bbfe-9b2385a64bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"
Jul 15 10:45:07.947878 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:07.947781    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20ea925f-7888-494d-bbfe-9b2385a64bd4-openshift-service-ca\") pod \"maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt\" (UID: \"20ea925f-7888-494d-bbfe-9b2385a64bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"
Jul 15 10:45:07.947878 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:07.947827    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rpm7\" (UniqueName: \"kubernetes.io/projected/20ea925f-7888-494d-bbfe-9b2385a64bd4-kube-api-access-6rpm7\") pod \"maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt\" (UID: \"20ea925f-7888-494d-bbfe-9b2385a64bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"
Jul 15 10:45:08.048546 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:08.048515    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20ea925f-7888-494d-bbfe-9b2385a64bd4-openshift-service-ca\") pod \"maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt\" (UID: \"20ea925f-7888-494d-bbfe-9b2385a64bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"
Jul 15 10:45:08.048662 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:08.048552    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rpm7\" (UniqueName: \"kubernetes.io/projected/20ea925f-7888-494d-bbfe-9b2385a64bd4-kube-api-access-6rpm7\") pod \"maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt\" (UID: \"20ea925f-7888-494d-bbfe-9b2385a64bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"
Jul 15 10:45:08.048662 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:08.048588    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20ea925f-7888-494d-bbfe-9b2385a64bd4-maas-api-tls\") pod \"maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt\" (UID: \"20ea925f-7888-494d-bbfe-9b2385a64bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"
Jul 15 10:45:08.049264 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:08.049244    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20ea925f-7888-494d-bbfe-9b2385a64bd4-openshift-service-ca\") pod \"maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt\" (UID: \"20ea925f-7888-494d-bbfe-9b2385a64bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"
Jul 15 10:45:08.051075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:08.051054    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20ea925f-7888-494d-bbfe-9b2385a64bd4-maas-api-tls\") pod \"maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt\" (UID: \"20ea925f-7888-494d-bbfe-9b2385a64bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"
Jul 15 10:45:08.068509 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:08.068488    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rpm7\" (UniqueName: \"kubernetes.io/projected/20ea925f-7888-494d-bbfe-9b2385a64bd4-kube-api-access-6rpm7\") pod \"maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt\" (UID: \"20ea925f-7888-494d-bbfe-9b2385a64bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"
Jul 15 10:45:08.173248 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:08.173193    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"
Jul 15 10:45:08.313768 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:08.313744    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"]
Jul 15 10:45:08.316043 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:45:08.316017    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ea925f_7888_494d_bbfe_9b2385a64bd4.slice/crio-ebb95a5b32f972985f9e0c7bb93e38421d0e87a5c02e0d51d7887cc037f0cc49 WatchSource:0}: Error finding container ebb95a5b32f972985f9e0c7bb93e38421d0e87a5c02e0d51d7887cc037f0cc49: Status 404 returned error can't find the container with id ebb95a5b32f972985f9e0c7bb93e38421d0e87a5c02e0d51d7887cc037f0cc49
Jul 15 10:45:08.939056 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:08.939017    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt" event={"ID":"20ea925f-7888-494d-bbfe-9b2385a64bd4","Type":"ContainerStarted","Data":"ebb95a5b32f972985f9e0c7bb93e38421d0e87a5c02e0d51d7887cc037f0cc49"}
Jul 15 10:45:10.191670 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:10.191632    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:45:10.951506 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:10.951468    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt" event={"ID":"20ea925f-7888-494d-bbfe-9b2385a64bd4","Type":"ContainerStarted","Data":"44be3b515cb394fc4fca7e195b4bf809360869b61515af1191684f34e7af1b11"}
Jul 15 10:45:10.951693 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:10.951575    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"
Jul 15 10:45:10.972197 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:10.972155    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt" podStartSLOduration=1.839007152 podStartE2EDuration="3.972140203s" totalImagesPullingTime="2.133133051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:45:10.970273533 +0000 UTC m=+1509.789915417" watchObservedRunningTime="2026-07-15 10:45:10.972140203 +0000 UTC m=+1509.791782069"
Jul 15 10:45:12.740125 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:12.740091    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h"]
Jul 15 10:45:12.743431 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:12.743415    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h"
Jul 15 10:45:12.746239 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:12.746218    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zj826\""
Jul 15 10:45:12.755548 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:12.755524    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h"]
Jul 15 10:45:12.888915 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:12.888892    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cca7dc9b-1e6b-4257-817c-783f43efa579-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5b874627-tr87h\" (UID: \"cca7dc9b-1e6b-4257-817c-783f43efa579\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h"
Jul 15 10:45:12.989787 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:12.989762    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cca7dc9b-1e6b-4257-817c-783f43efa579-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5b874627-tr87h\" (UID: \"cca7dc9b-1e6b-4257-817c-783f43efa579\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h"
Jul 15 10:45:12.990342 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:12.990303    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cca7dc9b-1e6b-4257-817c-783f43efa579-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5b874627-tr87h\" (UID: \"cca7dc9b-1e6b-4257-817c-783f43efa579\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h"
Jul 15 10:45:13.052859 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:13.052839    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h"
Jul 15 10:45:13.389557 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:13.389532    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h"]
Jul 15 10:45:13.391227 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:45:13.391201    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca7dc9b_1e6b_4257_817c_783f43efa579.slice/crio-36192e9669ce77c46a8388736a2ddec3d05574ba3849221550a1ba17e39c82f3 WatchSource:0}: Error finding container 36192e9669ce77c46a8388736a2ddec3d05574ba3849221550a1ba17e39c82f3: Status 404 returned error can't find the container with id 36192e9669ce77c46a8388736a2ddec3d05574ba3849221550a1ba17e39c82f3
Jul 15 10:45:13.966261 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:13.966233    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h" event={"ID":"cca7dc9b-1e6b-4257-817c-783f43efa579","Type":"ContainerStarted","Data":"1a8db734d92ae3b9ffd8f25d4e182114825595f46105bdf325b6061884f221f1"}
Jul 15 10:45:13.966566 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:13.966291    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h" event={"ID":"cca7dc9b-1e6b-4257-817c-783f43efa579","Type":"ContainerStarted","Data":"36192e9669ce77c46a8388736a2ddec3d05574ba3849221550a1ba17e39c82f3"}
Jul 15 10:45:13.985489 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:13.985448    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h" podStartSLOduration=1.985431137 podStartE2EDuration="1.985431137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:45:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:45:13.983788025 +0000 UTC m=+1512.803429896" watchObservedRunningTime="2026-07-15 10:45:13.985431137 +0000 UTC m=+1512.805073008"
Jul 15 10:45:14.972919 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:14.972877    2568 generic.go:356] "Generic (PLEG): container finished" podID="cca7dc9b-1e6b-4257-817c-783f43efa579" containerID="1a8db734d92ae3b9ffd8f25d4e182114825595f46105bdf325b6061884f221f1" exitCode=7
Jul 15 10:45:14.972919 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:14.972923    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h" event={"ID":"cca7dc9b-1e6b-4257-817c-783f43efa579","Type":"ContainerDied","Data":"1a8db734d92ae3b9ffd8f25d4e182114825595f46105bdf325b6061884f221f1"}
Jul 15 10:45:14.973382 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:14.973165    2568 scope.go:117] "RemoveContainer" containerID="1a8db734d92ae3b9ffd8f25d4e182114825595f46105bdf325b6061884f221f1"
Jul 15 10:45:15.979449 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:15.979363    2568 generic.go:356] "Generic (PLEG): container finished" podID="cca7dc9b-1e6b-4257-817c-783f43efa579" containerID="f5111fe4e9b73ea3cb7a26a56a03c44ee234f19fe55e488a930100505afb9680" exitCode=7
Jul 15 10:45:15.979449 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:15.979416    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h" event={"ID":"cca7dc9b-1e6b-4257-817c-783f43efa579","Type":"ContainerDied","Data":"f5111fe4e9b73ea3cb7a26a56a03c44ee234f19fe55e488a930100505afb9680"}
Jul 15 10:45:15.979945 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:15.979474    2568 scope.go:117] "RemoveContainer" containerID="1a8db734d92ae3b9ffd8f25d4e182114825595f46105bdf325b6061884f221f1"
Jul 15 10:45:15.979945 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:15.979662    2568 scope.go:117] "RemoveContainer" containerID="f5111fe4e9b73ea3cb7a26a56a03c44ee234f19fe55e488a930100505afb9680"
Jul 15 10:45:15.979945 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:45:15.979872    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-5b874627-tr87h_odh-ai-gateway-infra(cca7dc9b-1e6b-4257-817c-783f43efa579)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h" podUID="cca7dc9b-1e6b-4257-817c-783f43efa579"
Jul 15 10:45:16.961047 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:16.961024    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"
Jul 15 10:45:16.986553 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:16.986525    2568 scope.go:117] "RemoveContainer" containerID="f5111fe4e9b73ea3cb7a26a56a03c44ee234f19fe55e488a930100505afb9680"
Jul 15 10:45:16.986967 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:45:16.986713    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-5b874627-tr87h_odh-ai-gateway-infra(cca7dc9b-1e6b-4257-817c-783f43efa579)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h" podUID="cca7dc9b-1e6b-4257-817c-783f43efa579"
Jul 15 10:45:27.642822 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:27.642744    2568 scope.go:117] "RemoveContainer" containerID="f5111fe4e9b73ea3cb7a26a56a03c44ee234f19fe55e488a930100505afb9680"
Jul 15 10:45:28.040962 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:28.040932    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h" event={"ID":"cca7dc9b-1e6b-4257-817c-783f43efa579","Type":"ContainerStarted","Data":"3f2b92832dca42a8bce8596a917845f538b8a61a3893a6efe9c4d37d29ba4061"}
Jul 15 10:45:29.046992 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:29.046945    2568 generic.go:356] "Generic (PLEG): container finished" podID="cca7dc9b-1e6b-4257-817c-783f43efa579" containerID="3f2b92832dca42a8bce8596a917845f538b8a61a3893a6efe9c4d37d29ba4061" exitCode=0
Jul 15 10:45:29.047464 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:29.047020    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h" event={"ID":"cca7dc9b-1e6b-4257-817c-783f43efa579","Type":"ContainerDied","Data":"3f2b92832dca42a8bce8596a917845f538b8a61a3893a6efe9c4d37d29ba4061"}
Jul 15 10:45:29.047464 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:29.047075    2568 scope.go:117] "RemoveContainer" containerID="f5111fe4e9b73ea3cb7a26a56a03c44ee234f19fe55e488a930100505afb9680"
Jul 15 10:45:29.074050 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:29.074029    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h"]
Jul 15 10:45:30.186793 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:30.186765    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h"
Jul 15 10:45:30.312960 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:30.312879    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cca7dc9b-1e6b-4257-817c-783f43efa579-maas-api-service-ca\") pod \"cca7dc9b-1e6b-4257-817c-783f43efa579\" (UID: \"cca7dc9b-1e6b-4257-817c-783f43efa579\") "
Jul 15 10:45:30.313271 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:30.313249    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cca7dc9b-1e6b-4257-817c-783f43efa579-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cca7dc9b-1e6b-4257-817c-783f43efa579" (UID: "cca7dc9b-1e6b-4257-817c-783f43efa579"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:45:30.413805 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:30.413772    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cca7dc9b-1e6b-4257-817c-783f43efa579-maas-api-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:45:31.059887 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:31.059853    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h" event={"ID":"cca7dc9b-1e6b-4257-817c-783f43efa579","Type":"ContainerDied","Data":"36192e9669ce77c46a8388736a2ddec3d05574ba3849221550a1ba17e39c82f3"}
Jul 15 10:45:31.060085 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:31.059906    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36192e9669ce77c46a8388736a2ddec3d05574ba3849221550a1ba17e39c82f3"
Jul 15 10:45:31.060085 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:31.059861    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h"
Jul 15 10:45:31.097235 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:31.097199    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h"]
Jul 15 10:45:31.100785 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:31.100763    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-tr87h"]
Jul 15 10:45:31.648254 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:45:31.648225    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cca7dc9b-1e6b-4257-817c-783f43efa579" path="/var/lib/kubelet/pods/cca7dc9b-1e6b-4257-817c-783f43efa579/volumes"
Jul 15 10:46:02.805383 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:02.805347    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-t66d9"]
Jul 15 10:46:02.805821 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:02.805642    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cca7dc9b-1e6b-4257-817c-783f43efa579" containerName="revoke-keys"
Jul 15 10:46:02.805821 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:02.805652    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca7dc9b-1e6b-4257-817c-783f43efa579" containerName="revoke-keys"
Jul 15 10:46:02.805821 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:02.805676    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cca7dc9b-1e6b-4257-817c-783f43efa579" containerName="revoke-keys"
Jul 15 10:46:02.805821 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:02.805681    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca7dc9b-1e6b-4257-817c-783f43efa579" containerName="revoke-keys"
Jul 15 10:46:02.805821 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:02.805728    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cca7dc9b-1e6b-4257-817c-783f43efa579" containerName="revoke-keys"
Jul 15 10:46:02.805821 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:02.805738    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cca7dc9b-1e6b-4257-817c-783f43efa579" containerName="revoke-keys"
Jul 15 10:46:02.808766 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:02.808749    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-t66d9"
Jul 15 10:46:02.811424 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:02.811399    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zj826\""
Jul 15 10:46:02.824774 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:02.824741    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-t66d9"]
Jul 15 10:46:02.863282 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:02.863255    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/010eaeba-2545-4d73-9c58-25968fbff877-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5b874627-t66d9\" (UID: \"010eaeba-2545-4d73-9c58-25968fbff877\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-t66d9"
Jul 15 10:46:02.964065 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:02.964037    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/010eaeba-2545-4d73-9c58-25968fbff877-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5b874627-t66d9\" (UID: \"010eaeba-2545-4d73-9c58-25968fbff877\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-t66d9"
Jul 15 10:46:02.964602 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:02.964583    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/010eaeba-2545-4d73-9c58-25968fbff877-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5b874627-t66d9\" (UID: \"010eaeba-2545-4d73-9c58-25968fbff877\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-t66d9"
Jul 15 10:46:03.125535 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:03.125482    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-t66d9"
Jul 15 10:46:03.255541 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:03.255510    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-t66d9"]
Jul 15 10:46:03.256948 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:46:03.256925    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010eaeba_2545_4d73_9c58_25968fbff877.slice/crio-da2ef253a4dd824ae14ab384ddf1d2c867bd87ea2ee3293780ddd7ff95ec641b WatchSource:0}: Error finding container da2ef253a4dd824ae14ab384ddf1d2c867bd87ea2ee3293780ddd7ff95ec641b: Status 404 returned error can't find the container with id da2ef253a4dd824ae14ab384ddf1d2c867bd87ea2ee3293780ddd7ff95ec641b
Jul 15 10:46:04.222418 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:04.222334    2568 generic.go:356] "Generic (PLEG): container finished" podID="010eaeba-2545-4d73-9c58-25968fbff877" containerID="c0073cad5442255f81559aafa7b05067b2a495fa81b992c080786dd3c0b8ace1" exitCode=0
Jul 15 10:46:04.222418 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:04.222387    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-t66d9" event={"ID":"010eaeba-2545-4d73-9c58-25968fbff877","Type":"ContainerDied","Data":"c0073cad5442255f81559aafa7b05067b2a495fa81b992c080786dd3c0b8ace1"}
Jul 15 10:46:04.222792 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:04.222426    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-t66d9" event={"ID":"010eaeba-2545-4d73-9c58-25968fbff877","Type":"ContainerStarted","Data":"da2ef253a4dd824ae14ab384ddf1d2c867bd87ea2ee3293780ddd7ff95ec641b"}
Jul 15 10:46:05.356144 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:05.356105    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-t66d9"
Jul 15 10:46:05.381860 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:05.381833    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/010eaeba-2545-4d73-9c58-25968fbff877-maas-api-service-ca\") pod \"010eaeba-2545-4d73-9c58-25968fbff877\" (UID: \"010eaeba-2545-4d73-9c58-25968fbff877\") "
Jul 15 10:46:05.382168 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:05.382145    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/010eaeba-2545-4d73-9c58-25968fbff877-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "010eaeba-2545-4d73-9c58-25968fbff877" (UID: "010eaeba-2545-4d73-9c58-25968fbff877"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:46:05.482879 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:05.482810    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/010eaeba-2545-4d73-9c58-25968fbff877-maas-api-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:46:06.232602 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:06.232566    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-t66d9" event={"ID":"010eaeba-2545-4d73-9c58-25968fbff877","Type":"ContainerDied","Data":"da2ef253a4dd824ae14ab384ddf1d2c867bd87ea2ee3293780ddd7ff95ec641b"}
Jul 15 10:46:06.232772 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:06.232625    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da2ef253a4dd824ae14ab384ddf1d2c867bd87ea2ee3293780ddd7ff95ec641b"
Jul 15 10:46:06.232772 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:06.232575    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b874627-t66d9"
Jul 15 10:46:13.370090 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:13.370058    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"]
Jul 15 10:46:13.370544 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:13.370277    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt" podUID="20ea925f-7888-494d-bbfe-9b2385a64bd4" containerName="maas-api" containerID="cri-o://44be3b515cb394fc4fca7e195b4bf809360869b61515af1191684f34e7af1b11" gracePeriod=30
Jul 15 10:46:13.609231 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:13.609209    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"
Jul 15 10:46:13.644874 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:13.644811    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rpm7\" (UniqueName: \"kubernetes.io/projected/20ea925f-7888-494d-bbfe-9b2385a64bd4-kube-api-access-6rpm7\") pod \"20ea925f-7888-494d-bbfe-9b2385a64bd4\" (UID: \"20ea925f-7888-494d-bbfe-9b2385a64bd4\") "
Jul 15 10:46:13.644969 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:13.644877    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20ea925f-7888-494d-bbfe-9b2385a64bd4-openshift-service-ca\") pod \"20ea925f-7888-494d-bbfe-9b2385a64bd4\" (UID: \"20ea925f-7888-494d-bbfe-9b2385a64bd4\") "
Jul 15 10:46:13.644969 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:13.644905    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20ea925f-7888-494d-bbfe-9b2385a64bd4-maas-api-tls\") pod \"20ea925f-7888-494d-bbfe-9b2385a64bd4\" (UID: \"20ea925f-7888-494d-bbfe-9b2385a64bd4\") "
Jul 15 10:46:13.645298 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:13.645266    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20ea925f-7888-494d-bbfe-9b2385a64bd4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "20ea925f-7888-494d-bbfe-9b2385a64bd4" (UID: "20ea925f-7888-494d-bbfe-9b2385a64bd4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:46:13.647248 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:13.647223    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20ea925f-7888-494d-bbfe-9b2385a64bd4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "20ea925f-7888-494d-bbfe-9b2385a64bd4" (UID: "20ea925f-7888-494d-bbfe-9b2385a64bd4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:46:13.647422 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:13.647401    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ea925f-7888-494d-bbfe-9b2385a64bd4-kube-api-access-6rpm7" (OuterVolumeSpecName: "kube-api-access-6rpm7") pod "20ea925f-7888-494d-bbfe-9b2385a64bd4" (UID: "20ea925f-7888-494d-bbfe-9b2385a64bd4"). InnerVolumeSpecName "kube-api-access-6rpm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:46:13.745655 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:13.745620    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rpm7\" (UniqueName: \"kubernetes.io/projected/20ea925f-7888-494d-bbfe-9b2385a64bd4-kube-api-access-6rpm7\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:46:13.745655 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:13.745654    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20ea925f-7888-494d-bbfe-9b2385a64bd4-openshift-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:46:13.745655 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:13.745664    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20ea925f-7888-494d-bbfe-9b2385a64bd4-maas-api-tls\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:46:14.276153 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:14.276107    2568 generic.go:356] "Generic (PLEG): container finished" podID="20ea925f-7888-494d-bbfe-9b2385a64bd4" containerID="44be3b515cb394fc4fca7e195b4bf809360869b61515af1191684f34e7af1b11" exitCode=0
Jul 15 10:46:14.276278 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:14.276161    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt" event={"ID":"20ea925f-7888-494d-bbfe-9b2385a64bd4","Type":"ContainerDied","Data":"44be3b515cb394fc4fca7e195b4bf809360869b61515af1191684f34e7af1b11"}
Jul 15 10:46:14.276278 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:14.276166    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"
Jul 15 10:46:14.276278 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:14.276197    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt" event={"ID":"20ea925f-7888-494d-bbfe-9b2385a64bd4","Type":"ContainerDied","Data":"ebb95a5b32f972985f9e0c7bb93e38421d0e87a5c02e0d51d7887cc037f0cc49"}
Jul 15 10:46:14.276278 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:14.276218    2568 scope.go:117] "RemoveContainer" containerID="44be3b515cb394fc4fca7e195b4bf809360869b61515af1191684f34e7af1b11"
Jul 15 10:46:14.284582 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:14.284554    2568 scope.go:117] "RemoveContainer" containerID="44be3b515cb394fc4fca7e195b4bf809360869b61515af1191684f34e7af1b11"
Jul 15 10:46:14.284843 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:46:14.284821    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44be3b515cb394fc4fca7e195b4bf809360869b61515af1191684f34e7af1b11\": container with ID starting with 44be3b515cb394fc4fca7e195b4bf809360869b61515af1191684f34e7af1b11 not found: ID does not exist" containerID="44be3b515cb394fc4fca7e195b4bf809360869b61515af1191684f34e7af1b11"
Jul 15 10:46:14.284926 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:14.284850    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44be3b515cb394fc4fca7e195b4bf809360869b61515af1191684f34e7af1b11"} err="failed to get container status \"44be3b515cb394fc4fca7e195b4bf809360869b61515af1191684f34e7af1b11\": rpc error: code = NotFound desc = could not find container \"44be3b515cb394fc4fca7e195b4bf809360869b61515af1191684f34e7af1b11\": container with ID starting with 44be3b515cb394fc4fca7e195b4bf809360869b61515af1191684f34e7af1b11 not found: ID does not exist"
Jul 15 10:46:14.296404 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:14.296384    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"]
Jul 15 10:46:14.301286 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:14.301268    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b874627-6d5cd6b7d4-pmxxt"]
Jul 15 10:46:15.646607 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:15.646577    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20ea925f-7888-494d-bbfe-9b2385a64bd4" path="/var/lib/kubelet/pods/20ea925f-7888-494d-bbfe-9b2385a64bd4/volumes"
Jul 15 10:46:16.397268 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:16.397234    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:46:30.127881 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.127844    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"]
Jul 15 10:46:30.128256 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.128169    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010eaeba-2545-4d73-9c58-25968fbff877" containerName="revoke-keys"
Jul 15 10:46:30.128256 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.128179    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="010eaeba-2545-4d73-9c58-25968fbff877" containerName="revoke-keys"
Jul 15 10:46:30.128256 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.128190    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20ea925f-7888-494d-bbfe-9b2385a64bd4" containerName="maas-api"
Jul 15 10:46:30.128256 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.128195    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="20ea925f-7888-494d-bbfe-9b2385a64bd4" containerName="maas-api"
Jul 15 10:46:30.128256 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.128203    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cca7dc9b-1e6b-4257-817c-783f43efa579" containerName="revoke-keys"
Jul 15 10:46:30.128256 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.128208    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca7dc9b-1e6b-4257-817c-783f43efa579" containerName="revoke-keys"
Jul 15 10:46:30.128450 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.128261    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="010eaeba-2545-4d73-9c58-25968fbff877" containerName="revoke-keys"
Jul 15 10:46:30.128450 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.128274    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cca7dc9b-1e6b-4257-817c-783f43efa579" containerName="revoke-keys"
Jul 15 10:46:30.128450 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.128283    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="20ea925f-7888-494d-bbfe-9b2385a64bd4" containerName="maas-api"
Jul 15 10:46:30.132476 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.132459    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"
Jul 15 10:46:30.135343 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.135318    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 10:46:30.135755 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.135734    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zk7pv\""
Jul 15 10:46:30.136346 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.136321    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-2b6d2c8d-serving-cert\""
Jul 15 10:46:30.136615 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.136596    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 10:46:30.144081 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.144044    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"]
Jul 15 10:46:30.258197 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.258169    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b409e6e-53db-441d-867d-9a2b5712fce7-openshift-service-ca\") pod \"maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9\" (UID: \"4b409e6e-53db-441d-867d-9a2b5712fce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"
Jul 15 10:46:30.258316 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.258217    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96j69\" (UniqueName: \"kubernetes.io/projected/4b409e6e-53db-441d-867d-9a2b5712fce7-kube-api-access-96j69\") pod \"maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9\" (UID: \"4b409e6e-53db-441d-867d-9a2b5712fce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"
Jul 15 10:46:30.258316 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.258302    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b409e6e-53db-441d-867d-9a2b5712fce7-maas-api-tls\") pod \"maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9\" (UID: \"4b409e6e-53db-441d-867d-9a2b5712fce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"
Jul 15 10:46:30.359253 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.359229    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b409e6e-53db-441d-867d-9a2b5712fce7-maas-api-tls\") pod \"maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9\" (UID: \"4b409e6e-53db-441d-867d-9a2b5712fce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"
Jul 15 10:46:30.359386 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.359269    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b409e6e-53db-441d-867d-9a2b5712fce7-openshift-service-ca\") pod \"maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9\" (UID: \"4b409e6e-53db-441d-867d-9a2b5712fce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"
Jul 15 10:46:30.359386 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.359308    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96j69\" (UniqueName: \"kubernetes.io/projected/4b409e6e-53db-441d-867d-9a2b5712fce7-kube-api-access-96j69\") pod \"maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9\" (UID: \"4b409e6e-53db-441d-867d-9a2b5712fce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"
Jul 15 10:46:30.359979 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.359948    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b409e6e-53db-441d-867d-9a2b5712fce7-openshift-service-ca\") pod \"maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9\" (UID: \"4b409e6e-53db-441d-867d-9a2b5712fce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"
Jul 15 10:46:30.361713 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.361695    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b409e6e-53db-441d-867d-9a2b5712fce7-maas-api-tls\") pod \"maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9\" (UID: \"4b409e6e-53db-441d-867d-9a2b5712fce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"
Jul 15 10:46:30.369057 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.369029    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96j69\" (UniqueName: \"kubernetes.io/projected/4b409e6e-53db-441d-867d-9a2b5712fce7-kube-api-access-96j69\") pod \"maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9\" (UID: \"4b409e6e-53db-441d-867d-9a2b5712fce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"
Jul 15 10:46:30.446902 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.446848    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"
Jul 15 10:46:30.583670 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:30.583643    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"]
Jul 15 10:46:30.584652 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:46:30.584625    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b409e6e_53db_441d_867d_9a2b5712fce7.slice/crio-b942cacd2cb482a2fb10adb4808e5537c2d0a667518996d5ed5ad366733e5301 WatchSource:0}: Error finding container b942cacd2cb482a2fb10adb4808e5537c2d0a667518996d5ed5ad366733e5301: Status 404 returned error can't find the container with id b942cacd2cb482a2fb10adb4808e5537c2d0a667518996d5ed5ad366733e5301
Jul 15 10:46:31.369540 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:31.369458    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9" event={"ID":"4b409e6e-53db-441d-867d-9a2b5712fce7","Type":"ContainerStarted","Data":"2a9957523f15cf2903e87b261b6701b48129b86323f8d867935c5d6898856bda"}
Jul 15 10:46:31.369540 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:31.369518    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9" event={"ID":"4b409e6e-53db-441d-867d-9a2b5712fce7","Type":"ContainerStarted","Data":"b942cacd2cb482a2fb10adb4808e5537c2d0a667518996d5ed5ad366733e5301"}
Jul 15 10:46:31.369936 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:31.369576    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"
Jul 15 10:46:31.391501 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:31.391454    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9" podStartSLOduration=0.915395542 podStartE2EDuration="1.391440956s" totalImagesPullingTime="476.045414ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:46:31.390339235 +0000 UTC m=+1590.209981107" watchObservedRunningTime="2026-07-15 10:46:31.391440956 +0000 UTC m=+1590.211082835"
Jul 15 10:46:32.094894 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:32.094864    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:46:34.521091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:34.521060    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4"]
Jul 15 10:46:34.524436 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:34.524420    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4"
Jul 15 10:46:34.526998 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:34.526956    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zj826\""
Jul 15 10:46:34.532710 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:34.532687    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4"]
Jul 15 10:46:34.593697 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:34.593671    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c22574-835c-4b45-b795-03688e345c5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4\" (UID: \"90c22574-835c-4b45-b795-03688e345c5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4"
Jul 15 10:46:34.694648 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:34.694614    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c22574-835c-4b45-b795-03688e345c5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4\" (UID: \"90c22574-835c-4b45-b795-03688e345c5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4"
Jul 15 10:46:34.695205 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:34.695189    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c22574-835c-4b45-b795-03688e345c5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4\" (UID: \"90c22574-835c-4b45-b795-03688e345c5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4"
Jul 15 10:46:34.836481 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:34.836434    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4"
Jul 15 10:46:34.967743 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:34.967718    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4"]
Jul 15 10:46:34.969443 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:46:34.969414    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c22574_835c_4b45_b795_03688e345c5a.slice/crio-00085260e37266a8c3e10bee9e52795fbd251469228a87921a0d449261ccca43 WatchSource:0}: Error finding container 00085260e37266a8c3e10bee9e52795fbd251469228a87921a0d449261ccca43: Status 404 returned error can't find the container with id 00085260e37266a8c3e10bee9e52795fbd251469228a87921a0d449261ccca43
Jul 15 10:46:35.389761 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:35.389730    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4" event={"ID":"90c22574-835c-4b45-b795-03688e345c5a","Type":"ContainerStarted","Data":"7e031d976fc89bb11b5751d86e0956e03628d6f1c39c7999137c67b564c98449"}
Jul 15 10:46:35.389896 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:35.389800    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4" event={"ID":"90c22574-835c-4b45-b795-03688e345c5a","Type":"ContainerStarted","Data":"00085260e37266a8c3e10bee9e52795fbd251469228a87921a0d449261ccca43"}
Jul 15 10:46:35.407189 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:35.407145    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4" podStartSLOduration=1.407127151 podStartE2EDuration="1.407127151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:46:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:46:35.406216938 +0000 UTC m=+1594.225858811" watchObservedRunningTime="2026-07-15 10:46:35.407127151 +0000 UTC m=+1594.226769020"
Jul 15 10:46:36.397243 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:36.397211    2568 generic.go:356] "Generic (PLEG): container finished" podID="90c22574-835c-4b45-b795-03688e345c5a" containerID="7e031d976fc89bb11b5751d86e0956e03628d6f1c39c7999137c67b564c98449" exitCode=7
Jul 15 10:46:36.397589 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:36.397298    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4" event={"ID":"90c22574-835c-4b45-b795-03688e345c5a","Type":"ContainerDied","Data":"7e031d976fc89bb11b5751d86e0956e03628d6f1c39c7999137c67b564c98449"}
Jul 15 10:46:36.397589 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:36.397418    2568 scope.go:117] "RemoveContainer" containerID="7e031d976fc89bb11b5751d86e0956e03628d6f1c39c7999137c67b564c98449"
Jul 15 10:46:37.379745 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:37.379714    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"
Jul 15 10:46:37.404256 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:37.404227    2568 generic.go:356] "Generic (PLEG): container finished" podID="90c22574-835c-4b45-b795-03688e345c5a" containerID="56090b235a8367291819f937c9fc7ed4754c41123aa0497534f7628be41f8275" exitCode=7
Jul 15 10:46:37.404691 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:37.404310    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4" event={"ID":"90c22574-835c-4b45-b795-03688e345c5a","Type":"ContainerDied","Data":"56090b235a8367291819f937c9fc7ed4754c41123aa0497534f7628be41f8275"}
Jul 15 10:46:37.404691 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:37.404360    2568 scope.go:117] "RemoveContainer" containerID="7e031d976fc89bb11b5751d86e0956e03628d6f1c39c7999137c67b564c98449"
Jul 15 10:46:37.404691 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:37.404472    2568 scope.go:117] "RemoveContainer" containerID="56090b235a8367291819f937c9fc7ed4754c41123aa0497534f7628be41f8275"
Jul 15 10:46:37.404691 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:46:37.404655    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4_odh-ai-gateway-infra(90c22574-835c-4b45-b795-03688e345c5a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4" podUID="90c22574-835c-4b45-b795-03688e345c5a"
Jul 15 10:46:38.410904 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:38.410877    2568 scope.go:117] "RemoveContainer" containerID="56090b235a8367291819f937c9fc7ed4754c41123aa0497534f7628be41f8275"
Jul 15 10:46:38.411424 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:46:38.411155    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4_odh-ai-gateway-infra(90c22574-835c-4b45-b795-03688e345c5a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4" podUID="90c22574-835c-4b45-b795-03688e345c5a"
Jul 15 10:46:53.642835 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:53.642744    2568 scope.go:117] "RemoveContainer" containerID="56090b235a8367291819f937c9fc7ed4754c41123aa0497534f7628be41f8275"
Jul 15 10:46:54.500232 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:54.500198    2568 generic.go:356] "Generic (PLEG): container finished" podID="90c22574-835c-4b45-b795-03688e345c5a" containerID="e6c244595ba44818df61de9b4c6a57c4cca8f17e96852d505336b6dfc83df89e" exitCode=0
Jul 15 10:46:54.500348 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:54.500263    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4" event={"ID":"90c22574-835c-4b45-b795-03688e345c5a","Type":"ContainerDied","Data":"e6c244595ba44818df61de9b4c6a57c4cca8f17e96852d505336b6dfc83df89e"}
Jul 15 10:46:54.500348 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:54.500322    2568 scope.go:117] "RemoveContainer" containerID="56090b235a8367291819f937c9fc7ed4754c41123aa0497534f7628be41f8275"
Jul 15 10:46:55.532858 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:55.532826    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4"]
Jul 15 10:46:55.651705 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:55.651677    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4"
Jul 15 10:46:55.754881 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:55.754853    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c22574-835c-4b45-b795-03688e345c5a-maas-api-service-ca\") pod \"90c22574-835c-4b45-b795-03688e345c5a\" (UID: \"90c22574-835c-4b45-b795-03688e345c5a\") "
Jul 15 10:46:55.755246 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:55.755224    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90c22574-835c-4b45-b795-03688e345c5a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "90c22574-835c-4b45-b795-03688e345c5a" (UID: "90c22574-835c-4b45-b795-03688e345c5a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:46:55.855696 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:55.855647    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c22574-835c-4b45-b795-03688e345c5a-maas-api-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:46:56.514180 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:56.514146    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4" event={"ID":"90c22574-835c-4b45-b795-03688e345c5a","Type":"ContainerDied","Data":"00085260e37266a8c3e10bee9e52795fbd251469228a87921a0d449261ccca43"}
Jul 15 10:46:56.514180 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:56.514160    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4"
Jul 15 10:46:56.514356 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:56.514191    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00085260e37266a8c3e10bee9e52795fbd251469228a87921a0d449261ccca43"
Jul 15 10:46:56.548403 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:56.548378    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4"]
Jul 15 10:46:56.553931 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:56.553910    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-jlpr4"]
Jul 15 10:46:57.647469 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:46:57.647441    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90c22574-835c-4b45-b795-03688e345c5a" path="/var/lib/kubelet/pods/90c22574-835c-4b45-b795-03688e345c5a/volumes"
Jul 15 10:47:34.594519 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:34.594485    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q"]
Jul 15 10:47:34.594936 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:34.594782    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c22574-835c-4b45-b795-03688e345c5a" containerName="revoke-keys"
Jul 15 10:47:34.594936 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:34.594792    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c22574-835c-4b45-b795-03688e345c5a" containerName="revoke-keys"
Jul 15 10:47:34.594936 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:34.594804    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c22574-835c-4b45-b795-03688e345c5a" containerName="revoke-keys"
Jul 15 10:47:34.594936 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:34.594809    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c22574-835c-4b45-b795-03688e345c5a" containerName="revoke-keys"
Jul 15 10:47:34.594936 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:34.594822    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c22574-835c-4b45-b795-03688e345c5a" containerName="revoke-keys"
Jul 15 10:47:34.594936 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:34.594827    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c22574-835c-4b45-b795-03688e345c5a" containerName="revoke-keys"
Jul 15 10:47:34.594936 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:34.594879    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="90c22574-835c-4b45-b795-03688e345c5a" containerName="revoke-keys"
Jul 15 10:47:34.594936 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:34.594887    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="90c22574-835c-4b45-b795-03688e345c5a" containerName="revoke-keys"
Jul 15 10:47:34.594936 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:34.594893    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="90c22574-835c-4b45-b795-03688e345c5a" containerName="revoke-keys"
Jul 15 10:47:34.597723 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:34.597707    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q"
Jul 15 10:47:34.600358 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:34.600338    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zj826\""
Jul 15 10:47:34.607754 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:34.607734    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q"]
Jul 15 10:47:34.635329 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:34.635296    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c47d889c-cbc9-4132-aa51-bbfecbfa7bbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q\" (UID: \"c47d889c-cbc9-4132-aa51-bbfecbfa7bbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q"
Jul 15 10:47:34.736254 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:34.736227    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c47d889c-cbc9-4132-aa51-bbfecbfa7bbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q\" (UID: \"c47d889c-cbc9-4132-aa51-bbfecbfa7bbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q"
Jul 15 10:47:34.736959 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:34.736926    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c47d889c-cbc9-4132-aa51-bbfecbfa7bbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q\" (UID: \"c47d889c-cbc9-4132-aa51-bbfecbfa7bbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q"
Jul 15 10:47:34.908759 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:34.908698    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q"
Jul 15 10:47:35.039299 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:35.039275    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q"]
Jul 15 10:47:35.040810 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:47:35.040785    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc47d889c_cbc9_4132_aa51_bbfecbfa7bbf.slice/crio-b9af1a1ca9cc34ef9664364519db05c017054165a61094dfa703f50ea10cbb5b WatchSource:0}: Error finding container b9af1a1ca9cc34ef9664364519db05c017054165a61094dfa703f50ea10cbb5b: Status 404 returned error can't find the container with id b9af1a1ca9cc34ef9664364519db05c017054165a61094dfa703f50ea10cbb5b
Jul 15 10:47:35.706988 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:35.706878    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q" event={"ID":"c47d889c-cbc9-4132-aa51-bbfecbfa7bbf","Type":"ContainerStarted","Data":"f3978f54ff6443a5eba311980c06673361717ef185337b9edeeca1e9998d6a4a"}
Jul 15 10:47:35.706988 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:35.706934    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q" event={"ID":"c47d889c-cbc9-4132-aa51-bbfecbfa7bbf","Type":"ContainerStarted","Data":"b9af1a1ca9cc34ef9664364519db05c017054165a61094dfa703f50ea10cbb5b"}
Jul 15 10:47:36.714457 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:36.714424    2568 generic.go:356] "Generic (PLEG): container finished" podID="c47d889c-cbc9-4132-aa51-bbfecbfa7bbf" containerID="f3978f54ff6443a5eba311980c06673361717ef185337b9edeeca1e9998d6a4a" exitCode=0
Jul 15 10:47:36.714830 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:36.714499    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q" event={"ID":"c47d889c-cbc9-4132-aa51-bbfecbfa7bbf","Type":"ContainerDied","Data":"f3978f54ff6443a5eba311980c06673361717ef185337b9edeeca1e9998d6a4a"}
Jul 15 10:47:37.420611 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:37.420579    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:47:37.848157 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:37.848135    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q"
Jul 15 10:47:37.964029 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:37.964005    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c47d889c-cbc9-4132-aa51-bbfecbfa7bbf-maas-api-service-ca\") pod \"c47d889c-cbc9-4132-aa51-bbfecbfa7bbf\" (UID: \"c47d889c-cbc9-4132-aa51-bbfecbfa7bbf\") "
Jul 15 10:47:37.964353 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:37.964333    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c47d889c-cbc9-4132-aa51-bbfecbfa7bbf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c47d889c-cbc9-4132-aa51-bbfecbfa7bbf" (UID: "c47d889c-cbc9-4132-aa51-bbfecbfa7bbf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:47:38.064603 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:38.064579    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c47d889c-cbc9-4132-aa51-bbfecbfa7bbf-maas-api-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:47:38.725753 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:38.725720    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q"
Jul 15 10:47:38.725753 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:38.725737    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q" event={"ID":"c47d889c-cbc9-4132-aa51-bbfecbfa7bbf","Type":"ContainerDied","Data":"b9af1a1ca9cc34ef9664364519db05c017054165a61094dfa703f50ea10cbb5b"}
Jul 15 10:47:38.725958 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:38.725783    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9af1a1ca9cc34ef9664364519db05c017054165a61094dfa703f50ea10cbb5b"
Jul 15 10:47:41.199518 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.199489    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"]
Jul 15 10:47:41.199874 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.199721    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9" podUID="4b409e6e-53db-441d-867d-9a2b5712fce7" containerName="maas-api" containerID="cri-o://2a9957523f15cf2903e87b261b6701b48129b86323f8d867935c5d6898856bda" gracePeriod=30
Jul 15 10:47:41.444966 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.444942    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"
Jul 15 10:47:41.494427 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.494397    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b409e6e-53db-441d-867d-9a2b5712fce7-openshift-service-ca\") pod \"4b409e6e-53db-441d-867d-9a2b5712fce7\" (UID: \"4b409e6e-53db-441d-867d-9a2b5712fce7\") "
Jul 15 10:47:41.494561 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.494499    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b409e6e-53db-441d-867d-9a2b5712fce7-maas-api-tls\") pod \"4b409e6e-53db-441d-867d-9a2b5712fce7\" (UID: \"4b409e6e-53db-441d-867d-9a2b5712fce7\") "
Jul 15 10:47:41.494600 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.494587    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96j69\" (UniqueName: \"kubernetes.io/projected/4b409e6e-53db-441d-867d-9a2b5712fce7-kube-api-access-96j69\") pod \"4b409e6e-53db-441d-867d-9a2b5712fce7\" (UID: \"4b409e6e-53db-441d-867d-9a2b5712fce7\") "
Jul 15 10:47:41.494725 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.494705    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b409e6e-53db-441d-867d-9a2b5712fce7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4b409e6e-53db-441d-867d-9a2b5712fce7" (UID: "4b409e6e-53db-441d-867d-9a2b5712fce7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:47:41.494833 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.494814    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b409e6e-53db-441d-867d-9a2b5712fce7-openshift-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:47:41.496797 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.496775    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b409e6e-53db-441d-867d-9a2b5712fce7-kube-api-access-96j69" (OuterVolumeSpecName: "kube-api-access-96j69") pod "4b409e6e-53db-441d-867d-9a2b5712fce7" (UID: "4b409e6e-53db-441d-867d-9a2b5712fce7"). InnerVolumeSpecName "kube-api-access-96j69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:47:41.496907 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.496877    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b409e6e-53db-441d-867d-9a2b5712fce7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4b409e6e-53db-441d-867d-9a2b5712fce7" (UID: "4b409e6e-53db-441d-867d-9a2b5712fce7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:47:41.595693 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.595654    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b409e6e-53db-441d-867d-9a2b5712fce7-maas-api-tls\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:47:41.595693 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.595686    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96j69\" (UniqueName: \"kubernetes.io/projected/4b409e6e-53db-441d-867d-9a2b5712fce7-kube-api-access-96j69\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:47:41.742255 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.742181    2568 generic.go:356] "Generic (PLEG): container finished" podID="4b409e6e-53db-441d-867d-9a2b5712fce7" containerID="2a9957523f15cf2903e87b261b6701b48129b86323f8d867935c5d6898856bda" exitCode=0
Jul 15 10:47:41.742255 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.742227    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"
Jul 15 10:47:41.742414 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.742269    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9" event={"ID":"4b409e6e-53db-441d-867d-9a2b5712fce7","Type":"ContainerDied","Data":"2a9957523f15cf2903e87b261b6701b48129b86323f8d867935c5d6898856bda"}
Jul 15 10:47:41.742414 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.742319    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9" event={"ID":"4b409e6e-53db-441d-867d-9a2b5712fce7","Type":"ContainerDied","Data":"b942cacd2cb482a2fb10adb4808e5537c2d0a667518996d5ed5ad366733e5301"}
Jul 15 10:47:41.742414 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.742344    2568 scope.go:117] "RemoveContainer" containerID="2a9957523f15cf2903e87b261b6701b48129b86323f8d867935c5d6898856bda"
Jul 15 10:47:41.751122 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.751091    2568 scope.go:117] "RemoveContainer" containerID="2a9957523f15cf2903e87b261b6701b48129b86323f8d867935c5d6898856bda"
Jul 15 10:47:41.751361 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:47:41.751343    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a9957523f15cf2903e87b261b6701b48129b86323f8d867935c5d6898856bda\": container with ID starting with 2a9957523f15cf2903e87b261b6701b48129b86323f8d867935c5d6898856bda not found: ID does not exist" containerID="2a9957523f15cf2903e87b261b6701b48129b86323f8d867935c5d6898856bda"
Jul 15 10:47:41.751415 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.751368    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a9957523f15cf2903e87b261b6701b48129b86323f8d867935c5d6898856bda"} err="failed to get container status \"2a9957523f15cf2903e87b261b6701b48129b86323f8d867935c5d6898856bda\": rpc error: code = NotFound desc = could not find container \"2a9957523f15cf2903e87b261b6701b48129b86323f8d867935c5d6898856bda\": container with ID starting with 2a9957523f15cf2903e87b261b6701b48129b86323f8d867935c5d6898856bda not found: ID does not exist"
Jul 15 10:47:41.770409 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.770385    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"]
Jul 15 10:47:41.774708 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:41.774684    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2b6d2c8d-54fb4cc87f-2cfk9"]
Jul 15 10:47:43.647820 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:43.647783    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b409e6e-53db-441d-867d-9a2b5712fce7" path="/var/lib/kubelet/pods/4b409e6e-53db-441d-867d-9a2b5712fce7/volumes"
Jul 15 10:47:51.052410 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.052373    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"]
Jul 15 10:47:51.052865 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.052823    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b409e6e-53db-441d-867d-9a2b5712fce7" containerName="maas-api"
Jul 15 10:47:51.052865 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.052865    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b409e6e-53db-441d-867d-9a2b5712fce7" containerName="maas-api"
Jul 15 10:47:51.053068 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.052882    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c47d889c-cbc9-4132-aa51-bbfecbfa7bbf" containerName="revoke-keys"
Jul 15 10:47:51.053068 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.052891    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c47d889c-cbc9-4132-aa51-bbfecbfa7bbf" containerName="revoke-keys"
Jul 15 10:47:51.053068 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.052974    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c47d889c-cbc9-4132-aa51-bbfecbfa7bbf" containerName="revoke-keys"
Jul 15 10:47:51.053068 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.052985    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b409e6e-53db-441d-867d-9a2b5712fce7" containerName="maas-api"
Jul 15 10:47:51.057099 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.057083    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"
Jul 15 10:47:51.062286 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.062268    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zk7pv\""
Jul 15 10:47:51.062579 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.062563    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 10:47:51.063445 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.063295    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8452aa9e-serving-cert\""
Jul 15 10:47:51.068716 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.068699    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 10:47:51.073892 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.073872    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"]
Jul 15 10:47:51.161271 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.161247    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd82de93-5352-432e-8e50-403e5e5bd51b-openshift-service-ca\") pod \"maas-api-e2e-ait-8452aa9e-7f97658756-fq697\" (UID: \"dd82de93-5352-432e-8e50-403e5e5bd51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"
Jul 15 10:47:51.161375 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.161322    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd82de93-5352-432e-8e50-403e5e5bd51b-maas-api-tls\") pod \"maas-api-e2e-ait-8452aa9e-7f97658756-fq697\" (UID: \"dd82de93-5352-432e-8e50-403e5e5bd51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"
Jul 15 10:47:51.161375 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.161340    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk9w8\" (UniqueName: \"kubernetes.io/projected/dd82de93-5352-432e-8e50-403e5e5bd51b-kube-api-access-mk9w8\") pod \"maas-api-e2e-ait-8452aa9e-7f97658756-fq697\" (UID: \"dd82de93-5352-432e-8e50-403e5e5bd51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"
Jul 15 10:47:51.261771 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.261747    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd82de93-5352-432e-8e50-403e5e5bd51b-maas-api-tls\") pod \"maas-api-e2e-ait-8452aa9e-7f97658756-fq697\" (UID: \"dd82de93-5352-432e-8e50-403e5e5bd51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"
Jul 15 10:47:51.261869 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.261772    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9w8\" (UniqueName: \"kubernetes.io/projected/dd82de93-5352-432e-8e50-403e5e5bd51b-kube-api-access-mk9w8\") pod \"maas-api-e2e-ait-8452aa9e-7f97658756-fq697\" (UID: \"dd82de93-5352-432e-8e50-403e5e5bd51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"
Jul 15 10:47:51.261869 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.261792    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd82de93-5352-432e-8e50-403e5e5bd51b-openshift-service-ca\") pod \"maas-api-e2e-ait-8452aa9e-7f97658756-fq697\" (UID: \"dd82de93-5352-432e-8e50-403e5e5bd51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"
Jul 15 10:47:51.261936 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:47:51.261904    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-serving-cert: secret "maas-api-e2e-ait-8452aa9e-serving-cert" not found
Jul 15 10:47:51.261995 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:47:51.261983    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd82de93-5352-432e-8e50-403e5e5bd51b-maas-api-tls podName:dd82de93-5352-432e-8e50-403e5e5bd51b nodeName:}" failed. No retries permitted until 2026-07-15 10:47:51.76196411 +0000 UTC m=+1670.581605965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dd82de93-5352-432e-8e50-403e5e5bd51b-maas-api-tls") pod "maas-api-e2e-ait-8452aa9e-7f97658756-fq697" (UID: "dd82de93-5352-432e-8e50-403e5e5bd51b") : secret "maas-api-e2e-ait-8452aa9e-serving-cert" not found
Jul 15 10:47:51.262396 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.262381    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd82de93-5352-432e-8e50-403e5e5bd51b-openshift-service-ca\") pod \"maas-api-e2e-ait-8452aa9e-7f97658756-fq697\" (UID: \"dd82de93-5352-432e-8e50-403e5e5bd51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"
Jul 15 10:47:51.277222 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.277200    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk9w8\" (UniqueName: \"kubernetes.io/projected/dd82de93-5352-432e-8e50-403e5e5bd51b-kube-api-access-mk9w8\") pod \"maas-api-e2e-ait-8452aa9e-7f97658756-fq697\" (UID: \"dd82de93-5352-432e-8e50-403e5e5bd51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"
Jul 15 10:47:51.765172 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.765138    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd82de93-5352-432e-8e50-403e5e5bd51b-maas-api-tls\") pod \"maas-api-e2e-ait-8452aa9e-7f97658756-fq697\" (UID: \"dd82de93-5352-432e-8e50-403e5e5bd51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"
Jul 15 10:47:51.767619 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.767593    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd82de93-5352-432e-8e50-403e5e5bd51b-maas-api-tls\") pod \"maas-api-e2e-ait-8452aa9e-7f97658756-fq697\" (UID: \"dd82de93-5352-432e-8e50-403e5e5bd51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"
Jul 15 10:47:51.967305 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:51.967268    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"
Jul 15 10:47:52.111753 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:52.111730    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"]
Jul 15 10:47:52.113859 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:47:52.113836    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd82de93_5352_432e_8e50_403e5e5bd51b.slice/crio-3d4d4199337bc8f6c6b9dab16ded9d4abfe3706d3a7be7f9784e092a6a19b130 WatchSource:0}: Error finding container 3d4d4199337bc8f6c6b9dab16ded9d4abfe3706d3a7be7f9784e092a6a19b130: Status 404 returned error can't find the container with id 3d4d4199337bc8f6c6b9dab16ded9d4abfe3706d3a7be7f9784e092a6a19b130
Jul 15 10:47:52.799042 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:52.799010    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697" event={"ID":"dd82de93-5352-432e-8e50-403e5e5bd51b","Type":"ContainerStarted","Data":"39a801c254660e5cb506c680b2b909eb55b97343b63e444f9d71c0138af3998b"}
Jul 15 10:47:52.799219 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:52.799062    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697" event={"ID":"dd82de93-5352-432e-8e50-403e5e5bd51b","Type":"ContainerStarted","Data":"3d4d4199337bc8f6c6b9dab16ded9d4abfe3706d3a7be7f9784e092a6a19b130"}
Jul 15 10:47:52.799219 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:52.799081    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"
Jul 15 10:47:52.819404 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:52.819315    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697" podStartSLOduration=1.369931644 podStartE2EDuration="1.819295368s" totalImagesPullingTime="449.363724ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:47:52.818725209 +0000 UTC m=+1671.638367081" watchObservedRunningTime="2026-07-15 10:47:52.819295368 +0000 UTC m=+1671.638937242"
Jul 15 10:47:53.499339 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:53.499303    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:47:56.042693 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:56.042657    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4"]
Jul 15 10:47:56.046180 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:56.046164    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4"
Jul 15 10:47:56.067374 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:56.067354    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zj826\""
Jul 15 10:47:56.076574 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:56.076542    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4"]
Jul 15 10:47:56.200014 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:56.199984    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afa87eed-1246-4928-8a01-60cf3adb4e4a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4\" (UID: \"afa87eed-1246-4928-8a01-60cf3adb4e4a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4"
Jul 15 10:47:56.301327 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:56.301269    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afa87eed-1246-4928-8a01-60cf3adb4e4a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4\" (UID: \"afa87eed-1246-4928-8a01-60cf3adb4e4a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4"
Jul 15 10:47:56.301818 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:56.301800    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afa87eed-1246-4928-8a01-60cf3adb4e4a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4\" (UID: \"afa87eed-1246-4928-8a01-60cf3adb4e4a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4"
Jul 15 10:47:56.355420 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:56.355398    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4"
Jul 15 10:47:56.707641 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:56.707616    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4"]
Jul 15 10:47:56.708523 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:47:56.708497    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa87eed_1246_4928_8a01_60cf3adb4e4a.slice/crio-4b6d30773ba9453e91f24510a3ed7c8ee4f06ac1de62b4d32c166ae4746811bd WatchSource:0}: Error finding container 4b6d30773ba9453e91f24510a3ed7c8ee4f06ac1de62b4d32c166ae4746811bd: Status 404 returned error can't find the container with id 4b6d30773ba9453e91f24510a3ed7c8ee4f06ac1de62b4d32c166ae4746811bd
Jul 15 10:47:56.820312 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:56.820284    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4" event={"ID":"afa87eed-1246-4928-8a01-60cf3adb4e4a","Type":"ContainerStarted","Data":"4b6d30773ba9453e91f24510a3ed7c8ee4f06ac1de62b4d32c166ae4746811bd"}
Jul 15 10:47:57.826597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:57.826567    2568 generic.go:356] "Generic (PLEG): container finished" podID="afa87eed-1246-4928-8a01-60cf3adb4e4a" containerID="7ac9e5277006d7ad7ebff2f90940ea8977d36912b3c402a2fce201612a4c3baf" exitCode=7
Jul 15 10:47:57.826953 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:57.826608    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4" event={"ID":"afa87eed-1246-4928-8a01-60cf3adb4e4a","Type":"ContainerDied","Data":"7ac9e5277006d7ad7ebff2f90940ea8977d36912b3c402a2fce201612a4c3baf"}
Jul 15 10:47:57.826953 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:57.826785    2568 scope.go:117] "RemoveContainer" containerID="7ac9e5277006d7ad7ebff2f90940ea8977d36912b3c402a2fce201612a4c3baf"
Jul 15 10:47:58.808751 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:58.808724    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"
Jul 15 10:47:58.834168 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:58.834146    2568 generic.go:356] "Generic (PLEG): container finished" podID="afa87eed-1246-4928-8a01-60cf3adb4e4a" containerID="b4c9eb07c07df7aa4d7211cb5455d65ce266ffe2ae12eca17c13751745fedcaf" exitCode=7
Jul 15 10:47:58.834543 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:58.834194    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4" event={"ID":"afa87eed-1246-4928-8a01-60cf3adb4e4a","Type":"ContainerDied","Data":"b4c9eb07c07df7aa4d7211cb5455d65ce266ffe2ae12eca17c13751745fedcaf"}
Jul 15 10:47:58.834543 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:58.834243    2568 scope.go:117] "RemoveContainer" containerID="7ac9e5277006d7ad7ebff2f90940ea8977d36912b3c402a2fce201612a4c3baf"
Jul 15 10:47:58.834543 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:58.834405    2568 scope.go:117] "RemoveContainer" containerID="b4c9eb07c07df7aa4d7211cb5455d65ce266ffe2ae12eca17c13751745fedcaf"
Jul 15 10:47:58.834687 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:47:58.834631    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4_odh-ai-gateway-infra(afa87eed-1246-4928-8a01-60cf3adb4e4a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4" podUID="afa87eed-1246-4928-8a01-60cf3adb4e4a"
Jul 15 10:47:59.840899 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:47:59.840874    2568 scope.go:117] "RemoveContainer" containerID="b4c9eb07c07df7aa4d7211cb5455d65ce266ffe2ae12eca17c13751745fedcaf"
Jul 15 10:47:59.841280 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:47:59.841017    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4_odh-ai-gateway-infra(afa87eed-1246-4928-8a01-60cf3adb4e4a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4" podUID="afa87eed-1246-4928-8a01-60cf3adb4e4a"
Jul 15 10:48:14.641682 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:14.641656    2568 scope.go:117] "RemoveContainer" containerID="b4c9eb07c07df7aa4d7211cb5455d65ce266ffe2ae12eca17c13751745fedcaf"
Jul 15 10:48:15.920614 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:15.920585    2568 generic.go:356] "Generic (PLEG): container finished" podID="afa87eed-1246-4928-8a01-60cf3adb4e4a" containerID="36525343a6ec396a0fbd7daae1f80b08ff6c77d5c635af3bc1c8c77544927ddb" exitCode=0
Jul 15 10:48:15.920979 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:15.920632    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4" event={"ID":"afa87eed-1246-4928-8a01-60cf3adb4e4a","Type":"ContainerDied","Data":"36525343a6ec396a0fbd7daae1f80b08ff6c77d5c635af3bc1c8c77544927ddb"}
Jul 15 10:48:15.920979 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:15.920676    2568 scope.go:117] "RemoveContainer" containerID="b4c9eb07c07df7aa4d7211cb5455d65ce266ffe2ae12eca17c13751745fedcaf"
Jul 15 10:48:16.956075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:16.956034    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4"]
Jul 15 10:48:17.063589 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:17.063565    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4"
Jul 15 10:48:17.152370 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:17.152346    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afa87eed-1246-4928-8a01-60cf3adb4e4a-maas-api-service-ca\") pod \"afa87eed-1246-4928-8a01-60cf3adb4e4a\" (UID: \"afa87eed-1246-4928-8a01-60cf3adb4e4a\") "
Jul 15 10:48:17.152658 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:17.152639    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afa87eed-1246-4928-8a01-60cf3adb4e4a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "afa87eed-1246-4928-8a01-60cf3adb4e4a" (UID: "afa87eed-1246-4928-8a01-60cf3adb4e4a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:48:17.253752 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:17.253733    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afa87eed-1246-4928-8a01-60cf3adb4e4a-maas-api-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:48:17.933025 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:17.932951    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4"
Jul 15 10:48:17.933025 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:17.932994    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4" event={"ID":"afa87eed-1246-4928-8a01-60cf3adb4e4a","Type":"ContainerDied","Data":"4b6d30773ba9453e91f24510a3ed7c8ee4f06ac1de62b4d32c166ae4746811bd"}
Jul 15 10:48:17.933218 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:17.933051    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b6d30773ba9453e91f24510a3ed7c8ee4f06ac1de62b4d32c166ae4746811bd"
Jul 15 10:48:17.986507 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:17.986477    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4"]
Jul 15 10:48:17.989766 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:17.989744    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-xs6w4"]
Jul 15 10:48:19.646964 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:19.646919    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afa87eed-1246-4928-8a01-60cf3adb4e4a" path="/var/lib/kubelet/pods/afa87eed-1246-4928-8a01-60cf3adb4e4a/volumes"
Jul 15 10:48:56.119805 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.119730    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m"]
Jul 15 10:48:56.120282 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.120017    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa87eed-1246-4928-8a01-60cf3adb4e4a" containerName="revoke-keys"
Jul 15 10:48:56.120282 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.120027    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa87eed-1246-4928-8a01-60cf3adb4e4a" containerName="revoke-keys"
Jul 15 10:48:56.120282 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.120034    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa87eed-1246-4928-8a01-60cf3adb4e4a" containerName="revoke-keys"
Jul 15 10:48:56.120282 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.120040    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa87eed-1246-4928-8a01-60cf3adb4e4a" containerName="revoke-keys"
Jul 15 10:48:56.120282 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.120053    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa87eed-1246-4928-8a01-60cf3adb4e4a" containerName="revoke-keys"
Jul 15 10:48:56.120282 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.120058    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa87eed-1246-4928-8a01-60cf3adb4e4a" containerName="revoke-keys"
Jul 15 10:48:56.120282 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.120140    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="afa87eed-1246-4928-8a01-60cf3adb4e4a" containerName="revoke-keys"
Jul 15 10:48:56.120282 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.120147    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="afa87eed-1246-4928-8a01-60cf3adb4e4a" containerName="revoke-keys"
Jul 15 10:48:56.120282 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.120152    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="afa87eed-1246-4928-8a01-60cf3adb4e4a" containerName="revoke-keys"
Jul 15 10:48:56.123217 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.123200    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m"
Jul 15 10:48:56.125960 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.125940    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zj826\""
Jul 15 10:48:56.135234 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.135213    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m"]
Jul 15 10:48:56.138733 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.138711    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24b7e037-8848-4f1a-be86-efe2194b129f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m\" (UID: \"24b7e037-8848-4f1a-be86-efe2194b129f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m"
Jul 15 10:48:56.239901 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.239873    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24b7e037-8848-4f1a-be86-efe2194b129f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m\" (UID: \"24b7e037-8848-4f1a-be86-efe2194b129f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m"
Jul 15 10:48:56.240462 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.240443    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24b7e037-8848-4f1a-be86-efe2194b129f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m\" (UID: \"24b7e037-8848-4f1a-be86-efe2194b129f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m"
Jul 15 10:48:56.433163 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.433071    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m"
Jul 15 10:48:56.569459 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:56.569436    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m"]
Jul 15 10:48:56.571983 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:48:56.571950    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b7e037_8848_4f1a_be86_efe2194b129f.slice/crio-e6c8a8cca914826128d0613b8c3de44ea356b7443d2173dbdf9ef697f5c97dbd WatchSource:0}: Error finding container e6c8a8cca914826128d0613b8c3de44ea356b7443d2173dbdf9ef697f5c97dbd: Status 404 returned error can't find the container with id e6c8a8cca914826128d0613b8c3de44ea356b7443d2173dbdf9ef697f5c97dbd
Jul 15 10:48:57.125711 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:57.125612    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m" event={"ID":"24b7e037-8848-4f1a-be86-efe2194b129f","Type":"ContainerStarted","Data":"645965ede8fc0fc8a8ffefa4fb9a7f2f58b1b18fc362b988565c0bc847b99c99"}
Jul 15 10:48:57.125711 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:57.125673    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m" event={"ID":"24b7e037-8848-4f1a-be86-efe2194b129f","Type":"ContainerStarted","Data":"e6c8a8cca914826128d0613b8c3de44ea356b7443d2173dbdf9ef697f5c97dbd"}
Jul 15 10:48:57.150448 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:57.150393    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m" podStartSLOduration=1.150377232 podStartE2EDuration="1.150377232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:57.149545788 +0000 UTC m=+1735.969187682" watchObservedRunningTime="2026-07-15 10:48:57.150377232 +0000 UTC m=+1735.970019103"
Jul 15 10:48:58.132170 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:58.132136    2568 generic.go:356] "Generic (PLEG): container finished" podID="24b7e037-8848-4f1a-be86-efe2194b129f" containerID="645965ede8fc0fc8a8ffefa4fb9a7f2f58b1b18fc362b988565c0bc847b99c99" exitCode=0
Jul 15 10:48:58.132533 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:58.132213    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m" event={"ID":"24b7e037-8848-4f1a-be86-efe2194b129f","Type":"ContainerDied","Data":"645965ede8fc0fc8a8ffefa4fb9a7f2f58b1b18fc362b988565c0bc847b99c99"}
Jul 15 10:48:59.269552 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:59.269528    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m"
Jul 15 10:48:59.363213 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:59.363186    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24b7e037-8848-4f1a-be86-efe2194b129f-maas-api-service-ca\") pod \"24b7e037-8848-4f1a-be86-efe2194b129f\" (UID: \"24b7e037-8848-4f1a-be86-efe2194b129f\") "
Jul 15 10:48:59.363494 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:59.363473    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24b7e037-8848-4f1a-be86-efe2194b129f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "24b7e037-8848-4f1a-be86-efe2194b129f" (UID: "24b7e037-8848-4f1a-be86-efe2194b129f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:48:59.463705 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:48:59.463648    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24b7e037-8848-4f1a-be86-efe2194b129f-maas-api-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:49:00.143318 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:00.143278    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m" event={"ID":"24b7e037-8848-4f1a-be86-efe2194b129f","Type":"ContainerDied","Data":"e6c8a8cca914826128d0613b8c3de44ea356b7443d2173dbdf9ef697f5c97dbd"}
Jul 15 10:49:00.143609 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:00.143330    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6c8a8cca914826128d0613b8c3de44ea356b7443d2173dbdf9ef697f5c97dbd"
Jul 15 10:49:00.143609 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:00.143294    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m"
Jul 15 10:49:06.805610 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:06.805576    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"]
Jul 15 10:49:06.806027 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:06.805774    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697" podUID="dd82de93-5352-432e-8e50-403e5e5bd51b" containerName="maas-api" containerID="cri-o://39a801c254660e5cb506c680b2b909eb55b97343b63e444f9d71c0138af3998b" gracePeriod=30
Jul 15 10:49:07.047158 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.047136    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"
Jul 15 10:49:07.122904 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.122828    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd82de93-5352-432e-8e50-403e5e5bd51b-openshift-service-ca\") pod \"dd82de93-5352-432e-8e50-403e5e5bd51b\" (UID: \"dd82de93-5352-432e-8e50-403e5e5bd51b\") "
Jul 15 10:49:07.122904 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.122862    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk9w8\" (UniqueName: \"kubernetes.io/projected/dd82de93-5352-432e-8e50-403e5e5bd51b-kube-api-access-mk9w8\") pod \"dd82de93-5352-432e-8e50-403e5e5bd51b\" (UID: \"dd82de93-5352-432e-8e50-403e5e5bd51b\") "
Jul 15 10:49:07.123168 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.122941    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd82de93-5352-432e-8e50-403e5e5bd51b-maas-api-tls\") pod \"dd82de93-5352-432e-8e50-403e5e5bd51b\" (UID: \"dd82de93-5352-432e-8e50-403e5e5bd51b\") "
Jul 15 10:49:07.123286 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.123261    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd82de93-5352-432e-8e50-403e5e5bd51b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dd82de93-5352-432e-8e50-403e5e5bd51b" (UID: "dd82de93-5352-432e-8e50-403e5e5bd51b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:49:07.125082 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.125059    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd82de93-5352-432e-8e50-403e5e5bd51b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dd82de93-5352-432e-8e50-403e5e5bd51b" (UID: "dd82de93-5352-432e-8e50-403e5e5bd51b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:49:07.125174 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.125156    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd82de93-5352-432e-8e50-403e5e5bd51b-kube-api-access-mk9w8" (OuterVolumeSpecName: "kube-api-access-mk9w8") pod "dd82de93-5352-432e-8e50-403e5e5bd51b" (UID: "dd82de93-5352-432e-8e50-403e5e5bd51b"). InnerVolumeSpecName "kube-api-access-mk9w8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:49:07.178122 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.178089    2568 generic.go:356] "Generic (PLEG): container finished" podID="dd82de93-5352-432e-8e50-403e5e5bd51b" containerID="39a801c254660e5cb506c680b2b909eb55b97343b63e444f9d71c0138af3998b" exitCode=0
Jul 15 10:49:07.178233 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.178142    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"
Jul 15 10:49:07.178233 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.178151    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697" event={"ID":"dd82de93-5352-432e-8e50-403e5e5bd51b","Type":"ContainerDied","Data":"39a801c254660e5cb506c680b2b909eb55b97343b63e444f9d71c0138af3998b"}
Jul 15 10:49:07.178233 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.178217    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697" event={"ID":"dd82de93-5352-432e-8e50-403e5e5bd51b","Type":"ContainerDied","Data":"3d4d4199337bc8f6c6b9dab16ded9d4abfe3706d3a7be7f9784e092a6a19b130"}
Jul 15 10:49:07.178382 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.178249    2568 scope.go:117] "RemoveContainer" containerID="39a801c254660e5cb506c680b2b909eb55b97343b63e444f9d71c0138af3998b"
Jul 15 10:49:07.186930 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.186914    2568 scope.go:117] "RemoveContainer" containerID="39a801c254660e5cb506c680b2b909eb55b97343b63e444f9d71c0138af3998b"
Jul 15 10:49:07.187233 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:49:07.187215    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39a801c254660e5cb506c680b2b909eb55b97343b63e444f9d71c0138af3998b\": container with ID starting with 39a801c254660e5cb506c680b2b909eb55b97343b63e444f9d71c0138af3998b not found: ID does not exist" containerID="39a801c254660e5cb506c680b2b909eb55b97343b63e444f9d71c0138af3998b"
Jul 15 10:49:07.187330 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.187241    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39a801c254660e5cb506c680b2b909eb55b97343b63e444f9d71c0138af3998b"} err="failed to get container status \"39a801c254660e5cb506c680b2b909eb55b97343b63e444f9d71c0138af3998b\": rpc error: code = NotFound desc = could not find container \"39a801c254660e5cb506c680b2b909eb55b97343b63e444f9d71c0138af3998b\": container with ID starting with 39a801c254660e5cb506c680b2b909eb55b97343b63e444f9d71c0138af3998b not found: ID does not exist"
Jul 15 10:49:07.208233 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.208212    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"]
Jul 15 10:49:07.213223 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.213201    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8452aa9e-7f97658756-fq697"]
Jul 15 10:49:07.224336 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.224311    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd82de93-5352-432e-8e50-403e5e5bd51b-openshift-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:49:07.224336 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.224335    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk9w8\" (UniqueName: \"kubernetes.io/projected/dd82de93-5352-432e-8e50-403e5e5bd51b-kube-api-access-mk9w8\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:49:07.224443 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.224349    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd82de93-5352-432e-8e50-403e5e5bd51b-maas-api-tls\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:49:07.647053 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:07.647015    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd82de93-5352-432e-8e50-403e5e5bd51b" path="/var/lib/kubelet/pods/dd82de93-5352-432e-8e50-403e5e5bd51b/volumes"
Jul 15 10:49:09.626366 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:09.626333    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:49:22.676449 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.676409    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"]
Jul 15 10:49:22.676890 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.676873    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd82de93-5352-432e-8e50-403e5e5bd51b" containerName="maas-api"
Jul 15 10:49:22.676935 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.676895    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd82de93-5352-432e-8e50-403e5e5bd51b" containerName="maas-api"
Jul 15 10:49:22.676935 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.676907    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b7e037-8848-4f1a-be86-efe2194b129f" containerName="revoke-keys"
Jul 15 10:49:22.676935 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.676916    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b7e037-8848-4f1a-be86-efe2194b129f" containerName="revoke-keys"
Jul 15 10:49:22.677027 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.676994    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b7e037-8848-4f1a-be86-efe2194b129f" containerName="revoke-keys"
Jul 15 10:49:22.677027 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.677010    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd82de93-5352-432e-8e50-403e5e5bd51b" containerName="maas-api"
Jul 15 10:49:22.681576 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.681552    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.684335 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.684316    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-73e6f609-openshift-default-dockercfg-r8ppw\""
Jul 15 10:49:22.693944 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.693921    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"]
Jul 15 10:49:22.831136 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.831080    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-token\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.831136 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.831137    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-data\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.831358 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.831168    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-credential-socket\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.831358 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.831183    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istiod-ca-cert\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.831358 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.831252    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-workload-socket\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.831358 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.831279    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-envoy\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.831358 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.831321    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqb99\" (UniqueName: \"kubernetes.io/projected/669c6f23-ff41-4e41-816a-67aa3b7f4d14-kube-api-access-tqb99\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.831358 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.831344    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-workload-certs\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.831358 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.831361    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-podinfo\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.931964 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.931887    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-data\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.931964 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.931941    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-credential-socket\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.931964 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.931958    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istiod-ca-cert\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.932243 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.932070    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-workload-socket\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.932243 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.932144    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-envoy\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.932243 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.932186    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqb99\" (UniqueName: \"kubernetes.io/projected/669c6f23-ff41-4e41-816a-67aa3b7f4d14-kube-api-access-tqb99\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.932243 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.932232    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-workload-certs\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.932417 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.932339    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-podinfo\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.932417 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.932356    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-credential-socket\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.932417 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.932408    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-token\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.932548 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.932444    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-data\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.932548 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.932485    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-workload-socket\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.932656 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.932572    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-workload-certs\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.932730 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.932711    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istiod-ca-cert\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.934384 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.934363    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-envoy\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.934725 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.934705    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-podinfo\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.942425 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.942398    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqb99\" (UniqueName: \"kubernetes.io/projected/669c6f23-ff41-4e41-816a-67aa3b7f4d14-kube-api-access-tqb99\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.942786 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.942766    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-token\") pod \"e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") " pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:22.993567 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:22.993541    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:23.136672 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:23.136643    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"]
Jul 15 10:49:23.138027 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:49:23.138005    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod669c6f23_ff41_4e41_816a_67aa3b7f4d14.slice/crio-bf521661be0f425155a10233188cb2784773eaa8f017e06a0d754135c91909ff WatchSource:0}: Error finding container bf521661be0f425155a10233188cb2784773eaa8f017e06a0d754135c91909ff: Status 404 returned error can't find the container with id bf521661be0f425155a10233188cb2784773eaa8f017e06a0d754135c91909ff
Jul 15 10:49:23.265437 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:23.265409    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl" event={"ID":"669c6f23-ff41-4e41-816a-67aa3b7f4d14","Type":"ContainerStarted","Data":"bf521661be0f425155a10233188cb2784773eaa8f017e06a0d754135c91909ff"}
Jul 15 10:49:23.973939 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:23.973895    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"]
Jul 15 10:49:23.977640 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:23.977614    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"
Jul 15 10:49:23.980695 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:23.980649    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zk7pv\""
Jul 15 10:49:23.980695 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:23.980668    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-73e6f609-serving-cert\""
Jul 15 10:49:23.980888 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:23.980674    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 10:49:23.981788 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:23.981629    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 10:49:23.989038 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:23.989014    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"]
Jul 15 10:49:24.040821 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:24.040793    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwv4w\" (UniqueName: \"kubernetes.io/projected/bcc708dd-1b48-4213-8dc7-2fa372648e17-kube-api-access-qwv4w\") pod \"maas-api-e2e-derive-73e6f609-bb699c758-4v2k5\" (UID: \"bcc708dd-1b48-4213-8dc7-2fa372648e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"
Jul 15 10:49:24.040928 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:24.040893    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcc708dd-1b48-4213-8dc7-2fa372648e17-openshift-service-ca\") pod \"maas-api-e2e-derive-73e6f609-bb699c758-4v2k5\" (UID: \"bcc708dd-1b48-4213-8dc7-2fa372648e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"
Jul 15 10:49:24.040994 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:24.040940    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bcc708dd-1b48-4213-8dc7-2fa372648e17-maas-api-tls\") pod \"maas-api-e2e-derive-73e6f609-bb699c758-4v2k5\" (UID: \"bcc708dd-1b48-4213-8dc7-2fa372648e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"
Jul 15 10:49:24.141959 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:24.141928    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bcc708dd-1b48-4213-8dc7-2fa372648e17-maas-api-tls\") pod \"maas-api-e2e-derive-73e6f609-bb699c758-4v2k5\" (UID: \"bcc708dd-1b48-4213-8dc7-2fa372648e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"
Jul 15 10:49:24.142103 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:24.141988    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwv4w\" (UniqueName: \"kubernetes.io/projected/bcc708dd-1b48-4213-8dc7-2fa372648e17-kube-api-access-qwv4w\") pod \"maas-api-e2e-derive-73e6f609-bb699c758-4v2k5\" (UID: \"bcc708dd-1b48-4213-8dc7-2fa372648e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"
Jul 15 10:49:24.142103 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:49:24.142062    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-serving-cert: secret "maas-api-e2e-derive-73e6f609-serving-cert" not found
Jul 15 10:49:24.142103 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:24.142083    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcc708dd-1b48-4213-8dc7-2fa372648e17-openshift-service-ca\") pod \"maas-api-e2e-derive-73e6f609-bb699c758-4v2k5\" (UID: \"bcc708dd-1b48-4213-8dc7-2fa372648e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"
Jul 15 10:49:24.142305 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:49:24.142146    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc708dd-1b48-4213-8dc7-2fa372648e17-maas-api-tls podName:bcc708dd-1b48-4213-8dc7-2fa372648e17 nodeName:}" failed. No retries permitted until 2026-07-15 10:49:24.642124981 +0000 UTC m=+1763.461766845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bcc708dd-1b48-4213-8dc7-2fa372648e17-maas-api-tls") pod "maas-api-e2e-derive-73e6f609-bb699c758-4v2k5" (UID: "bcc708dd-1b48-4213-8dc7-2fa372648e17") : secret "maas-api-e2e-derive-73e6f609-serving-cert" not found
Jul 15 10:49:24.142811 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:24.142794    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcc708dd-1b48-4213-8dc7-2fa372648e17-openshift-service-ca\") pod \"maas-api-e2e-derive-73e6f609-bb699c758-4v2k5\" (UID: \"bcc708dd-1b48-4213-8dc7-2fa372648e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"
Jul 15 10:49:24.154691 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:24.154668    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwv4w\" (UniqueName: \"kubernetes.io/projected/bcc708dd-1b48-4213-8dc7-2fa372648e17-kube-api-access-qwv4w\") pod \"maas-api-e2e-derive-73e6f609-bb699c758-4v2k5\" (UID: \"bcc708dd-1b48-4213-8dc7-2fa372648e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"
Jul 15 10:49:24.647795 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:24.647756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bcc708dd-1b48-4213-8dc7-2fa372648e17-maas-api-tls\") pod \"maas-api-e2e-derive-73e6f609-bb699c758-4v2k5\" (UID: \"bcc708dd-1b48-4213-8dc7-2fa372648e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"
Jul 15 10:49:24.650508 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:24.650479    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bcc708dd-1b48-4213-8dc7-2fa372648e17-maas-api-tls\") pod \"maas-api-e2e-derive-73e6f609-bb699c758-4v2k5\" (UID: \"bcc708dd-1b48-4213-8dc7-2fa372648e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"
Jul 15 10:49:24.893555 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:24.893518    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"
Jul 15 10:49:25.795059 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:25.795024    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:49:25.795351 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:25.795105    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:49:25.795351 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:25.795176    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:49:25.864499 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:25.864471    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"]
Jul 15 10:49:25.865971 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:49:25.865945    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc708dd_1b48_4213_8dc7_2fa372648e17.slice/crio-ecc5e34aba23d85a5eef6e4b83e14fc97def9e34dc24258f481b915bdc1f58b9 WatchSource:0}: Error finding container ecc5e34aba23d85a5eef6e4b83e14fc97def9e34dc24258f481b915bdc1f58b9: Status 404 returned error can't find the container with id ecc5e34aba23d85a5eef6e4b83e14fc97def9e34dc24258f481b915bdc1f58b9
Jul 15 10:49:26.284332 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:26.284301    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5" event={"ID":"bcc708dd-1b48-4213-8dc7-2fa372648e17","Type":"ContainerStarted","Data":"ecc5e34aba23d85a5eef6e4b83e14fc97def9e34dc24258f481b915bdc1f58b9"}
Jul 15 10:49:26.285897 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:26.285866    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl" event={"ID":"669c6f23-ff41-4e41-816a-67aa3b7f4d14","Type":"ContainerStarted","Data":"13a0a5bee608caccaedf8baaf44243d53a030edf4d7ed7d176144bc626049d38"}
Jul 15 10:49:26.316718 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:26.316667    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl" podStartSLOduration=1.6618725890000001 podStartE2EDuration="4.316650208s" totalImagesPullingTime="2.654777619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:49:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:26.315638196 +0000 UTC m=+1765.135280067" watchObservedRunningTime="2026-07-15 10:49:26.316650208 +0000 UTC m=+1765.136292083"
Jul 15 10:49:26.994358 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:26.994327    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:26.999174 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:26.999151    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:27.292873 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:27.292802    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5" event={"ID":"bcc708dd-1b48-4213-8dc7-2fa372648e17","Type":"ContainerStarted","Data":"63236db72d73dbf2659c4a326a319f3446bcf7dfc8593a371517ac164b81d561"}
Jul 15 10:49:27.293024 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:27.292945    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"
Jul 15 10:49:27.293024 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:27.292977    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:27.293749 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:27.293732    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:27.315678 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:27.315637    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5" podStartSLOduration=3.842445228 podStartE2EDuration="4.315623323s" totalImagesPullingTime="473.178095ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:27.31373585 +0000 UTC m=+1766.133377720" watchObservedRunningTime="2026-07-15 10:49:27.315623323 +0000 UTC m=+1766.135265195"
Jul 15 10:49:28.300370 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:28.300343    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8"]
Jul 15 10:49:28.303789 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:28.303772    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8"
Jul 15 10:49:28.306970 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:28.306945    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zj826\""
Jul 15 10:49:28.316646 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:28.316623    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8"]
Jul 15 10:49:28.382649 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:28.382627    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e833b0-07e4-4ef3-8010-4f8fd05750a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-73e6f609-vhks8\" (UID: \"e8e833b0-07e4-4ef3-8010-4f8fd05750a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8"
Jul 15 10:49:28.483475 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:28.483447    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e833b0-07e4-4ef3-8010-4f8fd05750a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-73e6f609-vhks8\" (UID: \"e8e833b0-07e4-4ef3-8010-4f8fd05750a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8"
Jul 15 10:49:28.484055 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:28.484037    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e833b0-07e4-4ef3-8010-4f8fd05750a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-73e6f609-vhks8\" (UID: \"e8e833b0-07e4-4ef3-8010-4f8fd05750a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8"
Jul 15 10:49:28.612952 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:28.612898    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8"
Jul 15 10:49:28.746359 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:28.746333    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8"]
Jul 15 10:49:28.747401 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:49:28.747375    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e833b0_07e4_4ef3_8010_4f8fd05750a4.slice/crio-bf62276b184b108728de3a87d1ea770878fa2bf143d7dfa6f35e732d28934d5e WatchSource:0}: Error finding container bf62276b184b108728de3a87d1ea770878fa2bf143d7dfa6f35e732d28934d5e: Status 404 returned error can't find the container with id bf62276b184b108728de3a87d1ea770878fa2bf143d7dfa6f35e732d28934d5e
Jul 15 10:49:29.294361 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:29.294331    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:49:29.303804 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:29.303776    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8" event={"ID":"e8e833b0-07e4-4ef3-8010-4f8fd05750a4","Type":"ContainerStarted","Data":"3871b26a4efaad3c4688d668c5cfa8d5c615a55e324a14ba5478f57ddf7e9f84"}
Jul 15 10:49:29.304158 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:29.303823    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8" event={"ID":"e8e833b0-07e4-4ef3-8010-4f8fd05750a4","Type":"ContainerStarted","Data":"bf62276b184b108728de3a87d1ea770878fa2bf143d7dfa6f35e732d28934d5e"}
Jul 15 10:49:29.325963 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:29.325919    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8" podStartSLOduration=1.325905922 podStartE2EDuration="1.325905922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:49:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:29.324050508 +0000 UTC m=+1768.143692379" watchObservedRunningTime="2026-07-15 10:49:29.325905922 +0000 UTC m=+1768.145547793"
Jul 15 10:49:30.310893 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:30.310858    2568 generic.go:356] "Generic (PLEG): container finished" podID="e8e833b0-07e4-4ef3-8010-4f8fd05750a4" containerID="3871b26a4efaad3c4688d668c5cfa8d5c615a55e324a14ba5478f57ddf7e9f84" exitCode=7
Jul 15 10:49:30.311311 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:30.310948    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8" event={"ID":"e8e833b0-07e4-4ef3-8010-4f8fd05750a4","Type":"ContainerDied","Data":"3871b26a4efaad3c4688d668c5cfa8d5c615a55e324a14ba5478f57ddf7e9f84"}
Jul 15 10:49:30.311311 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:30.311128    2568 scope.go:117] "RemoveContainer" containerID="3871b26a4efaad3c4688d668c5cfa8d5c615a55e324a14ba5478f57ddf7e9f84"
Jul 15 10:49:31.317621 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:31.317586    2568 generic.go:356] "Generic (PLEG): container finished" podID="e8e833b0-07e4-4ef3-8010-4f8fd05750a4" containerID="ec3c93a37e5358ea82deea462f0dc144f0ff9f186c9bb30b423b6fabc1f0d748" exitCode=7
Jul 15 10:49:31.317930 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:31.317670    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8" event={"ID":"e8e833b0-07e4-4ef3-8010-4f8fd05750a4","Type":"ContainerDied","Data":"ec3c93a37e5358ea82deea462f0dc144f0ff9f186c9bb30b423b6fabc1f0d748"}
Jul 15 10:49:31.317930 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:31.317726    2568 scope.go:117] "RemoveContainer" containerID="3871b26a4efaad3c4688d668c5cfa8d5c615a55e324a14ba5478f57ddf7e9f84"
Jul 15 10:49:31.318018 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:31.317962    2568 scope.go:117] "RemoveContainer" containerID="ec3c93a37e5358ea82deea462f0dc144f0ff9f186c9bb30b423b6fabc1f0d748"
Jul 15 10:49:31.318203 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:49:31.318184    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-73e6f609-vhks8_odh-ai-gateway-infra(e8e833b0-07e4-4ef3-8010-4f8fd05750a4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8" podUID="e8e833b0-07e4-4ef3-8010-4f8fd05750a4"
Jul 15 10:49:32.324688 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:32.324655    2568 scope.go:117] "RemoveContainer" containerID="ec3c93a37e5358ea82deea462f0dc144f0ff9f186c9bb30b423b6fabc1f0d748"
Jul 15 10:49:32.325148 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:49:32.324892    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-73e6f609-vhks8_odh-ai-gateway-infra(e8e833b0-07e4-4ef3-8010-4f8fd05750a4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8" podUID="e8e833b0-07e4-4ef3-8010-4f8fd05750a4"
Jul 15 10:49:33.304570 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:33.304543    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"
Jul 15 10:49:37.352211 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:37.352156    2568 generic.go:356] "Generic (PLEG): container finished" podID="669c6f23-ff41-4e41-816a-67aa3b7f4d14" containerID="13a0a5bee608caccaedf8baaf44243d53a030edf4d7ed7d176144bc626049d38" exitCode=0
Jul 15 10:49:37.352525 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:37.352234    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl" event={"ID":"669c6f23-ff41-4e41-816a-67aa3b7f4d14","Type":"ContainerDied","Data":"13a0a5bee608caccaedf8baaf44243d53a030edf4d7ed7d176144bc626049d38"}
Jul 15 10:49:37.352586 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:37.352572    2568 scope.go:117] "RemoveContainer" containerID="13a0a5bee608caccaedf8baaf44243d53a030edf4d7ed7d176144bc626049d38"
Jul 15 10:49:37.353503 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:37.353472    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:49:37.353592 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:37.353558    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:49:37.353650 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:37.353605    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:49:38.360854 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:38.360810    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl" event={"ID":"669c6f23-ff41-4e41-816a-67aa3b7f4d14","Type":"ContainerStarted","Data":"ca79e6f39d34bc6385df29f27d208a4abffdfbd77709fab7e234fab07948d598"}
Jul 15 10:49:38.994435 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:38.994401    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:38.995648 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:38.995620    2568 patch_prober.go:28] interesting pod/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 15 10:49:38.995805 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:38.995672    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl" podUID="669c6f23-ff41-4e41-816a-67aa3b7f4d14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 15 10:49:39.994784 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:39.994749    2568 patch_prober.go:28] interesting pod/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 15 10:49:39.995217 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:39.994814    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl" podUID="669c6f23-ff41-4e41-816a-67aa3b7f4d14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 15 10:49:40.994315 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:40.994283    2568 patch_prober.go:28] interesting pod/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 15 10:49:40.994488 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:40.994335    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl" podUID="669c6f23-ff41-4e41-816a-67aa3b7f4d14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 15 10:49:41.994154 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:41.994088    2568 patch_prober.go:28] interesting pod/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 15 10:49:41.994621 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:41.994190    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl" podUID="669c6f23-ff41-4e41-816a-67aa3b7f4d14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 15 10:49:42.293245 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:42.293156    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:42.997654 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:42.997629    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:42.998585 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:42.998563    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:49:47.642350 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:47.642316    2568 scope.go:117] "RemoveContainer" containerID="ec3c93a37e5358ea82deea462f0dc144f0ff9f186c9bb30b423b6fabc1f0d748"
Jul 15 10:49:48.420666 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:48.420638    2568 generic.go:356] "Generic (PLEG): container finished" podID="e8e833b0-07e4-4ef3-8010-4f8fd05750a4" containerID="344357ca642ae2319ea4aeed00c17d6922694505ffa2ff8c66fc1c2d166bfeb3" exitCode=0
Jul 15 10:49:48.420761 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:48.420677    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8" event={"ID":"e8e833b0-07e4-4ef3-8010-4f8fd05750a4","Type":"ContainerDied","Data":"344357ca642ae2319ea4aeed00c17d6922694505ffa2ff8c66fc1c2d166bfeb3"}
Jul 15 10:49:48.420761 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:48.420731    2568 scope.go:117] "RemoveContainer" containerID="ec3c93a37e5358ea82deea462f0dc144f0ff9f186c9bb30b423b6fabc1f0d748"
Jul 15 10:49:49.458526 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:49.458480    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8"]
Jul 15 10:49:49.564203 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:49.564183    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8"
Jul 15 10:49:49.750237 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:49.750218    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e833b0-07e4-4ef3-8010-4f8fd05750a4-maas-api-service-ca\") pod \"e8e833b0-07e4-4ef3-8010-4f8fd05750a4\" (UID: \"e8e833b0-07e4-4ef3-8010-4f8fd05750a4\") "
Jul 15 10:49:49.750532 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:49.750510    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e833b0-07e4-4ef3-8010-4f8fd05750a4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e8e833b0-07e4-4ef3-8010-4f8fd05750a4" (UID: "e8e833b0-07e4-4ef3-8010-4f8fd05750a4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:49:49.851048 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:49.851022    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e833b0-07e4-4ef3-8010-4f8fd05750a4-maas-api-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:49:50.439050 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:50.439019    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8" event={"ID":"e8e833b0-07e4-4ef3-8010-4f8fd05750a4","Type":"ContainerDied","Data":"bf62276b184b108728de3a87d1ea770878fa2bf143d7dfa6f35e732d28934d5e"}
Jul 15 10:49:50.439205 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:50.439088    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf62276b184b108728de3a87d1ea770878fa2bf143d7dfa6f35e732d28934d5e"
Jul 15 10:49:50.439205 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:50.439028    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8"
Jul 15 10:49:50.505788 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:50.505761    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8"]
Jul 15 10:49:50.510417 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:50.510394    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-vhks8"]
Jul 15 10:49:51.646775 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:49:51.646741    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8e833b0-07e4-4ef3-8010-4f8fd05750a4" path="/var/lib/kubelet/pods/e8e833b0-07e4-4ef3-8010-4f8fd05750a4/volumes"
Jul 15 10:50:01.672531 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:01.672502    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:50:01.676723 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:01.676705    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:50:28.368395 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:28.368356    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-mz8ld"]
Jul 15 10:50:28.368876 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:28.368801    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e833b0-07e4-4ef3-8010-4f8fd05750a4" containerName="revoke-keys"
Jul 15 10:50:28.368876 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:28.368820    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e833b0-07e4-4ef3-8010-4f8fd05750a4" containerName="revoke-keys"
Jul 15 10:50:28.368876 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:28.368855    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e833b0-07e4-4ef3-8010-4f8fd05750a4" containerName="revoke-keys"
Jul 15 10:50:28.368876 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:28.368863    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e833b0-07e4-4ef3-8010-4f8fd05750a4" containerName="revoke-keys"
Jul 15 10:50:28.368876 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:28.368873    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e833b0-07e4-4ef3-8010-4f8fd05750a4" containerName="revoke-keys"
Jul 15 10:50:28.369153 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:28.368881    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e833b0-07e4-4ef3-8010-4f8fd05750a4" containerName="revoke-keys"
Jul 15 10:50:28.369153 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:28.368980    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e833b0-07e4-4ef3-8010-4f8fd05750a4" containerName="revoke-keys"
Jul 15 10:50:28.369153 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:28.368991    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e833b0-07e4-4ef3-8010-4f8fd05750a4" containerName="revoke-keys"
Jul 15 10:50:28.372203 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:28.372183    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-mz8ld"
Jul 15 10:50:28.374734 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:28.374713    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zj826\""
Jul 15 10:50:28.384301 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:28.384269    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-mz8ld"]
Jul 15 10:50:28.428499 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:28.428468    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0195ef77-083b-493f-aa52-c315bc600ed7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-73e6f609-mz8ld\" (UID: \"0195ef77-083b-493f-aa52-c315bc600ed7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-mz8ld"
Jul 15 10:50:28.529283 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:28.529258    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0195ef77-083b-493f-aa52-c315bc600ed7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-73e6f609-mz8ld\" (UID: \"0195ef77-083b-493f-aa52-c315bc600ed7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-mz8ld"
Jul 15 10:50:28.529811 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:28.529792    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0195ef77-083b-493f-aa52-c315bc600ed7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-73e6f609-mz8ld\" (UID: \"0195ef77-083b-493f-aa52-c315bc600ed7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-mz8ld"
Jul 15 10:50:28.681896 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:28.681842    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-mz8ld"
Jul 15 10:50:28.829990 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:28.829961    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-mz8ld"]
Jul 15 10:50:28.832063 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:50:28.832037    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0195ef77_083b_493f_aa52_c315bc600ed7.slice/crio-369cc1af87afd035306c0df31f2b6538eb82a3e5cf578a3f0c147f842c480d12 WatchSource:0}: Error finding container 369cc1af87afd035306c0df31f2b6538eb82a3e5cf578a3f0c147f842c480d12: Status 404 returned error can't find the container with id 369cc1af87afd035306c0df31f2b6538eb82a3e5cf578a3f0c147f842c480d12
Jul 15 10:50:29.643027 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:29.642997    2568 generic.go:356] "Generic (PLEG): container finished" podID="0195ef77-083b-493f-aa52-c315bc600ed7" containerID="f26a10cb61cf1b92213bb9da6177a90fa5ecb73e8a3bf7670ad7b7f4acfd622f" exitCode=0
Jul 15 10:50:29.647958 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:29.647930    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-mz8ld" event={"ID":"0195ef77-083b-493f-aa52-c315bc600ed7","Type":"ContainerDied","Data":"f26a10cb61cf1b92213bb9da6177a90fa5ecb73e8a3bf7670ad7b7f4acfd622f"}
Jul 15 10:50:29.648072 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:29.647972    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-mz8ld" event={"ID":"0195ef77-083b-493f-aa52-c315bc600ed7","Type":"ContainerStarted","Data":"369cc1af87afd035306c0df31f2b6538eb82a3e5cf578a3f0c147f842c480d12"}
Jul 15 10:50:30.775541 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:30.775515    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-mz8ld"
Jul 15 10:50:30.847315 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:30.847293    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0195ef77-083b-493f-aa52-c315bc600ed7-maas-api-service-ca\") pod \"0195ef77-083b-493f-aa52-c315bc600ed7\" (UID: \"0195ef77-083b-493f-aa52-c315bc600ed7\") "
Jul 15 10:50:30.847618 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:30.847598    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0195ef77-083b-493f-aa52-c315bc600ed7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0195ef77-083b-493f-aa52-c315bc600ed7" (UID: "0195ef77-083b-493f-aa52-c315bc600ed7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:50:30.947824 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:30.947764    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0195ef77-083b-493f-aa52-c315bc600ed7-maas-api-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:50:31.659177 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:31.659148    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-mz8ld"
Jul 15 10:50:31.659320 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:31.659140    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73e6f609-mz8ld" event={"ID":"0195ef77-083b-493f-aa52-c315bc600ed7","Type":"ContainerDied","Data":"369cc1af87afd035306c0df31f2b6538eb82a3e5cf578a3f0c147f842c480d12"}
Jul 15 10:50:31.659320 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:31.659308    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="369cc1af87afd035306c0df31f2b6538eb82a3e5cf578a3f0c147f842c480d12"
Jul 15 10:50:39.143173 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.143140    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"]
Jul 15 10:50:39.143631 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.143360    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5" podUID="bcc708dd-1b48-4213-8dc7-2fa372648e17" containerName="maas-api" containerID="cri-o://63236db72d73dbf2659c4a326a319f3446bcf7dfc8593a371517ac164b81d561" gracePeriod=30
Jul 15 10:50:39.389845 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.389821    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"
Jul 15 10:50:39.514922 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.514901    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwv4w\" (UniqueName: \"kubernetes.io/projected/bcc708dd-1b48-4213-8dc7-2fa372648e17-kube-api-access-qwv4w\") pod \"bcc708dd-1b48-4213-8dc7-2fa372648e17\" (UID: \"bcc708dd-1b48-4213-8dc7-2fa372648e17\") "
Jul 15 10:50:39.515051 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.515027    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcc708dd-1b48-4213-8dc7-2fa372648e17-openshift-service-ca\") pod \"bcc708dd-1b48-4213-8dc7-2fa372648e17\" (UID: \"bcc708dd-1b48-4213-8dc7-2fa372648e17\") "
Jul 15 10:50:39.515051 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.515048    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bcc708dd-1b48-4213-8dc7-2fa372648e17-maas-api-tls\") pod \"bcc708dd-1b48-4213-8dc7-2fa372648e17\" (UID: \"bcc708dd-1b48-4213-8dc7-2fa372648e17\") "
Jul 15 10:50:39.515410 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.515385    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcc708dd-1b48-4213-8dc7-2fa372648e17-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bcc708dd-1b48-4213-8dc7-2fa372648e17" (UID: "bcc708dd-1b48-4213-8dc7-2fa372648e17"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:50:39.517138 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.517097    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcc708dd-1b48-4213-8dc7-2fa372648e17-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bcc708dd-1b48-4213-8dc7-2fa372648e17" (UID: "bcc708dd-1b48-4213-8dc7-2fa372648e17"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:50:39.517223 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.517164    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcc708dd-1b48-4213-8dc7-2fa372648e17-kube-api-access-qwv4w" (OuterVolumeSpecName: "kube-api-access-qwv4w") pod "bcc708dd-1b48-4213-8dc7-2fa372648e17" (UID: "bcc708dd-1b48-4213-8dc7-2fa372648e17"). InnerVolumeSpecName "kube-api-access-qwv4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:50:39.616570 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.616545    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwv4w\" (UniqueName: \"kubernetes.io/projected/bcc708dd-1b48-4213-8dc7-2fa372648e17-kube-api-access-qwv4w\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:50:39.616570 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.616567    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcc708dd-1b48-4213-8dc7-2fa372648e17-openshift-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:50:39.616685 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.616577    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bcc708dd-1b48-4213-8dc7-2fa372648e17-maas-api-tls\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:50:39.701539 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.701513    2568 generic.go:356] "Generic (PLEG): container finished" podID="bcc708dd-1b48-4213-8dc7-2fa372648e17" containerID="63236db72d73dbf2659c4a326a319f3446bcf7dfc8593a371517ac164b81d561" exitCode=0
Jul 15 10:50:39.701622 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.701552    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"
Jul 15 10:50:39.701622 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.701570    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5" event={"ID":"bcc708dd-1b48-4213-8dc7-2fa372648e17","Type":"ContainerDied","Data":"63236db72d73dbf2659c4a326a319f3446bcf7dfc8593a371517ac164b81d561"}
Jul 15 10:50:39.701622 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.701608    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5" event={"ID":"bcc708dd-1b48-4213-8dc7-2fa372648e17","Type":"ContainerDied","Data":"ecc5e34aba23d85a5eef6e4b83e14fc97def9e34dc24258f481b915bdc1f58b9"}
Jul 15 10:50:39.701730 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.701628    2568 scope.go:117] "RemoveContainer" containerID="63236db72d73dbf2659c4a326a319f3446bcf7dfc8593a371517ac164b81d561"
Jul 15 10:50:39.710359 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.710340    2568 scope.go:117] "RemoveContainer" containerID="63236db72d73dbf2659c4a326a319f3446bcf7dfc8593a371517ac164b81d561"
Jul 15 10:50:39.710657 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:50:39.710640    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63236db72d73dbf2659c4a326a319f3446bcf7dfc8593a371517ac164b81d561\": container with ID starting with 63236db72d73dbf2659c4a326a319f3446bcf7dfc8593a371517ac164b81d561 not found: ID does not exist" containerID="63236db72d73dbf2659c4a326a319f3446bcf7dfc8593a371517ac164b81d561"
Jul 15 10:50:39.710706 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.710666    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63236db72d73dbf2659c4a326a319f3446bcf7dfc8593a371517ac164b81d561"} err="failed to get container status \"63236db72d73dbf2659c4a326a319f3446bcf7dfc8593a371517ac164b81d561\": rpc error: code = NotFound desc = could not find container \"63236db72d73dbf2659c4a326a319f3446bcf7dfc8593a371517ac164b81d561\": container with ID starting with 63236db72d73dbf2659c4a326a319f3446bcf7dfc8593a371517ac164b81d561 not found: ID does not exist"
Jul 15 10:50:39.731882 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.731859    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"]
Jul 15 10:50:39.740051 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:39.740031    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-73e6f609-bb699c758-4v2k5"]
Jul 15 10:50:41.646826 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:41.646791    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcc708dd-1b48-4213-8dc7-2fa372648e17" path="/var/lib/kubelet/pods/bcc708dd-1b48-4213-8dc7-2fa372648e17/volumes"
Jul 15 10:50:41.903864 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:41.903777    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:50:53.694187 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:53.694151    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"]
Jul 15 10:50:53.694580 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:53.694357    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl" podUID="669c6f23-ff41-4e41-816a-67aa3b7f4d14" containerName="istio-proxy" containerID="cri-o://ca79e6f39d34bc6385df29f27d208a4abffdfbd77709fab7e234fab07948d598" gracePeriod=30
Jul 15 10:50:57.999849 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:57.999813    2568 patch_prober.go:28] interesting pod/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 10:50:58.000261 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:57.999877    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl" podUID="669c6f23-ff41-4e41-816a-67aa3b7f4d14" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:50:58.946365 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:58.946339    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:50:59.062231 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.062210    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-envoy\") pod \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") "
Jul 15 10:50:59.062574 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.062257    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-token\") pod \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") "
Jul 15 10:50:59.062574 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.062294    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istiod-ca-cert\") pod \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") "
Jul 15 10:50:59.062574 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.062394    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-credential-socket\") pod \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") "
Jul 15 10:50:59.062574 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.062423    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-podinfo\") pod \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") "
Jul 15 10:50:59.062574 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.062495    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-data\") pod \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") "
Jul 15 10:50:59.062574 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.062541    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-workload-socket\") pod \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") "
Jul 15 10:50:59.062840 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.062614    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-workload-certs\") pod \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") "
Jul 15 10:50:59.062840 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.062643    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqb99\" (UniqueName: \"kubernetes.io/projected/669c6f23-ff41-4e41-816a-67aa3b7f4d14-kube-api-access-tqb99\") pod \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\" (UID: \"669c6f23-ff41-4e41-816a-67aa3b7f4d14\") "
Jul 15 10:50:59.062840 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.062645    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "669c6f23-ff41-4e41-816a-67aa3b7f4d14" (UID: "669c6f23-ff41-4e41-816a-67aa3b7f4d14"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:50:59.062840 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.062680    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "669c6f23-ff41-4e41-816a-67aa3b7f4d14" (UID: "669c6f23-ff41-4e41-816a-67aa3b7f4d14"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:50:59.063062 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.062843    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "669c6f23-ff41-4e41-816a-67aa3b7f4d14" (UID: "669c6f23-ff41-4e41-816a-67aa3b7f4d14"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:50:59.063062 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.062921    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-workload-certs\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:50:59.063062 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.062940    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istiod-ca-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:50:59.063062 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.062960    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-credential-socket\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:50:59.063472 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.063323    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "669c6f23-ff41-4e41-816a-67aa3b7f4d14" (UID: "669c6f23-ff41-4e41-816a-67aa3b7f4d14"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:50:59.064000 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.063966    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-data" (OuterVolumeSpecName: "istio-data") pod "669c6f23-ff41-4e41-816a-67aa3b7f4d14" (UID: "669c6f23-ff41-4e41-816a-67aa3b7f4d14"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:50:59.064716 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.064695    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "669c6f23-ff41-4e41-816a-67aa3b7f4d14" (UID: "669c6f23-ff41-4e41-816a-67aa3b7f4d14"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:50:59.064716 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.064700    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "669c6f23-ff41-4e41-816a-67aa3b7f4d14" (UID: "669c6f23-ff41-4e41-816a-67aa3b7f4d14"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 10:50:59.064819 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.064759    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-token" (OuterVolumeSpecName: "istio-token") pod "669c6f23-ff41-4e41-816a-67aa3b7f4d14" (UID: "669c6f23-ff41-4e41-816a-67aa3b7f4d14"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:50:59.065182 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.065168    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/669c6f23-ff41-4e41-816a-67aa3b7f4d14-kube-api-access-tqb99" (OuterVolumeSpecName: "kube-api-access-tqb99") pod "669c6f23-ff41-4e41-816a-67aa3b7f4d14" (UID: "669c6f23-ff41-4e41-816a-67aa3b7f4d14"). InnerVolumeSpecName "kube-api-access-tqb99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:50:59.163659 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.163637    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-data\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:50:59.163659 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.163658    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-workload-socket\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:50:59.163781 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.163669    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqb99\" (UniqueName: \"kubernetes.io/projected/669c6f23-ff41-4e41-816a-67aa3b7f4d14-kube-api-access-tqb99\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:50:59.163781 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.163678    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-envoy\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:50:59.163781 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.163686    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-token\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:50:59.163781 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.163693    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/669c6f23-ff41-4e41-816a-67aa3b7f4d14-istio-podinfo\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:50:59.804040 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.804005    2568 generic.go:356] "Generic (PLEG): container finished" podID="669c6f23-ff41-4e41-816a-67aa3b7f4d14" containerID="ca79e6f39d34bc6385df29f27d208a4abffdfbd77709fab7e234fab07948d598" exitCode=0
Jul 15 10:50:59.804189 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.804042    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"
Jul 15 10:50:59.804189 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.804056    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl" event={"ID":"669c6f23-ff41-4e41-816a-67aa3b7f4d14","Type":"ContainerDied","Data":"ca79e6f39d34bc6385df29f27d208a4abffdfbd77709fab7e234fab07948d598"}
Jul 15 10:50:59.804189 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.804141    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl" event={"ID":"669c6f23-ff41-4e41-816a-67aa3b7f4d14","Type":"ContainerDied","Data":"bf521661be0f425155a10233188cb2784773eaa8f017e06a0d754135c91909ff"}
Jul 15 10:50:59.804189 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.804168    2568 scope.go:117] "RemoveContainer" containerID="ca79e6f39d34bc6385df29f27d208a4abffdfbd77709fab7e234fab07948d598"
Jul 15 10:50:59.813066 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.812917    2568 scope.go:117] "RemoveContainer" containerID="13a0a5bee608caccaedf8baaf44243d53a030edf4d7ed7d176144bc626049d38"
Jul 15 10:50:59.820589 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.820575    2568 scope.go:117] "RemoveContainer" containerID="ca79e6f39d34bc6385df29f27d208a4abffdfbd77709fab7e234fab07948d598"
Jul 15 10:50:59.820817 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:50:59.820803    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca79e6f39d34bc6385df29f27d208a4abffdfbd77709fab7e234fab07948d598\": container with ID starting with ca79e6f39d34bc6385df29f27d208a4abffdfbd77709fab7e234fab07948d598 not found: ID does not exist" containerID="ca79e6f39d34bc6385df29f27d208a4abffdfbd77709fab7e234fab07948d598"
Jul 15 10:50:59.820863 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.820825    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca79e6f39d34bc6385df29f27d208a4abffdfbd77709fab7e234fab07948d598"} err="failed to get container status \"ca79e6f39d34bc6385df29f27d208a4abffdfbd77709fab7e234fab07948d598\": rpc error: code = NotFound desc = could not find container \"ca79e6f39d34bc6385df29f27d208a4abffdfbd77709fab7e234fab07948d598\": container with ID starting with ca79e6f39d34bc6385df29f27d208a4abffdfbd77709fab7e234fab07948d598 not found: ID does not exist"
Jul 15 10:50:59.820863 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.820839    2568 scope.go:117] "RemoveContainer" containerID="13a0a5bee608caccaedf8baaf44243d53a030edf4d7ed7d176144bc626049d38"
Jul 15 10:50:59.821050 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:50:59.821032    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13a0a5bee608caccaedf8baaf44243d53a030edf4d7ed7d176144bc626049d38\": container with ID starting with 13a0a5bee608caccaedf8baaf44243d53a030edf4d7ed7d176144bc626049d38 not found: ID does not exist" containerID="13a0a5bee608caccaedf8baaf44243d53a030edf4d7ed7d176144bc626049d38"
Jul 15 10:50:59.821087 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.821057    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13a0a5bee608caccaedf8baaf44243d53a030edf4d7ed7d176144bc626049d38"} err="failed to get container status \"13a0a5bee608caccaedf8baaf44243d53a030edf4d7ed7d176144bc626049d38\": rpc error: code = NotFound desc = could not find container \"13a0a5bee608caccaedf8baaf44243d53a030edf4d7ed7d176144bc626049d38\": container with ID starting with 13a0a5bee608caccaedf8baaf44243d53a030edf4d7ed7d176144bc626049d38 not found: ID does not exist"
Jul 15 10:50:59.826857 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.826837    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"]
Jul 15 10:50:59.832597 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:50:59.832505    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-73e6f609-openshift-default-659fbb954c-qd5tl"]
Jul 15 10:51:01.649572 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:51:01.649532    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="669c6f23-ff41-4e41-816a-67aa3b7f4d14" path="/var/lib/kubelet/pods/669c6f23-ff41-4e41-816a-67aa3b7f4d14/volumes"
Jul 15 10:52:01.746127 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:01.746048    2568 scope.go:117] "RemoveContainer" containerID="3f2b92832dca42a8bce8596a917845f538b8a61a3893a6efe9c4d37d29ba4061"
Jul 15 10:52:21.093428 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:21.093393    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:52:28.398823 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:28.398793    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:52:35.493197 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:35.493160    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:52:37.063921 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.063890    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"]
Jul 15 10:52:37.064320 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.064248    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcc708dd-1b48-4213-8dc7-2fa372648e17" containerName="maas-api"
Jul 15 10:52:37.064320 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.064261    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcc708dd-1b48-4213-8dc7-2fa372648e17" containerName="maas-api"
Jul 15 10:52:37.064320 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.064271    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="669c6f23-ff41-4e41-816a-67aa3b7f4d14" containerName="istio-proxy"
Jul 15 10:52:37.064320 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.064279    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="669c6f23-ff41-4e41-816a-67aa3b7f4d14" containerName="istio-proxy"
Jul 15 10:52:37.064320 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.064303    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0195ef77-083b-493f-aa52-c315bc600ed7" containerName="revoke-keys"
Jul 15 10:52:37.064320 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.064308    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0195ef77-083b-493f-aa52-c315bc600ed7" containerName="revoke-keys"
Jul 15 10:52:37.064320 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.064315    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="669c6f23-ff41-4e41-816a-67aa3b7f4d14" containerName="istio-proxy"
Jul 15 10:52:37.064320 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.064320    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="669c6f23-ff41-4e41-816a-67aa3b7f4d14" containerName="istio-proxy"
Jul 15 10:52:37.064562 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.064373    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcc708dd-1b48-4213-8dc7-2fa372648e17" containerName="maas-api"
Jul 15 10:52:37.064562 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.064385    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0195ef77-083b-493f-aa52-c315bc600ed7" containerName="revoke-keys"
Jul 15 10:52:37.064562 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.064391    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e833b0-07e4-4ef3-8010-4f8fd05750a4" containerName="revoke-keys"
Jul 15 10:52:37.064562 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.064398    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="669c6f23-ff41-4e41-816a-67aa3b7f4d14" containerName="istio-proxy"
Jul 15 10:52:37.064562 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.064403    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="669c6f23-ff41-4e41-816a-67aa3b7f4d14" containerName="istio-proxy"
Jul 15 10:52:37.067481 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.067466    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.073222 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.073199    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-339d043d-openshift-default-dockercfg-lg8jn\""
Jul 15 10:52:37.107457 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.107427    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"]
Jul 15 10:52:37.140562 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.140535    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-credential-socket\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.140689 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.140568    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-workload-socket\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.140689 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.140585    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2227ce98-cb44-46cc-ba1d-6edf32230c68-istiod-ca-cert\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.140689 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.140665    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ftsp\" (UniqueName: \"kubernetes.io/projected/2227ce98-cb44-46cc-ba1d-6edf32230c68-kube-api-access-9ftsp\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.140795 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.140704    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-token\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.140795 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.140763    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-podinfo\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.140863 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.140813    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-workload-certs\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.140863 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.140847    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-envoy\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.140924 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.140864    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-data\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.242073 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.242046    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-credential-socket\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.242209 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.242075    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-workload-socket\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.242209 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.242096    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2227ce98-cb44-46cc-ba1d-6edf32230c68-istiod-ca-cert\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.242209 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.242171    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ftsp\" (UniqueName: \"kubernetes.io/projected/2227ce98-cb44-46cc-ba1d-6edf32230c68-kube-api-access-9ftsp\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.242209 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.242205    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-token\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.242407 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.242228    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-podinfo\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.242407 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.242257    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-workload-certs\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.242407 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.242282    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-envoy\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.242407 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.242306    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-data\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.242600 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.242533    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-workload-socket\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.242655 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.242634    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-data\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.242655 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.242618    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-workload-certs\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.242736 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.242725    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-credential-socket\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.242869 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.242853    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2227ce98-cb44-46cc-ba1d-6edf32230c68-istiod-ca-cert\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.244680 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.244655    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-envoy\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.244907 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.244886    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-podinfo\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.255437 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.255416    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-token\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.255827 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.255806    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ftsp\" (UniqueName: \"kubernetes.io/projected/2227ce98-cb44-46cc-ba1d-6edf32230c68-kube-api-access-9ftsp\") pod \"e2e-mt-339d043d-openshift-default-85646946f5-2t2sk\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") " pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.377038 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.376971    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:37.519097 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.519072    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"]
Jul 15 10:52:37.520712 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:52:37.520687    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2227ce98_cb44_46cc_ba1d_6edf32230c68.slice/crio-843c069eac64f5b6fd62f629b1dfdcae56b660dd875d0b7cef3dda53b0b75587 WatchSource:0}: Error finding container 843c069eac64f5b6fd62f629b1dfdcae56b660dd875d0b7cef3dda53b0b75587: Status 404 returned error can't find the container with id 843c069eac64f5b6fd62f629b1dfdcae56b660dd875d0b7cef3dda53b0b75587
Jul 15 10:52:37.522699 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.522670    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:52:37.522759 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.522731    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:52:37.522794 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:37.522759    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:52:38.304035 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:38.303994    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk" event={"ID":"2227ce98-cb44-46cc-ba1d-6edf32230c68","Type":"ContainerStarted","Data":"7a03ba41030a978ba385b41f7c0b9176cb4ba9fb8b1345b355f0dc168100d487"}
Jul 15 10:52:38.304441 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:38.304058    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk" event={"ID":"2227ce98-cb44-46cc-ba1d-6edf32230c68","Type":"ContainerStarted","Data":"843c069eac64f5b6fd62f629b1dfdcae56b660dd875d0b7cef3dda53b0b75587"}
Jul 15 10:52:38.333545 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:38.333494    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk" podStartSLOduration=1.333478788 podStartE2EDuration="1.333478788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:52:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:52:38.332661295 +0000 UTC m=+1957.152303169" watchObservedRunningTime="2026-07-15 10:52:38.333478788 +0000 UTC m=+1957.153120717"
Jul 15 10:52:38.377956 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:38.377928    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:38.382614 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:38.382585    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:39.309129 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:39.309081    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:39.309816 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:39.309801    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:40.443037 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.437397    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"]
Jul 15 10:52:40.443037 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.442025    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"
Jul 15 10:52:40.445037 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.445015    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zk7pv\""
Jul 15 10:52:40.445275 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.445258    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 10:52:40.446246 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.446208    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-339d043d-serving-cert\""
Jul 15 10:52:40.446561 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.446526    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 10:52:40.450358 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.450335    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"]
Jul 15 10:52:40.570184 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.570153    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6a2f411-2c42-427f-a16f-b8409b938bc2-maas-api-tls\") pod \"maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb\" (UID: \"c6a2f411-2c42-427f-a16f-b8409b938bc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"
Jul 15 10:52:40.570184 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.570187    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6a2f411-2c42-427f-a16f-b8409b938bc2-openshift-service-ca\") pod \"maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb\" (UID: \"c6a2f411-2c42-427f-a16f-b8409b938bc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"
Jul 15 10:52:40.570384 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.570216    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnlfp\" (UniqueName: \"kubernetes.io/projected/c6a2f411-2c42-427f-a16f-b8409b938bc2-kube-api-access-dnlfp\") pod \"maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb\" (UID: \"c6a2f411-2c42-427f-a16f-b8409b938bc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"
Jul 15 10:52:40.671175 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.671148    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6a2f411-2c42-427f-a16f-b8409b938bc2-maas-api-tls\") pod \"maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb\" (UID: \"c6a2f411-2c42-427f-a16f-b8409b938bc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"
Jul 15 10:52:40.671297 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.671179    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6a2f411-2c42-427f-a16f-b8409b938bc2-openshift-service-ca\") pod \"maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb\" (UID: \"c6a2f411-2c42-427f-a16f-b8409b938bc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"
Jul 15 10:52:40.671297 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.671207    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnlfp\" (UniqueName: \"kubernetes.io/projected/c6a2f411-2c42-427f-a16f-b8409b938bc2-kube-api-access-dnlfp\") pod \"maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb\" (UID: \"c6a2f411-2c42-427f-a16f-b8409b938bc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"
Jul 15 10:52:40.671820 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.671794    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6a2f411-2c42-427f-a16f-b8409b938bc2-openshift-service-ca\") pod \"maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb\" (UID: \"c6a2f411-2c42-427f-a16f-b8409b938bc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"
Jul 15 10:52:40.673732 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.673706    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6a2f411-2c42-427f-a16f-b8409b938bc2-maas-api-tls\") pod \"maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb\" (UID: \"c6a2f411-2c42-427f-a16f-b8409b938bc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"
Jul 15 10:52:40.681252 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.681225    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnlfp\" (UniqueName: \"kubernetes.io/projected/c6a2f411-2c42-427f-a16f-b8409b938bc2-kube-api-access-dnlfp\") pod \"maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb\" (UID: \"c6a2f411-2c42-427f-a16f-b8409b938bc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"
Jul 15 10:52:40.756277 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.756259    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"
Jul 15 10:52:40.890227 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.890198    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"]
Jul 15 10:52:40.891507 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:52:40.891480    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a2f411_2c42_427f_a16f_b8409b938bc2.slice/crio-c6118249b8d3032a5ab51c47d4e0d02f21fb8349f94116e15e068c1ad2bd6248 WatchSource:0}: Error finding container c6118249b8d3032a5ab51c47d4e0d02f21fb8349f94116e15e068c1ad2bd6248: Status 404 returned error can't find the container with id c6118249b8d3032a5ab51c47d4e0d02f21fb8349f94116e15e068c1ad2bd6248
Jul 15 10:52:40.892890 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:40.892873    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 10:52:41.320168 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:41.320134    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb" event={"ID":"c6a2f411-2c42-427f-a16f-b8409b938bc2","Type":"ContainerStarted","Data":"c6118249b8d3032a5ab51c47d4e0d02f21fb8349f94116e15e068c1ad2bd6248"}
Jul 15 10:52:42.327373 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:42.327340    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb" event={"ID":"c6a2f411-2c42-427f-a16f-b8409b938bc2","Type":"ContainerStarted","Data":"a2a21ab238a53a71a753918d337531a06902f97ccb8bbd8ea53d1e7bd5ba2a8e"}
Jul 15 10:52:42.327759 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:42.327460    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"
Jul 15 10:52:42.346285 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:42.346236    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb" podStartSLOduration=1.956681778 podStartE2EDuration="2.346221636s" totalImagesPullingTime="389.539858ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:52:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:52:42.345282972 +0000 UTC m=+1961.164924856" watchObservedRunningTime="2026-07-15 10:52:42.346221636 +0000 UTC m=+1961.165863506"
Jul 15 10:52:44.882235 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:44.882196    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:52:48.339333 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:48.339301    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"
Jul 15 10:52:52.853486 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:52.853415    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-339d043d-qlj2f"]
Jul 15 10:52:52.856713 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:52.856697    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-339d043d-qlj2f"
Jul 15 10:52:52.861567 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:52.861546    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zj826\""
Jul 15 10:52:52.867615 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:52.867593    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-339d043d-qlj2f"]
Jul 15 10:52:52.974712 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:52.974651    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6911ea7-0200-48ec-a648-ceed799e0bdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-339d043d-qlj2f\" (UID: \"e6911ea7-0200-48ec-a648-ceed799e0bdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-339d043d-qlj2f"
Jul 15 10:52:53.075010 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:53.074960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6911ea7-0200-48ec-a648-ceed799e0bdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-339d043d-qlj2f\" (UID: \"e6911ea7-0200-48ec-a648-ceed799e0bdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-339d043d-qlj2f"
Jul 15 10:52:53.075653 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:53.075634    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6911ea7-0200-48ec-a648-ceed799e0bdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-339d043d-qlj2f\" (UID: \"e6911ea7-0200-48ec-a648-ceed799e0bdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-339d043d-qlj2f"
Jul 15 10:52:53.168128 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:53.168087    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-339d043d-qlj2f"
Jul 15 10:52:53.300220 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:53.300194    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-339d043d-qlj2f"]
Jul 15 10:52:53.302235 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:52:53.302197    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6911ea7_0200_48ec_a648_ceed799e0bdd.slice/crio-ab190d7f3b8fa8808f3bcd523a7ad762034a8e5c8ab22dc3c73d86732953dc62 WatchSource:0}: Error finding container ab190d7f3b8fa8808f3bcd523a7ad762034a8e5c8ab22dc3c73d86732953dc62: Status 404 returned error can't find the container with id ab190d7f3b8fa8808f3bcd523a7ad762034a8e5c8ab22dc3c73d86732953dc62
Jul 15 10:52:53.389380 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:53.389345    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-339d043d-qlj2f" event={"ID":"e6911ea7-0200-48ec-a648-ceed799e0bdd","Type":"ContainerStarted","Data":"ab190d7f3b8fa8808f3bcd523a7ad762034a8e5c8ab22dc3c73d86732953dc62"}
Jul 15 10:52:53.390921 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:53.390895    2568 generic.go:356] "Generic (PLEG): container finished" podID="2227ce98-cb44-46cc-ba1d-6edf32230c68" containerID="7a03ba41030a978ba385b41f7c0b9176cb4ba9fb8b1345b355f0dc168100d487" exitCode=0
Jul 15 10:52:53.391073 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:53.390993    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk" event={"ID":"2227ce98-cb44-46cc-ba1d-6edf32230c68","Type":"ContainerDied","Data":"7a03ba41030a978ba385b41f7c0b9176cb4ba9fb8b1345b355f0dc168100d487"}
Jul 15 10:52:53.391393 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:53.391377    2568 scope.go:117] "RemoveContainer" containerID="7a03ba41030a978ba385b41f7c0b9176cb4ba9fb8b1345b355f0dc168100d487"
Jul 15 10:52:53.392366 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:53.392340    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:52:53.392466 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:53.392418    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:52:53.392534 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:53.392478    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:52:54.309950 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:54.309914    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:54.397718 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:54.397628    2568 generic.go:356] "Generic (PLEG): container finished" podID="e6911ea7-0200-48ec-a648-ceed799e0bdd" containerID="5962266809bda54684eff3b2bf6e4221cc5bdb317c4e425bcc4cb4ebbcb16157" exitCode=0
Jul 15 10:52:54.397901 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:54.397713    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-339d043d-qlj2f" event={"ID":"e6911ea7-0200-48ec-a648-ceed799e0bdd","Type":"ContainerDied","Data":"5962266809bda54684eff3b2bf6e4221cc5bdb317c4e425bcc4cb4ebbcb16157"}
Jul 15 10:52:54.399528 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:54.399507    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk" event={"ID":"2227ce98-cb44-46cc-ba1d-6edf32230c68","Type":"ContainerStarted","Data":"aae28ab3454911459d911be24dd42a82e0aa16843aeafd2b1c3555726cfa3b35"}
Jul 15 10:52:55.378296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:55.378260    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:55.379510 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:55.379470    2568 patch_prober.go:28] interesting pod/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 15 10:52:55.379643 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:55.379532    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk" podUID="2227ce98-cb44-46cc-ba1d-6edf32230c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 15 10:52:55.546712 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:55.546687    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-339d043d-qlj2f"
Jul 15 10:52:55.698375 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:55.698288    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6911ea7-0200-48ec-a648-ceed799e0bdd-maas-api-service-ca\") pod \"e6911ea7-0200-48ec-a648-ceed799e0bdd\" (UID: \"e6911ea7-0200-48ec-a648-ceed799e0bdd\") "
Jul 15 10:52:55.698598 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:55.698577    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6911ea7-0200-48ec-a648-ceed799e0bdd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e6911ea7-0200-48ec-a648-ceed799e0bdd" (UID: "e6911ea7-0200-48ec-a648-ceed799e0bdd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:52:55.799664 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:55.799633    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6911ea7-0200-48ec-a648-ceed799e0bdd-maas-api-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:52:56.377949 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:56.377910    2568 patch_prober.go:28] interesting pod/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 15 10:52:56.378257 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:56.378227    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk" podUID="2227ce98-cb44-46cc-ba1d-6edf32230c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 15 10:52:56.410515 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:56.410487    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-339d043d-qlj2f"
Jul 15 10:52:56.410898 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:56.410536    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-339d043d-qlj2f" event={"ID":"e6911ea7-0200-48ec-a648-ceed799e0bdd","Type":"ContainerDied","Data":"ab190d7f3b8fa8808f3bcd523a7ad762034a8e5c8ab22dc3c73d86732953dc62"}
Jul 15 10:52:56.410898 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:56.410585    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab190d7f3b8fa8808f3bcd523a7ad762034a8e5c8ab22dc3c73d86732953dc62"
Jul 15 10:52:57.377799 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:57.377748    2568 patch_prober.go:28] interesting pod/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 15 10:52:57.377997 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:57.377830    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk" podUID="2227ce98-cb44-46cc-ba1d-6edf32230c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 15 10:52:58.381083 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:58.381054    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:58.381527 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:58.381321    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:52:58.381949 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:52:58.381931    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:53:01.765699 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:01.765672    2568 scope.go:117] "RemoveContainer" containerID="e6c244595ba44818df61de9b4c6a57c4cca8f17e96852d505336b6dfc83df89e"
Jul 15 10:53:03.090794 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.090762    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"]
Jul 15 10:53:03.091319 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.091027    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb" podUID="c6a2f411-2c42-427f-a16f-b8409b938bc2" containerName="maas-api" containerID="cri-o://a2a21ab238a53a71a753918d337531a06902f97ccb8bbd8ea53d1e7bd5ba2a8e" gracePeriod=30
Jul 15 10:53:03.353540 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.353481    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"
Jul 15 10:53:03.364867 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.364847    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6a2f411-2c42-427f-a16f-b8409b938bc2-openshift-service-ca\") pod \"c6a2f411-2c42-427f-a16f-b8409b938bc2\" (UID: \"c6a2f411-2c42-427f-a16f-b8409b938bc2\") "
Jul 15 10:53:03.364982 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.364901    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnlfp\" (UniqueName: \"kubernetes.io/projected/c6a2f411-2c42-427f-a16f-b8409b938bc2-kube-api-access-dnlfp\") pod \"c6a2f411-2c42-427f-a16f-b8409b938bc2\" (UID: \"c6a2f411-2c42-427f-a16f-b8409b938bc2\") "
Jul 15 10:53:03.364982 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.364947    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6a2f411-2c42-427f-a16f-b8409b938bc2-maas-api-tls\") pod \"c6a2f411-2c42-427f-a16f-b8409b938bc2\" (UID: \"c6a2f411-2c42-427f-a16f-b8409b938bc2\") "
Jul 15 10:53:03.365220 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.365198    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6a2f411-2c42-427f-a16f-b8409b938bc2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c6a2f411-2c42-427f-a16f-b8409b938bc2" (UID: "c6a2f411-2c42-427f-a16f-b8409b938bc2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:53:03.367015 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.366988    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6a2f411-2c42-427f-a16f-b8409b938bc2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c6a2f411-2c42-427f-a16f-b8409b938bc2" (UID: "c6a2f411-2c42-427f-a16f-b8409b938bc2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:53:03.367104 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.367074    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6a2f411-2c42-427f-a16f-b8409b938bc2-kube-api-access-dnlfp" (OuterVolumeSpecName: "kube-api-access-dnlfp") pod "c6a2f411-2c42-427f-a16f-b8409b938bc2" (UID: "c6a2f411-2c42-427f-a16f-b8409b938bc2"). InnerVolumeSpecName "kube-api-access-dnlfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:53:03.448988 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.448949    2568 generic.go:356] "Generic (PLEG): container finished" podID="c6a2f411-2c42-427f-a16f-b8409b938bc2" containerID="a2a21ab238a53a71a753918d337531a06902f97ccb8bbd8ea53d1e7bd5ba2a8e" exitCode=0
Jul 15 10:53:03.449158 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.448989    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"
Jul 15 10:53:03.449158 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.449026    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb" event={"ID":"c6a2f411-2c42-427f-a16f-b8409b938bc2","Type":"ContainerDied","Data":"a2a21ab238a53a71a753918d337531a06902f97ccb8bbd8ea53d1e7bd5ba2a8e"}
Jul 15 10:53:03.449158 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.449076    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb" event={"ID":"c6a2f411-2c42-427f-a16f-b8409b938bc2","Type":"ContainerDied","Data":"c6118249b8d3032a5ab51c47d4e0d02f21fb8349f94116e15e068c1ad2bd6248"}
Jul 15 10:53:03.449158 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.449101    2568 scope.go:117] "RemoveContainer" containerID="a2a21ab238a53a71a753918d337531a06902f97ccb8bbd8ea53d1e7bd5ba2a8e"
Jul 15 10:53:03.458285 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.458271    2568 scope.go:117] "RemoveContainer" containerID="a2a21ab238a53a71a753918d337531a06902f97ccb8bbd8ea53d1e7bd5ba2a8e"
Jul 15 10:53:03.458520 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:53:03.458505    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2a21ab238a53a71a753918d337531a06902f97ccb8bbd8ea53d1e7bd5ba2a8e\": container with ID starting with a2a21ab238a53a71a753918d337531a06902f97ccb8bbd8ea53d1e7bd5ba2a8e not found: ID does not exist" containerID="a2a21ab238a53a71a753918d337531a06902f97ccb8bbd8ea53d1e7bd5ba2a8e"
Jul 15 10:53:03.458573 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.458529    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2a21ab238a53a71a753918d337531a06902f97ccb8bbd8ea53d1e7bd5ba2a8e"} err="failed to get container status \"a2a21ab238a53a71a753918d337531a06902f97ccb8bbd8ea53d1e7bd5ba2a8e\": rpc error: code = NotFound desc = could not find container \"a2a21ab238a53a71a753918d337531a06902f97ccb8bbd8ea53d1e7bd5ba2a8e\": container with ID starting with a2a21ab238a53a71a753918d337531a06902f97ccb8bbd8ea53d1e7bd5ba2a8e not found: ID does not exist"
Jul 15 10:53:03.465472 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.465451    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnlfp\" (UniqueName: \"kubernetes.io/projected/c6a2f411-2c42-427f-a16f-b8409b938bc2-kube-api-access-dnlfp\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:53:03.465472 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.465473    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6a2f411-2c42-427f-a16f-b8409b938bc2-maas-api-tls\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:53:03.465592 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.465483    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6a2f411-2c42-427f-a16f-b8409b938bc2-openshift-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:53:03.472929 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.472907    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"]
Jul 15 10:53:03.477379 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.477359    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb"]
Jul 15 10:53:03.646928 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:03.646870    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6a2f411-2c42-427f-a16f-b8409b938bc2" path="/var/lib/kubelet/pods/c6a2f411-2c42-427f-a16f-b8409b938bc2/volumes"
Jul 15 10:53:05.994752 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:05.994702    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:53:06.333436 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:06.333350    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-339d043d-7f6d7c96f8-2r9kb" podUID="c6a2f411-2c42-427f-a16f-b8409b938bc2" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.51:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 15 10:53:18.651300 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:18.651267    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"]
Jul 15 10:53:18.651705 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:18.651487    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk" podUID="2227ce98-cb44-46cc-ba1d-6edf32230c68" containerName="istio-proxy" containerID="cri-o://aae28ab3454911459d911be24dd42a82e0aa16843aeafd2b1c3555726cfa3b35" gracePeriod=30
Jul 15 10:53:23.905257 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:23.905231    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:53:24.021152 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.021126    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-podinfo\") pod \"2227ce98-cb44-46cc-ba1d-6edf32230c68\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") "
Jul 15 10:53:24.021285 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.021173    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2227ce98-cb44-46cc-ba1d-6edf32230c68-istiod-ca-cert\") pod \"2227ce98-cb44-46cc-ba1d-6edf32230c68\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") "
Jul 15 10:53:24.021285 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.021203    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-workload-certs\") pod \"2227ce98-cb44-46cc-ba1d-6edf32230c68\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") "
Jul 15 10:53:24.021412 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.021298    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-envoy\") pod \"2227ce98-cb44-46cc-ba1d-6edf32230c68\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") "
Jul 15 10:53:24.021412 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.021352    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ftsp\" (UniqueName: \"kubernetes.io/projected/2227ce98-cb44-46cc-ba1d-6edf32230c68-kube-api-access-9ftsp\") pod \"2227ce98-cb44-46cc-ba1d-6edf32230c68\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") "
Jul 15 10:53:24.021412 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.021384    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-workload-socket\") pod \"2227ce98-cb44-46cc-ba1d-6edf32230c68\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") "
Jul 15 10:53:24.021561 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.021427    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-credential-socket\") pod \"2227ce98-cb44-46cc-ba1d-6edf32230c68\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") "
Jul 15 10:53:24.021561 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.021457    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-token\") pod \"2227ce98-cb44-46cc-ba1d-6edf32230c68\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") "
Jul 15 10:53:24.021561 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.021453    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2227ce98-cb44-46cc-ba1d-6edf32230c68" (UID: "2227ce98-cb44-46cc-ba1d-6edf32230c68"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:53:24.021561 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.021492    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-data\") pod \"2227ce98-cb44-46cc-ba1d-6edf32230c68\" (UID: \"2227ce98-cb44-46cc-ba1d-6edf32230c68\") "
Jul 15 10:53:24.021751 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.021563    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2227ce98-cb44-46cc-ba1d-6edf32230c68-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2227ce98-cb44-46cc-ba1d-6edf32230c68" (UID: "2227ce98-cb44-46cc-ba1d-6edf32230c68"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:53:24.021751 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.021719    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2227ce98-cb44-46cc-ba1d-6edf32230c68" (UID: "2227ce98-cb44-46cc-ba1d-6edf32230c68"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:53:24.022011 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.021799    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2227ce98-cb44-46cc-ba1d-6edf32230c68-istiod-ca-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:53:24.022011 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.021817    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-workload-certs\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:53:24.022011 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.021828    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2227ce98-cb44-46cc-ba1d-6edf32230c68" (UID: "2227ce98-cb44-46cc-ba1d-6edf32230c68"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:53:24.022569 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.022542    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-data" (OuterVolumeSpecName: "istio-data") pod "2227ce98-cb44-46cc-ba1d-6edf32230c68" (UID: "2227ce98-cb44-46cc-ba1d-6edf32230c68"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:53:24.023564 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.023530    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2227ce98-cb44-46cc-ba1d-6edf32230c68-kube-api-access-9ftsp" (OuterVolumeSpecName: "kube-api-access-9ftsp") pod "2227ce98-cb44-46cc-ba1d-6edf32230c68" (UID: "2227ce98-cb44-46cc-ba1d-6edf32230c68"). InnerVolumeSpecName "kube-api-access-9ftsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:53:24.023564 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.023552    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2227ce98-cb44-46cc-ba1d-6edf32230c68" (UID: "2227ce98-cb44-46cc-ba1d-6edf32230c68"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 10:53:24.024003 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.023983    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2227ce98-cb44-46cc-ba1d-6edf32230c68" (UID: "2227ce98-cb44-46cc-ba1d-6edf32230c68"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:53:24.024071 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.024060    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-token" (OuterVolumeSpecName: "istio-token") pod "2227ce98-cb44-46cc-ba1d-6edf32230c68" (UID: "2227ce98-cb44-46cc-ba1d-6edf32230c68"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:53:24.122389 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.122365    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-podinfo\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:53:24.122389 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.122385    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-envoy\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:53:24.122510 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.122394    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ftsp\" (UniqueName: \"kubernetes.io/projected/2227ce98-cb44-46cc-ba1d-6edf32230c68-kube-api-access-9ftsp\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:53:24.122510 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.122402    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-workload-socket\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:53:24.122510 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.122410    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-credential-socket\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:53:24.122510 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.122418    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-token\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:53:24.122510 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.122425    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2227ce98-cb44-46cc-ba1d-6edf32230c68-istio-data\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:53:24.563435 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.563398    2568 generic.go:356] "Generic (PLEG): container finished" podID="2227ce98-cb44-46cc-ba1d-6edf32230c68" containerID="aae28ab3454911459d911be24dd42a82e0aa16843aeafd2b1c3555726cfa3b35" exitCode=0
Jul 15 10:53:24.563607 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.563476    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"
Jul 15 10:53:24.563607 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.563472    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk" event={"ID":"2227ce98-cb44-46cc-ba1d-6edf32230c68","Type":"ContainerDied","Data":"aae28ab3454911459d911be24dd42a82e0aa16843aeafd2b1c3555726cfa3b35"}
Jul 15 10:53:24.563692 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.563629    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk" event={"ID":"2227ce98-cb44-46cc-ba1d-6edf32230c68","Type":"ContainerDied","Data":"843c069eac64f5b6fd62f629b1dfdcae56b660dd875d0b7cef3dda53b0b75587"}
Jul 15 10:53:24.563692 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.563653    2568 scope.go:117] "RemoveContainer" containerID="aae28ab3454911459d911be24dd42a82e0aa16843aeafd2b1c3555726cfa3b35"
Jul 15 10:53:24.572925 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.572910    2568 scope.go:117] "RemoveContainer" containerID="7a03ba41030a978ba385b41f7c0b9176cb4ba9fb8b1345b355f0dc168100d487"
Jul 15 10:53:24.580896 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.580880    2568 scope.go:117] "RemoveContainer" containerID="aae28ab3454911459d911be24dd42a82e0aa16843aeafd2b1c3555726cfa3b35"
Jul 15 10:53:24.581154 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:53:24.581134    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aae28ab3454911459d911be24dd42a82e0aa16843aeafd2b1c3555726cfa3b35\": container with ID starting with aae28ab3454911459d911be24dd42a82e0aa16843aeafd2b1c3555726cfa3b35 not found: ID does not exist" containerID="aae28ab3454911459d911be24dd42a82e0aa16843aeafd2b1c3555726cfa3b35"
Jul 15 10:53:24.581227 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.581160    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aae28ab3454911459d911be24dd42a82e0aa16843aeafd2b1c3555726cfa3b35"} err="failed to get container status \"aae28ab3454911459d911be24dd42a82e0aa16843aeafd2b1c3555726cfa3b35\": rpc error: code = NotFound desc = could not find container \"aae28ab3454911459d911be24dd42a82e0aa16843aeafd2b1c3555726cfa3b35\": container with ID starting with aae28ab3454911459d911be24dd42a82e0aa16843aeafd2b1c3555726cfa3b35 not found: ID does not exist"
Jul 15 10:53:24.581227 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.581176    2568 scope.go:117] "RemoveContainer" containerID="7a03ba41030a978ba385b41f7c0b9176cb4ba9fb8b1345b355f0dc168100d487"
Jul 15 10:53:24.581388 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:53:24.581374    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a03ba41030a978ba385b41f7c0b9176cb4ba9fb8b1345b355f0dc168100d487\": container with ID starting with 7a03ba41030a978ba385b41f7c0b9176cb4ba9fb8b1345b355f0dc168100d487 not found: ID does not exist" containerID="7a03ba41030a978ba385b41f7c0b9176cb4ba9fb8b1345b355f0dc168100d487"
Jul 15 10:53:24.581431 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.581391    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a03ba41030a978ba385b41f7c0b9176cb4ba9fb8b1345b355f0dc168100d487"} err="failed to get container status \"7a03ba41030a978ba385b41f7c0b9176cb4ba9fb8b1345b355f0dc168100d487\": rpc error: code = NotFound desc = could not find container \"7a03ba41030a978ba385b41f7c0b9176cb4ba9fb8b1345b355f0dc168100d487\": container with ID starting with 7a03ba41030a978ba385b41f7c0b9176cb4ba9fb8b1345b355f0dc168100d487 not found: ID does not exist"
Jul 15 10:53:24.587494 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.587470    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"]
Jul 15 10:53:24.592253 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:24.592234    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-339d043d-openshift-default-85646946f5-2t2sk"]
Jul 15 10:53:25.647018 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:25.646965    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2227ce98-cb44-46cc-ba1d-6edf32230c68" path="/var/lib/kubelet/pods/2227ce98-cb44-46cc-ba1d-6edf32230c68/volumes"
Jul 15 10:53:39.652850 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.652812    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"]
Jul 15 10:53:39.653418 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.653300    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6911ea7-0200-48ec-a648-ceed799e0bdd" containerName="revoke-keys"
Jul 15 10:53:39.653418 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.653317    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6911ea7-0200-48ec-a648-ceed799e0bdd" containerName="revoke-keys"
Jul 15 10:53:39.653418 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.653337    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a2f411-2c42-427f-a16f-b8409b938bc2" containerName="maas-api"
Jul 15 10:53:39.653418 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.653346    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a2f411-2c42-427f-a16f-b8409b938bc2" containerName="maas-api"
Jul 15 10:53:39.653418 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.653360    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2227ce98-cb44-46cc-ba1d-6edf32230c68" containerName="istio-proxy"
Jul 15 10:53:39.653418 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.653368    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2227ce98-cb44-46cc-ba1d-6edf32230c68" containerName="istio-proxy"
Jul 15 10:53:39.653607 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.653458    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2227ce98-cb44-46cc-ba1d-6edf32230c68" containerName="istio-proxy"
Jul 15 10:53:39.653607 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.653471    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2227ce98-cb44-46cc-ba1d-6edf32230c68" containerName="istio-proxy"
Jul 15 10:53:39.653607 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.653482    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6a2f411-2c42-427f-a16f-b8409b938bc2" containerName="maas-api"
Jul 15 10:53:39.653607 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.653490    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6911ea7-0200-48ec-a648-ceed799e0bdd" containerName="revoke-keys"
Jul 15 10:53:39.656817 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.656799    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.659410 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.659389    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e595ab4b-openshift-default-dockercfg-6vp4h\""
Jul 15 10:53:39.667083 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.667061    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"]
Jul 15 10:53:39.738594 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.738567    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-workload-certs\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.738691 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.738606    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kprg7\" (UniqueName: \"kubernetes.io/projected/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-kube-api-access-kprg7\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.738691 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.738642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-envoy\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.738790 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.738712    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-credential-socket\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.738790 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.738730    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istiod-ca-cert\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.738856 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.738798    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-podinfo\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.738856 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.738841    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-token\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.738947 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.738872    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-workload-socket\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.738947 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.738896    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-data\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.839632 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.839600    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-workload-certs\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.839766 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.839651    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kprg7\" (UniqueName: \"kubernetes.io/projected/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-kube-api-access-kprg7\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.839766 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.839678    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-envoy\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.839766 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.839717    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-credential-socket\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.839766 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.839741    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istiod-ca-cert\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.839999 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.839775    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-podinfo\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.839999 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.839799    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-token\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.839999 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.839832    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-workload-socket\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.839999 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.839858    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-data\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.840242 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.840030    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-workload-certs\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.840242 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.840191    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-credential-socket\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.840365 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.840344    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-data\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.840553 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.840531    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istiod-ca-cert\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.840653 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.840571    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-workload-socket\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.841971 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.841952    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-envoy\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.842394 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.842373    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-podinfo\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.850674 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.850645    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-token\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.855153 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.855132    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kprg7\" (UniqueName: \"kubernetes.io/projected/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-kube-api-access-kprg7\") pod \"e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") " pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:39.967289 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:39.967230    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:40.107887 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:40.107863    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"]
Jul 15 10:53:40.110541 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:53:40.110513    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ecc2097_8ed5_4ebc_8f6b_8551348a1e84.slice/crio-e57a544f1f602f775a748d0dcc964c48815d24ebec42f7c3e019365eee8c21ef WatchSource:0}: Error finding container e57a544f1f602f775a748d0dcc964c48815d24ebec42f7c3e019365eee8c21ef: Status 404 returned error can't find the container with id e57a544f1f602f775a748d0dcc964c48815d24ebec42f7c3e019365eee8c21ef
Jul 15 10:53:40.112548 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:40.112522    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:53:40.112617 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:40.112580    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:53:40.112617 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:40.112609    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:53:40.648333 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:40.648295    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495" event={"ID":"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84","Type":"ContainerStarted","Data":"f2b02c613fd2c931131939f0fc0b623d1f36bee874d3b7c9ffa670331239d26f"}
Jul 15 10:53:40.648526 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:40.648348    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495" event={"ID":"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84","Type":"ContainerStarted","Data":"e57a544f1f602f775a748d0dcc964c48815d24ebec42f7c3e019365eee8c21ef"}
Jul 15 10:53:40.674049 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:40.673995    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495" podStartSLOduration=1.6739802940000001 podStartE2EDuration="1.673980294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:53:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:53:40.673252513 +0000 UTC m=+2019.492894384" watchObservedRunningTime="2026-07-15 10:53:40.673980294 +0000 UTC m=+2019.493622165"
Jul 15 10:53:40.967600 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:40.967524    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:41.972424 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:41.972397    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:42.658743 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:42.658715    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:42.659541 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:42.659522    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:43.460959 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:43.460926    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"]
Jul 15 10:53:43.461319 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:43.461299    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2227ce98-cb44-46cc-ba1d-6edf32230c68" containerName="istio-proxy"
Jul 15 10:53:43.461319 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:43.461312    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2227ce98-cb44-46cc-ba1d-6edf32230c68" containerName="istio-proxy"
Jul 15 10:53:43.464614 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:43.464597    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"
Jul 15 10:53:43.467207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:43.467184    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e595ab4b-serving-cert\""
Jul 15 10:53:43.467404 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:43.467253    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 10:53:43.467404 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:43.467262    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 10:53:43.467404 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:43.467296    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zk7pv\""
Jul 15 10:53:43.476235 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:43.476215    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"]
Jul 15 10:53:43.566593 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:43.566565    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc09bb43-081d-4419-90c7-2526c642cbdd-maas-api-tls\") pod \"maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g\" (UID: \"fc09bb43-081d-4419-90c7-2526c642cbdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"
Jul 15 10:53:43.566762 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:43.566602    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc09bb43-081d-4419-90c7-2526c642cbdd-openshift-service-ca\") pod \"maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g\" (UID: \"fc09bb43-081d-4419-90c7-2526c642cbdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"
Jul 15 10:53:43.566762 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:43.566633    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccvq5\" (UniqueName: \"kubernetes.io/projected/fc09bb43-081d-4419-90c7-2526c642cbdd-kube-api-access-ccvq5\") pod \"maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g\" (UID: \"fc09bb43-081d-4419-90c7-2526c642cbdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"
Jul 15 10:53:43.667269 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:43.667244    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc09bb43-081d-4419-90c7-2526c642cbdd-maas-api-tls\") pod \"maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g\" (UID: \"fc09bb43-081d-4419-90c7-2526c642cbdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"
Jul 15 10:53:43.667392 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:43.667282    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc09bb43-081d-4419-90c7-2526c642cbdd-openshift-service-ca\") pod \"maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g\" (UID: \"fc09bb43-081d-4419-90c7-2526c642cbdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"
Jul 15 10:53:43.667392 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:43.667316    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccvq5\" (UniqueName: \"kubernetes.io/projected/fc09bb43-081d-4419-90c7-2526c642cbdd-kube-api-access-ccvq5\") pod \"maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g\" (UID: \"fc09bb43-081d-4419-90c7-2526c642cbdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"
Jul 15 10:53:43.667461 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:53:43.667396    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-serving-cert: secret "maas-api-e2e-mt-e595ab4b-serving-cert" not found
Jul 15 10:53:43.667495 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:53:43.667477    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc09bb43-081d-4419-90c7-2526c642cbdd-maas-api-tls podName:fc09bb43-081d-4419-90c7-2526c642cbdd nodeName:}" failed. No retries permitted until 2026-07-15 10:53:44.167456242 +0000 UTC m=+2022.987098106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fc09bb43-081d-4419-90c7-2526c642cbdd-maas-api-tls") pod "maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g" (UID: "fc09bb43-081d-4419-90c7-2526c642cbdd") : secret "maas-api-e2e-mt-e595ab4b-serving-cert" not found
Jul 15 10:53:43.667931 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:43.667913    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc09bb43-081d-4419-90c7-2526c642cbdd-openshift-service-ca\") pod \"maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g\" (UID: \"fc09bb43-081d-4419-90c7-2526c642cbdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"
Jul 15 10:53:43.679038 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:43.679012    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccvq5\" (UniqueName: \"kubernetes.io/projected/fc09bb43-081d-4419-90c7-2526c642cbdd-kube-api-access-ccvq5\") pod \"maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g\" (UID: \"fc09bb43-081d-4419-90c7-2526c642cbdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"
Jul 15 10:53:44.171416 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:44.171386    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc09bb43-081d-4419-90c7-2526c642cbdd-maas-api-tls\") pod \"maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g\" (UID: \"fc09bb43-081d-4419-90c7-2526c642cbdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"
Jul 15 10:53:44.174168 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:44.174140    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc09bb43-081d-4419-90c7-2526c642cbdd-maas-api-tls\") pod \"maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g\" (UID: \"fc09bb43-081d-4419-90c7-2526c642cbdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"
Jul 15 10:53:44.376203 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:44.376164    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"
Jul 15 10:53:44.514121 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:44.514081    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"]
Jul 15 10:53:44.515387 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:53:44.515364    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc09bb43_081d_4419_90c7_2526c642cbdd.slice/crio-38716f39cb545bd4e54ecacb1e9caeccdde5f88e0997c60cc3a065ef9976b183 WatchSource:0}: Error finding container 38716f39cb545bd4e54ecacb1e9caeccdde5f88e0997c60cc3a065ef9976b183: Status 404 returned error can't find the container with id 38716f39cb545bd4e54ecacb1e9caeccdde5f88e0997c60cc3a065ef9976b183
Jul 15 10:53:44.668539 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:44.668515    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g" event={"ID":"fc09bb43-081d-4419-90c7-2526c642cbdd","Type":"ContainerStarted","Data":"38716f39cb545bd4e54ecacb1e9caeccdde5f88e0997c60cc3a065ef9976b183"}
Jul 15 10:53:45.675218 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:45.675177    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g" event={"ID":"fc09bb43-081d-4419-90c7-2526c642cbdd","Type":"ContainerStarted","Data":"6503b230a9d3188d7a8d0bd2400397242fffa38772894c5123cdf8e5deab7186"}
Jul 15 10:53:45.675615 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:45.675250    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"
Jul 15 10:53:45.697215 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:45.697166    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g" podStartSLOduration=2.179184166 podStartE2EDuration="2.697151912s" totalImagesPullingTime="517.967746ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:53:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:53:45.694508775 +0000 UTC m=+2024.514150650" watchObservedRunningTime="2026-07-15 10:53:45.697151912 +0000 UTC m=+2024.516793782"
Jul 15 10:53:48.989672 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:48.989640    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:53:51.686813 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:51.686785    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"
Jul 15 10:53:57.660070 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:57.660029    2568 patch_prober.go:28] interesting pod/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 15 10:53:57.660526 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:57.660126    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495" podUID="1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 15 10:53:57.744906 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:57.744871    2568 generic.go:356] "Generic (PLEG): container finished" podID="1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" containerID="f2b02c613fd2c931131939f0fc0b623d1f36bee874d3b7c9ffa670331239d26f" exitCode=0
Jul 15 10:53:57.745064 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:57.744937    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495" event={"ID":"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84","Type":"ContainerDied","Data":"f2b02c613fd2c931131939f0fc0b623d1f36bee874d3b7c9ffa670331239d26f"}
Jul 15 10:53:57.745265 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:57.745250    2568 scope.go:117] "RemoveContainer" containerID="f2b02c613fd2c931131939f0fc0b623d1f36bee874d3b7c9ffa670331239d26f"
Jul 15 10:53:57.746156 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:57.746125    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:53:57.746261 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:57.746191    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:53:57.746261 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:57.746221    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:53:58.752665 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:58.752627    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495" event={"ID":"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84","Type":"ContainerStarted","Data":"92e3a43feef19c38caf22c3b1fdeb2723f5775a602351d768d9b506b59843e1b"}
Jul 15 10:53:58.967900 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:58.967863    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:53:58.968274 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:58.968243    2568 patch_prober.go:28] interesting pod/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 15 10:53:58.968406 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:58.968301    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495" podUID="1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 15 10:53:59.968350 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:59.968312    2568 patch_prober.go:28] interesting pod/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 15 10:53:59.968913 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:53:59.968881    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495" podUID="1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 15 10:54:00.968503 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:00.968458    2568 patch_prober.go:28] interesting pod/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 15 10:54:00.968997 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:00.968533    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495" podUID="1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 15 10:54:01.968660 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:01.968627    2568 patch_prober.go:28] interesting pod/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 15 10:54:01.969241 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:01.969210    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495" podUID="1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 15 10:54:02.971652 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:02.971623    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:54:02.971978 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:02.971957    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:54:02.972652 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:02.972637    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:54:04.788214 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:04.788174    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:54:17.198032 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:17.197991    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:54:20.926129 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:20.926086    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k"]
Jul 15 10:54:20.929650 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:20.929634    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k"
Jul 15 10:54:20.932308 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:20.932285    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zj826\""
Jul 15 10:54:20.938617 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:20.938590    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k"]
Jul 15 10:54:20.951720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:20.951698    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92289ae2-b24e-4821-8b86-615a0d1a6424-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k\" (UID: \"92289ae2-b24e-4821-8b86-615a0d1a6424\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k"
Jul 15 10:54:21.052513 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:21.052490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92289ae2-b24e-4821-8b86-615a0d1a6424-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k\" (UID: \"92289ae2-b24e-4821-8b86-615a0d1a6424\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k"
Jul 15 10:54:21.053044 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:21.053027    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92289ae2-b24e-4821-8b86-615a0d1a6424-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k\" (UID: \"92289ae2-b24e-4821-8b86-615a0d1a6424\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k"
Jul 15 10:54:21.241593 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:21.241542    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k"
Jul 15 10:54:21.377130 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:21.377086    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k"]
Jul 15 10:54:21.378721 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:54:21.378689    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92289ae2_b24e_4821_8b86_615a0d1a6424.slice/crio-df496d8eb23309e0c0edc1599dfd7f8e4116247ca502408b847e3e15db9771d6 WatchSource:0}: Error finding container df496d8eb23309e0c0edc1599dfd7f8e4116247ca502408b847e3e15db9771d6: Status 404 returned error can't find the container with id df496d8eb23309e0c0edc1599dfd7f8e4116247ca502408b847e3e15db9771d6
Jul 15 10:54:21.875823 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:21.875745    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k" event={"ID":"92289ae2-b24e-4821-8b86-615a0d1a6424","Type":"ContainerStarted","Data":"8bf53195333296ad52bcd1e5507ecbca0a2f7f8aca6013a929c876b707cc3aa2"}
Jul 15 10:54:21.875823 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:21.875794    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k" event={"ID":"92289ae2-b24e-4821-8b86-615a0d1a6424","Type":"ContainerStarted","Data":"df496d8eb23309e0c0edc1599dfd7f8e4116247ca502408b847e3e15db9771d6"}
Jul 15 10:54:21.895356 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:21.895273    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k" podStartSLOduration=1.895256624 podStartE2EDuration="1.895256624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:54:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:54:21.894476438 +0000 UTC m=+2060.714118308" watchObservedRunningTime="2026-07-15 10:54:21.895256624 +0000 UTC m=+2060.714898489"
Jul 15 10:54:22.883762 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:22.883729    2568 generic.go:356] "Generic (PLEG): container finished" podID="92289ae2-b24e-4821-8b86-615a0d1a6424" containerID="8bf53195333296ad52bcd1e5507ecbca0a2f7f8aca6013a929c876b707cc3aa2" exitCode=0
Jul 15 10:54:22.884166 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:22.883814    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k" event={"ID":"92289ae2-b24e-4821-8b86-615a0d1a6424","Type":"ContainerDied","Data":"8bf53195333296ad52bcd1e5507ecbca0a2f7f8aca6013a929c876b707cc3aa2"}
Jul 15 10:54:24.036728 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:24.036701    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k"
Jul 15 10:54:24.071879 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:24.071858    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92289ae2-b24e-4821-8b86-615a0d1a6424-maas-api-service-ca\") pod \"92289ae2-b24e-4821-8b86-615a0d1a6424\" (UID: \"92289ae2-b24e-4821-8b86-615a0d1a6424\") "
Jul 15 10:54:24.072303 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:24.072278    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92289ae2-b24e-4821-8b86-615a0d1a6424-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "92289ae2-b24e-4821-8b86-615a0d1a6424" (UID: "92289ae2-b24e-4821-8b86-615a0d1a6424"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:54:24.173203 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:24.173151    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92289ae2-b24e-4821-8b86-615a0d1a6424-maas-api-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:54:24.895655 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:24.895617    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k" event={"ID":"92289ae2-b24e-4821-8b86-615a0d1a6424","Type":"ContainerDied","Data":"df496d8eb23309e0c0edc1599dfd7f8e4116247ca502408b847e3e15db9771d6"}
Jul 15 10:54:24.895810 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:24.895671    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df496d8eb23309e0c0edc1599dfd7f8e4116247ca502408b847e3e15db9771d6"
Jul 15 10:54:24.895810 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:24.895626    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k"
Jul 15 10:54:31.587257 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:31.587222    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"]
Jul 15 10:54:31.588055 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:31.588018    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g" podUID="fc09bb43-081d-4419-90c7-2526c642cbdd" containerName="maas-api" containerID="cri-o://6503b230a9d3188d7a8d0bd2400397242fffa38772894c5123cdf8e5deab7186" gracePeriod=30
Jul 15 10:54:31.680699 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:31.680657    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g" podUID="fc09bb43-081d-4419-90c7-2526c642cbdd" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.54:8443/health\": dial tcp 10.134.0.54:8443: connect: connection refused"
Jul 15 10:54:31.842148 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:31.842077    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"
Jul 15 10:54:31.932290 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:31.932260    2568 generic.go:356] "Generic (PLEG): container finished" podID="fc09bb43-081d-4419-90c7-2526c642cbdd" containerID="6503b230a9d3188d7a8d0bd2400397242fffa38772894c5123cdf8e5deab7186" exitCode=0
Jul 15 10:54:31.932453 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:31.932301    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"
Jul 15 10:54:31.932453 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:31.932348    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g" event={"ID":"fc09bb43-081d-4419-90c7-2526c642cbdd","Type":"ContainerDied","Data":"6503b230a9d3188d7a8d0bd2400397242fffa38772894c5123cdf8e5deab7186"}
Jul 15 10:54:31.932453 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:31.932395    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g" event={"ID":"fc09bb43-081d-4419-90c7-2526c642cbdd","Type":"ContainerDied","Data":"38716f39cb545bd4e54ecacb1e9caeccdde5f88e0997c60cc3a065ef9976b183"}
Jul 15 10:54:31.932453 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:31.932419    2568 scope.go:117] "RemoveContainer" containerID="6503b230a9d3188d7a8d0bd2400397242fffa38772894c5123cdf8e5deab7186"
Jul 15 10:54:31.935714 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:31.935682    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc09bb43-081d-4419-90c7-2526c642cbdd-maas-api-tls\") pod \"fc09bb43-081d-4419-90c7-2526c642cbdd\" (UID: \"fc09bb43-081d-4419-90c7-2526c642cbdd\") "
Jul 15 10:54:31.935790 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:31.935725    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccvq5\" (UniqueName: \"kubernetes.io/projected/fc09bb43-081d-4419-90c7-2526c642cbdd-kube-api-access-ccvq5\") pod \"fc09bb43-081d-4419-90c7-2526c642cbdd\" (UID: \"fc09bb43-081d-4419-90c7-2526c642cbdd\") "
Jul 15 10:54:31.935790 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:31.935782    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc09bb43-081d-4419-90c7-2526c642cbdd-openshift-service-ca\") pod \"fc09bb43-081d-4419-90c7-2526c642cbdd\" (UID: \"fc09bb43-081d-4419-90c7-2526c642cbdd\") "
Jul 15 10:54:31.936182 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:31.936158    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc09bb43-081d-4419-90c7-2526c642cbdd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fc09bb43-081d-4419-90c7-2526c642cbdd" (UID: "fc09bb43-081d-4419-90c7-2526c642cbdd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:54:31.937854 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:31.937829    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc09bb43-081d-4419-90c7-2526c642cbdd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fc09bb43-081d-4419-90c7-2526c642cbdd" (UID: "fc09bb43-081d-4419-90c7-2526c642cbdd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:54:31.937982 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:31.937963    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc09bb43-081d-4419-90c7-2526c642cbdd-kube-api-access-ccvq5" (OuterVolumeSpecName: "kube-api-access-ccvq5") pod "fc09bb43-081d-4419-90c7-2526c642cbdd" (UID: "fc09bb43-081d-4419-90c7-2526c642cbdd"). InnerVolumeSpecName "kube-api-access-ccvq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:54:31.941493 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:31.941475    2568 scope.go:117] "RemoveContainer" containerID="6503b230a9d3188d7a8d0bd2400397242fffa38772894c5123cdf8e5deab7186"
Jul 15 10:54:31.941753 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:54:31.941733    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6503b230a9d3188d7a8d0bd2400397242fffa38772894c5123cdf8e5deab7186\": container with ID starting with 6503b230a9d3188d7a8d0bd2400397242fffa38772894c5123cdf8e5deab7186 not found: ID does not exist" containerID="6503b230a9d3188d7a8d0bd2400397242fffa38772894c5123cdf8e5deab7186"
Jul 15 10:54:31.941853 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:31.941758    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6503b230a9d3188d7a8d0bd2400397242fffa38772894c5123cdf8e5deab7186"} err="failed to get container status \"6503b230a9d3188d7a8d0bd2400397242fffa38772894c5123cdf8e5deab7186\": rpc error: code = NotFound desc = could not find container \"6503b230a9d3188d7a8d0bd2400397242fffa38772894c5123cdf8e5deab7186\": container with ID starting with 6503b230a9d3188d7a8d0bd2400397242fffa38772894c5123cdf8e5deab7186 not found: ID does not exist"
Jul 15 10:54:32.037184 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:32.037158    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc09bb43-081d-4419-90c7-2526c642cbdd-maas-api-tls\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:54:32.037184 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:32.037179    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccvq5\" (UniqueName: \"kubernetes.io/projected/fc09bb43-081d-4419-90c7-2526c642cbdd-kube-api-access-ccvq5\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:54:32.037313 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:32.037189    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc09bb43-081d-4419-90c7-2526c642cbdd-openshift-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:54:32.259914 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:32.259887    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"]
Jul 15 10:54:32.264785 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:32.264759    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e595ab4b-68f99c6bdc-w6h9g"]
Jul 15 10:54:33.647552 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:33.647521    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc09bb43-081d-4419-90c7-2526c642cbdd" path="/var/lib/kubelet/pods/fc09bb43-081d-4419-90c7-2526c642cbdd/volumes"
Jul 15 10:54:35.196896 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:54:35.196862    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:55:01.704428 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:01.704400    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:55:01.710448 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:01.710430    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 10:55:01.804411 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:01.804389    2568 scope.go:117] "RemoveContainer" containerID="36525343a6ec396a0fbd7daae1f80b08ff6c77d5c635af3bc1c8c77544927ddb"
Jul 15 10:55:38.495718 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:38.495679    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"]
Jul 15 10:55:38.496270 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:38.495900    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495" podUID="1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" containerName="istio-proxy" containerID="cri-o://92e3a43feef19c38caf22c3b1fdeb2723f5775a602351d768d9b506b59843e1b" gracePeriod=30
Jul 15 10:55:41.896991 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:41.896958    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:55:43.528987 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:55:43.528959    2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ecc2097_8ed5_4ebc_8f6b_8551348a1e84.slice/crio-conmon-92e3a43feef19c38caf22c3b1fdeb2723f5775a602351d768d9b506b59843e1b.scope\": RecentStats: unable to find data in memory cache]"
Jul 15 10:55:43.529321 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:55:43.529056    2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ecc2097_8ed5_4ebc_8f6b_8551348a1e84.slice/crio-conmon-92e3a43feef19c38caf22c3b1fdeb2723f5775a602351d768d9b506b59843e1b.scope\": RecentStats: unable to find data in memory cache]"
Jul 15 10:55:43.735169 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.735146    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:55:43.837336 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.837273    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-podinfo\") pod \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") "
Jul 15 10:55:43.837336 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.837304    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-workload-socket\") pod \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") "
Jul 15 10:55:43.837336 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.837325    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-workload-certs\") pod \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") "
Jul 15 10:55:43.837571 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.837341    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-token\") pod \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") "
Jul 15 10:55:43.837571 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.837372    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-envoy\") pod \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") "
Jul 15 10:55:43.837571 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.837395    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istiod-ca-cert\") pod \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") "
Jul 15 10:55:43.837571 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.837424    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-data\") pod \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") "
Jul 15 10:55:43.837571 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.837489    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-credential-socket\") pod \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") "
Jul 15 10:55:43.837571 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.837519    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kprg7\" (UniqueName: \"kubernetes.io/projected/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-kube-api-access-kprg7\") pod \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\" (UID: \"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84\") "
Jul 15 10:55:43.837868 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.837585    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" (UID: "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:55:43.837868 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.837683    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" (UID: "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:55:43.837868 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.837759    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-workload-socket\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:55:43.837868 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.837775    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-workload-certs\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:55:43.837868 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.837786    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" (UID: "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:55:43.838139 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.837999    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" (UID: "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:55:43.838549 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.838520    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" (UID: "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:55:43.839703 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.839677    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" (UID: "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 10:55:43.839790 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.839773    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-kube-api-access-kprg7" (OuterVolumeSpecName: "kube-api-access-kprg7") pod "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" (UID: "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84"). InnerVolumeSpecName "kube-api-access-kprg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:55:43.840212 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.840193    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" (UID: "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:55:43.840277 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.840219    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" (UID: "1ecc2097-8ed5-4ebc-8f6b-8551348a1e84"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:55:43.938905 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.938881    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-token\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:55:43.938905 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.938904    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-envoy\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:55:43.939069 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.938916    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istiod-ca-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:55:43.939069 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.938927    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-data\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:55:43.939069 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.938946    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-credential-socket\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:55:43.939069 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.938959    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kprg7\" (UniqueName: \"kubernetes.io/projected/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-kube-api-access-kprg7\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:55:43.939069 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:43.938989    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84-istio-podinfo\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:55:44.307067 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:44.307032    2568 generic.go:356] "Generic (PLEG): container finished" podID="1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" containerID="92e3a43feef19c38caf22c3b1fdeb2723f5775a602351d768d9b506b59843e1b" exitCode=0
Jul 15 10:55:44.307237 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:44.307075    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"
Jul 15 10:55:44.307237 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:44.307102    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495" event={"ID":"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84","Type":"ContainerDied","Data":"92e3a43feef19c38caf22c3b1fdeb2723f5775a602351d768d9b506b59843e1b"}
Jul 15 10:55:44.307237 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:44.307180    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495" event={"ID":"1ecc2097-8ed5-4ebc-8f6b-8551348a1e84","Type":"ContainerDied","Data":"e57a544f1f602f775a748d0dcc964c48815d24ebec42f7c3e019365eee8c21ef"}
Jul 15 10:55:44.307237 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:44.307211    2568 scope.go:117] "RemoveContainer" containerID="92e3a43feef19c38caf22c3b1fdeb2723f5775a602351d768d9b506b59843e1b"
Jul 15 10:55:44.316385 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:44.316370    2568 scope.go:117] "RemoveContainer" containerID="f2b02c613fd2c931131939f0fc0b623d1f36bee874d3b7c9ffa670331239d26f"
Jul 15 10:55:44.324166 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:44.324146    2568 scope.go:117] "RemoveContainer" containerID="92e3a43feef19c38caf22c3b1fdeb2723f5775a602351d768d9b506b59843e1b"
Jul 15 10:55:44.324411 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:55:44.324394    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92e3a43feef19c38caf22c3b1fdeb2723f5775a602351d768d9b506b59843e1b\": container with ID starting with 92e3a43feef19c38caf22c3b1fdeb2723f5775a602351d768d9b506b59843e1b not found: ID does not exist" containerID="92e3a43feef19c38caf22c3b1fdeb2723f5775a602351d768d9b506b59843e1b"
Jul 15 10:55:44.324484 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:44.324416    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92e3a43feef19c38caf22c3b1fdeb2723f5775a602351d768d9b506b59843e1b"} err="failed to get container status \"92e3a43feef19c38caf22c3b1fdeb2723f5775a602351d768d9b506b59843e1b\": rpc error: code = NotFound desc = could not find container \"92e3a43feef19c38caf22c3b1fdeb2723f5775a602351d768d9b506b59843e1b\": container with ID starting with 92e3a43feef19c38caf22c3b1fdeb2723f5775a602351d768d9b506b59843e1b not found: ID does not exist"
Jul 15 10:55:44.324484 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:44.324432    2568 scope.go:117] "RemoveContainer" containerID="f2b02c613fd2c931131939f0fc0b623d1f36bee874d3b7c9ffa670331239d26f"
Jul 15 10:55:44.324638 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:55:44.324624    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2b02c613fd2c931131939f0fc0b623d1f36bee874d3b7c9ffa670331239d26f\": container with ID starting with f2b02c613fd2c931131939f0fc0b623d1f36bee874d3b7c9ffa670331239d26f not found: ID does not exist" containerID="f2b02c613fd2c931131939f0fc0b623d1f36bee874d3b7c9ffa670331239d26f"
Jul 15 10:55:44.324682 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:44.324642    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2b02c613fd2c931131939f0fc0b623d1f36bee874d3b7c9ffa670331239d26f"} err="failed to get container status \"f2b02c613fd2c931131939f0fc0b623d1f36bee874d3b7c9ffa670331239d26f\": rpc error: code = NotFound desc = could not find container \"f2b02c613fd2c931131939f0fc0b623d1f36bee874d3b7c9ffa670331239d26f\": container with ID starting with f2b02c613fd2c931131939f0fc0b623d1f36bee874d3b7c9ffa670331239d26f not found: ID does not exist"
Jul 15 10:55:44.338164 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:44.338138    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"]
Jul 15 10:55:44.344489 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:44.344467    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e595ab4b-openshift-default-66fd99b467-rv495"]
Jul 15 10:55:45.647975 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:45.647938    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" path="/var/lib/kubelet/pods/1ecc2097-8ed5-4ebc-8f6b-8551348a1e84/volumes"
Jul 15 10:55:53.690287 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:55:53.690205    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:56:01.830221 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:01.830189    2568 scope.go:117] "RemoveContainer" containerID="344357ca642ae2319ea4aeed00c17d6922694505ffa2ff8c66fc1c2d166bfeb3"
Jul 15 10:56:35.942556 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:35.942520    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"]
Jul 15 10:56:35.943027 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:35.942840    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" containerName="istio-proxy"
Jul 15 10:56:35.943027 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:35.942852    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" containerName="istio-proxy"
Jul 15 10:56:35.943027 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:35.942868    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92289ae2-b24e-4821-8b86-615a0d1a6424" containerName="revoke-keys"
Jul 15 10:56:35.943027 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:35.942873    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="92289ae2-b24e-4821-8b86-615a0d1a6424" containerName="revoke-keys"
Jul 15 10:56:35.943027 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:35.942886    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc09bb43-081d-4419-90c7-2526c642cbdd" containerName="maas-api"
Jul 15 10:56:35.943027 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:35.942891    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc09bb43-081d-4419-90c7-2526c642cbdd" containerName="maas-api"
Jul 15 10:56:35.943027 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:35.942948    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" containerName="istio-proxy"
Jul 15 10:56:35.943027 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:35.942957    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="92289ae2-b24e-4821-8b86-615a0d1a6424" containerName="revoke-keys"
Jul 15 10:56:35.943027 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:35.942983    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc09bb43-081d-4419-90c7-2526c642cbdd" containerName="maas-api"
Jul 15 10:56:35.945930 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:35.945913    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:35.948864 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:35.948847    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-97bab6-openshift-default-dockercfg-xn5gf\""
Jul 15 10:56:35.959323 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:35.959299    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"]
Jul 15 10:56:36.001040 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.001008    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istiod-ca-cert\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.001163 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.001050    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-envoy\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.001163 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.001077    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-credential-socket\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.001256 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.001161    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hjvx\" (UniqueName: \"kubernetes.io/projected/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-kube-api-access-2hjvx\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.001256 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.001193    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-workload-socket\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.001256 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.001226    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-workload-certs\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.001256 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.001247    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-token\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.001396 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.001283    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-data\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.001396 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.001297    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-podinfo\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.102214 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.102183    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-data\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.102214 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.102216    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-podinfo\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.102414 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.102238    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istiod-ca-cert\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.102414 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.102259    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-envoy\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.102414 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.102277    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-credential-socket\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.102414 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.102297    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hjvx\" (UniqueName: \"kubernetes.io/projected/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-kube-api-access-2hjvx\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.102414 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.102321    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-workload-socket\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.102414 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.102361    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-workload-certs\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.102414 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.102396    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-token\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.102764 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.102652    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-data\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.102764 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.102722    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-workload-socket\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.102764 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.102750    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-credential-socket\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.102891 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.102868    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-workload-certs\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.103135 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.103095    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istiod-ca-cert\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.104682 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.104664    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-envoy\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.104890 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.104872    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-podinfo\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.113046 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.113019    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-token\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.113315 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.113295    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hjvx\" (UniqueName: \"kubernetes.io/projected/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-kube-api-access-2hjvx\") pod \"e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") " pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.256052 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.256027    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:36.406996 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.406950    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"]
Jul 15 10:56:36.408667 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:56:36.408643    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d333726_b646_42a2_9ec4_e3a9c7c4cbfc.slice/crio-e4549b7d1b7c43a660fd5afc8474dc00732aec21c9eea63535ec452891cc8dbf WatchSource:0}: Error finding container e4549b7d1b7c43a660fd5afc8474dc00732aec21c9eea63535ec452891cc8dbf: Status 404 returned error can't find the container with id e4549b7d1b7c43a660fd5afc8474dc00732aec21c9eea63535ec452891cc8dbf
Jul 15 10:56:36.410612 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.410578    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:56:36.410686 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.410652    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:56:36.410686 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.410679    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:56:36.569853 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.569757    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j" event={"ID":"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc","Type":"ContainerStarted","Data":"c5d5eb04d06c5ee9b2a3b075b3e0b5039bda4ea3a921a5787394577eef3154a3"}
Jul 15 10:56:36.569853 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.569808    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j" event={"ID":"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc","Type":"ContainerStarted","Data":"e4549b7d1b7c43a660fd5afc8474dc00732aec21c9eea63535ec452891cc8dbf"}
Jul 15 10:56:36.603099 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:36.603037    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j" podStartSLOduration=1.603016159 podStartE2EDuration="1.603016159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:56:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:56:36.59996022 +0000 UTC m=+2195.419602093" watchObservedRunningTime="2026-07-15 10:56:36.603016159 +0000 UTC m=+2195.422658034"
Jul 15 10:56:37.256974 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:37.256945    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:37.261440 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:37.261413    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:37.575846 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:37.575781    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:37.576735 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:37.576718    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:38.760451 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.760420    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"]
Jul 15 10:56:38.760892 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.760877    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" containerName="istio-proxy"
Jul 15 10:56:38.760935 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.760896    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" containerName="istio-proxy"
Jul 15 10:56:38.760982 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.760972    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ecc2097-8ed5-4ebc-8f6b-8551348a1e84" containerName="istio-proxy"
Jul 15 10:56:38.764403 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.764387    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"
Jul 15 10:56:38.767380 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.767354    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 10:56:38.767527 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.767377    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-97bab6-serving-cert\""
Jul 15 10:56:38.767527 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.767403    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zk7pv\""
Jul 15 10:56:38.768473 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.768457    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 10:56:38.776052 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.776027    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"]
Jul 15 10:56:38.822366 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.822341    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/002db606-2100-4ad7-980e-3e451f36c08e-maas-api-tls\") pod \"maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx\" (UID: \"002db606-2100-4ad7-980e-3e451f36c08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"
Jul 15 10:56:38.822486 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.822381    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66qmk\" (UniqueName: \"kubernetes.io/projected/002db606-2100-4ad7-980e-3e451f36c08e-kube-api-access-66qmk\") pod \"maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx\" (UID: \"002db606-2100-4ad7-980e-3e451f36c08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"
Jul 15 10:56:38.822486 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.822409    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/002db606-2100-4ad7-980e-3e451f36c08e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx\" (UID: \"002db606-2100-4ad7-980e-3e451f36c08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"
Jul 15 10:56:38.923014 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.922983    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66qmk\" (UniqueName: \"kubernetes.io/projected/002db606-2100-4ad7-980e-3e451f36c08e-kube-api-access-66qmk\") pod \"maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx\" (UID: \"002db606-2100-4ad7-980e-3e451f36c08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"
Jul 15 10:56:38.923183 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.923029    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/002db606-2100-4ad7-980e-3e451f36c08e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx\" (UID: \"002db606-2100-4ad7-980e-3e451f36c08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"
Jul 15 10:56:38.923183 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.923074    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/002db606-2100-4ad7-980e-3e451f36c08e-maas-api-tls\") pod \"maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx\" (UID: \"002db606-2100-4ad7-980e-3e451f36c08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"
Jul 15 10:56:38.923328 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:56:38.923185    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-serving-cert: secret "maas-api-e2e-inf-a-97bab6-serving-cert" not found
Jul 15 10:56:38.923328 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:56:38.923241    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002db606-2100-4ad7-980e-3e451f36c08e-maas-api-tls podName:002db606-2100-4ad7-980e-3e451f36c08e nodeName:}" failed. No retries permitted until 2026-07-15 10:56:39.423226278 +0000 UTC m=+2198.242868128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/002db606-2100-4ad7-980e-3e451f36c08e-maas-api-tls") pod "maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx" (UID: "002db606-2100-4ad7-980e-3e451f36c08e") : secret "maas-api-e2e-inf-a-97bab6-serving-cert" not found
Jul 15 10:56:38.923764 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.923740    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/002db606-2100-4ad7-980e-3e451f36c08e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx\" (UID: \"002db606-2100-4ad7-980e-3e451f36c08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"
Jul 15 10:56:38.935545 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:38.935525    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66qmk\" (UniqueName: \"kubernetes.io/projected/002db606-2100-4ad7-980e-3e451f36c08e-kube-api-access-66qmk\") pod \"maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx\" (UID: \"002db606-2100-4ad7-980e-3e451f36c08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"
Jul 15 10:56:39.427804 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:39.427771    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/002db606-2100-4ad7-980e-3e451f36c08e-maas-api-tls\") pod \"maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx\" (UID: \"002db606-2100-4ad7-980e-3e451f36c08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"
Jul 15 10:56:39.430320 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:39.430292    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/002db606-2100-4ad7-980e-3e451f36c08e-maas-api-tls\") pod \"maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx\" (UID: \"002db606-2100-4ad7-980e-3e451f36c08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"
Jul 15 10:56:39.675247 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:39.675213    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"
Jul 15 10:56:39.814179 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:39.814152    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"]
Jul 15 10:56:39.816077 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:56:39.816037    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002db606_2100_4ad7_980e_3e451f36c08e.slice/crio-d4c5a252ecd959dbb6fd6ae920aae63b5287663d27c7e0f1762cca987fc19eda WatchSource:0}: Error finding container d4c5a252ecd959dbb6fd6ae920aae63b5287663d27c7e0f1762cca987fc19eda: Status 404 returned error can't find the container with id d4c5a252ecd959dbb6fd6ae920aae63b5287663d27c7e0f1762cca987fc19eda
Jul 15 10:56:40.593563 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:40.593476    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx" event={"ID":"002db606-2100-4ad7-980e-3e451f36c08e","Type":"ContainerStarted","Data":"b6738cd1e7aa075448471ff86c4c1445eb35312140a2ff7b978e4be16cbc91d9"}
Jul 15 10:56:40.593563 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:40.593528    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx" event={"ID":"002db606-2100-4ad7-980e-3e451f36c08e","Type":"ContainerStarted","Data":"d4c5a252ecd959dbb6fd6ae920aae63b5287663d27c7e0f1762cca987fc19eda"}
Jul 15 10:56:40.593749 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:40.593619    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"
Jul 15 10:56:40.614736 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:40.614691    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx" podStartSLOduration=2.162486131 podStartE2EDuration="2.614671933s" totalImagesPullingTime="452.185802ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:56:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:56:40.614538718 +0000 UTC m=+2199.434180599" watchObservedRunningTime="2026-07-15 10:56:40.614671933 +0000 UTC m=+2199.434313806"
Jul 15 10:56:43.846217 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:43.846184    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"]
Jul 15 10:56:43.849812 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:43.849794    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:43.852732 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:43.852705    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a47e9a-openshift-default-dockercfg-6htc8\""
Jul 15 10:56:43.864958 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:43.864934    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"]
Jul 15 10:56:43.959805 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:43.959771    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-workload-certs\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:43.959968 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:43.959822    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-data\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:43.959968 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:43.959883    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istiod-ca-cert\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:43.960132 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:43.960004    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vnhv\" (UniqueName: \"kubernetes.io/projected/3c50c59d-6cdd-49ed-b2ad-1ad661314777-kube-api-access-4vnhv\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:43.960132 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:43.960055    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-envoy\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:43.960132 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:43.960105    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-podinfo\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:43.960279 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:43.960151    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-credential-socket\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:43.960279 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:43.960186    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-workload-socket\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:43.960279 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:43.960211    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-token\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.061415 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.061386    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-data\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.061577 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.061425    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istiod-ca-cert\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.061577 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.061460    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vnhv\" (UniqueName: \"kubernetes.io/projected/3c50c59d-6cdd-49ed-b2ad-1ad661314777-kube-api-access-4vnhv\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.061577 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.061481    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-envoy\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.061577 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.061509    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-podinfo\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.061577 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.061534    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-credential-socket\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.061577 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.061564    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-workload-socket\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.061943 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.061587    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-token\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.061943 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.061621    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-workload-certs\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.061943 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.061833    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-data\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.062104 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.062084    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-credential-socket\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.062221 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.062201    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istiod-ca-cert\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.062290 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.062247    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-workload-certs\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.062438 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.062333    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-workload-socket\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.064015 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.063997    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-envoy\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.064158 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.064140    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-podinfo\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.075861 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.075834    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vnhv\" (UniqueName: \"kubernetes.io/projected/3c50c59d-6cdd-49ed-b2ad-1ad661314777-kube-api-access-4vnhv\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.075971 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.075873    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-token\") pod \"e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") " pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.159757 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.159698    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:44.306260 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:56:44.306222    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c50c59d_6cdd_49ed_b2ad_1ad661314777.slice/crio-7e6107d812fb2a50f43d534055d67362b72ecf28514564291de231af0a61bae1 WatchSource:0}: Error finding container 7e6107d812fb2a50f43d534055d67362b72ecf28514564291de231af0a61bae1: Status 404 returned error can't find the container with id 7e6107d812fb2a50f43d534055d67362b72ecf28514564291de231af0a61bae1
Jul 15 10:56:44.306260 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.306236    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"]
Jul 15 10:56:44.308313 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.308287    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:56:44.308406 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.308348    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:56:44.308406 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.308377    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:56:44.615602 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.615560    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt" event={"ID":"3c50c59d-6cdd-49ed-b2ad-1ad661314777","Type":"ContainerStarted","Data":"4c17774d7c22f4693c6b2548da221c3167fc9739ad076c66b4ce90b0ad20bcca"}
Jul 15 10:56:44.615766 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.615628    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt" event={"ID":"3c50c59d-6cdd-49ed-b2ad-1ad661314777","Type":"ContainerStarted","Data":"7e6107d812fb2a50f43d534055d67362b72ecf28514564291de231af0a61bae1"}
Jul 15 10:56:44.644838 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.644795    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt" podStartSLOduration=1.6447801260000001 podStartE2EDuration="1.644780126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:56:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:56:44.64387275 +0000 UTC m=+2203.463514622" watchObservedRunningTime="2026-07-15 10:56:44.644780126 +0000 UTC m=+2203.464421997"
Jul 15 10:56:44.978450 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:44.978374    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:56:45.160159 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:45.160091    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:45.164773 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:45.164737    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:45.621247 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:45.621218    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:45.622075 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:45.622058    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:56:46.604905 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:46.604878    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"
Jul 15 10:56:46.894264 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:46.894185    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"]
Jul 15 10:56:46.898451 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:46.898428    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"
Jul 15 10:56:46.903423 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:46.903404    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-a47e9a-serving-cert\""
Jul 15 10:56:46.915413 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:46.915390    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"]
Jul 15 10:56:46.990057 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:46.990026    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fbf962d-8704-44a2-b8e7-b6460b4f5152-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt\" (UID: \"6fbf962d-8704-44a2-b8e7-b6460b4f5152\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"
Jul 15 10:56:46.990245 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:46.990072    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwnsq\" (UniqueName: \"kubernetes.io/projected/6fbf962d-8704-44a2-b8e7-b6460b4f5152-kube-api-access-mwnsq\") pod \"maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt\" (UID: \"6fbf962d-8704-44a2-b8e7-b6460b4f5152\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"
Jul 15 10:56:46.990245 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:46.990097    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fbf962d-8704-44a2-b8e7-b6460b4f5152-maas-api-tls\") pod \"maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt\" (UID: \"6fbf962d-8704-44a2-b8e7-b6460b4f5152\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"
Jul 15 10:56:47.090614 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:47.090583    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fbf962d-8704-44a2-b8e7-b6460b4f5152-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt\" (UID: \"6fbf962d-8704-44a2-b8e7-b6460b4f5152\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"
Jul 15 10:56:47.090785 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:47.090638    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwnsq\" (UniqueName: \"kubernetes.io/projected/6fbf962d-8704-44a2-b8e7-b6460b4f5152-kube-api-access-mwnsq\") pod \"maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt\" (UID: \"6fbf962d-8704-44a2-b8e7-b6460b4f5152\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"
Jul 15 10:56:47.090785 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:47.090671    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fbf962d-8704-44a2-b8e7-b6460b4f5152-maas-api-tls\") pod \"maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt\" (UID: \"6fbf962d-8704-44a2-b8e7-b6460b4f5152\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"
Jul 15 10:56:47.091271 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:47.091245    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fbf962d-8704-44a2-b8e7-b6460b4f5152-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt\" (UID: \"6fbf962d-8704-44a2-b8e7-b6460b4f5152\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"
Jul 15 10:56:47.093192 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:47.093168    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fbf962d-8704-44a2-b8e7-b6460b4f5152-maas-api-tls\") pod \"maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt\" (UID: \"6fbf962d-8704-44a2-b8e7-b6460b4f5152\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"
Jul 15 10:56:47.102416 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:47.102389    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwnsq\" (UniqueName: \"kubernetes.io/projected/6fbf962d-8704-44a2-b8e7-b6460b4f5152-kube-api-access-mwnsq\") pod \"maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt\" (UID: \"6fbf962d-8704-44a2-b8e7-b6460b4f5152\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"
Jul 15 10:56:47.208922 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:47.208843    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"
Jul 15 10:56:47.392527 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:47.392496    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"]
Jul 15 10:56:47.393301 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:56:47.393269    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fbf962d_8704_44a2_b8e7_b6460b4f5152.slice/crio-3f03c3613577d1082dc26d8261795108e475a4caf5a4472707520efcc359ea9e WatchSource:0}: Error finding container 3f03c3613577d1082dc26d8261795108e475a4caf5a4472707520efcc359ea9e: Status 404 returned error can't find the container with id 3f03c3613577d1082dc26d8261795108e475a4caf5a4472707520efcc359ea9e
Jul 15 10:56:47.633407 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:47.633366    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt" event={"ID":"6fbf962d-8704-44a2-b8e7-b6460b4f5152","Type":"ContainerStarted","Data":"3f03c3613577d1082dc26d8261795108e475a4caf5a4472707520efcc359ea9e"}
Jul 15 10:56:48.640433 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:48.640395    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt" event={"ID":"6fbf962d-8704-44a2-b8e7-b6460b4f5152","Type":"ContainerStarted","Data":"6ad06cce9b9b4e0cc82222242772fa2a6f58957768be8472f9033e3aad71d51b"}
Jul 15 10:56:48.640780 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:48.640539    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"
Jul 15 10:56:48.670921 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:48.670864    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt" podStartSLOduration=1.852769516 podStartE2EDuration="2.67084503s" totalImagesPullingTime="818.075514ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:56:48.66627286 +0000 UTC m=+2207.485914733" watchObservedRunningTime="2026-07-15 10:56:48.67084503 +0000 UTC m=+2207.490486902"
Jul 15 10:56:53.160296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:53.159181    2568 patch_prober.go:28] interesting pod/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": read tcp 10.134.0.2:43200->10.134.0.56:15021: read: connection reset by peer" start-of-body=
Jul 15 10:56:53.160296 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:53.159245    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j" podUID="1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": read tcp 10.134.0.2:43200->10.134.0.56:15021: read: connection reset by peer"
Jul 15 10:56:53.679940 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:53.679893    2568 generic.go:356] "Generic (PLEG): container finished" podID="1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" containerID="c5d5eb04d06c5ee9b2a3b075b3e0b5039bda4ea3a921a5787394577eef3154a3" exitCode=0
Jul 15 10:56:53.680174 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:53.679955    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j" event={"ID":"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc","Type":"ContainerDied","Data":"c5d5eb04d06c5ee9b2a3b075b3e0b5039bda4ea3a921a5787394577eef3154a3"}
Jul 15 10:56:53.680787 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:53.680763    2568 scope.go:117] "RemoveContainer" containerID="c5d5eb04d06c5ee9b2a3b075b3e0b5039bda4ea3a921a5787394577eef3154a3"
Jul 15 10:56:53.681979 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:53.681943    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:56:53.682063 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:53.682035    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:56:53.682139 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:53.682083    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:56:54.652158 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:54.652106    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"
Jul 15 10:56:54.690822 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:54.690784    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j" event={"ID":"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc","Type":"ContainerStarted","Data":"cbfa7e5fda08b0b5b4f023ef9c2b7c1272471a65dbf22d3d99fa986a7d2c4515"}
Jul 15 10:56:55.256707 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:55.256682    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:56:55.256897 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:55.256870    2568 patch_prober.go:28] interesting pod/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 15 10:56:55.256955 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:55.256932    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j" podUID="1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 15 10:56:56.256518 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:56.256480    2568 patch_prober.go:28] interesting pod/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 15 10:56:56.256914 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:56.256546    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j" podUID="1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 15 10:56:56.507830 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:56.507719    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:56:57.256998 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:57.256965    2568 patch_prober.go:28] interesting pod/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 15 10:56:57.257482 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:57.257015    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j" podUID="1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 15 10:56:58.256884 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:58.256847    2568 patch_prober.go:28] interesting pod/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 15 10:56:58.257053 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:58.256917    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j" podUID="1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 15 10:56:58.715352 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:58.715248    2568 generic.go:356] "Generic (PLEG): container finished" podID="3c50c59d-6cdd-49ed-b2ad-1ad661314777" containerID="4c17774d7c22f4693c6b2548da221c3167fc9739ad076c66b4ce90b0ad20bcca" exitCode=0
Jul 15 10:56:58.715352 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:58.715325    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt" event={"ID":"3c50c59d-6cdd-49ed-b2ad-1ad661314777","Type":"ContainerDied","Data":"4c17774d7c22f4693c6b2548da221c3167fc9739ad076c66b4ce90b0ad20bcca"}
Jul 15 10:56:58.715700 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:58.715685    2568 scope.go:117] "RemoveContainer" containerID="4c17774d7c22f4693c6b2548da221c3167fc9739ad076c66b4ce90b0ad20bcca"
Jul 15 10:56:58.716653 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:58.716630    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:56:58.716706 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:58.716690    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:56:58.716744 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:58.716721    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:56:59.257051 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:59.257016    2568 patch_prober.go:28] interesting pod/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 15 10:56:59.257551 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:59.257065    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j" podUID="1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 15 10:56:59.722393 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:56:59.722305    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt" event={"ID":"3c50c59d-6cdd-49ed-b2ad-1ad661314777","Type":"ContainerStarted","Data":"094904ce9f5ace10da3d654b90f9bf8019d21c6ca6f783f7cbba34c206e3b4dd"}
Jul 15 10:57:00.160857 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:00.160818    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:57:00.162338 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:00.162308    2568 patch_prober.go:28] interesting pod/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 15 10:57:00.162588 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:00.162547    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt" podUID="3c50c59d-6cdd-49ed-b2ad-1ad661314777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 15 10:57:00.267788 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:00.267749    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:57:00.268794 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:00.268746    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:57:00.274167 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:00.274142    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:57:00.621174 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:00.621139    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:57:01.160425 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:01.160382    2568 patch_prober.go:28] interesting pod/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 15 10:57:01.160627 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:01.160462    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt" podUID="3c50c59d-6cdd-49ed-b2ad-1ad661314777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 15 10:57:02.160233 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:02.160193    2568 patch_prober.go:28] interesting pod/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 15 10:57:02.160709 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:02.160255    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt" podUID="3c50c59d-6cdd-49ed-b2ad-1ad661314777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 15 10:57:03.160635 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:03.160598    2568 patch_prober.go:28] interesting pod/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 15 10:57:03.161265 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:03.161223    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt" podUID="3c50c59d-6cdd-49ed-b2ad-1ad661314777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 15 10:57:04.161092 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:04.161037    2568 patch_prober.go:28] interesting pod/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 15 10:57:04.161580 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:04.161133    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt" podUID="3c50c59d-6cdd-49ed-b2ad-1ad661314777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 15 10:57:05.164368 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:05.164338    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:57:05.165416 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:05.165396    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:57:07.091842 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:07.091807    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:57:29.684584 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:29.684496    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:57:43.289702 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:43.289669    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:57:55.297728 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:55.297695    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:57:56.798412 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:56.798379    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"]
Jul 15 10:57:56.798879 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:56.798604    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx" podUID="002db606-2100-4ad7-980e-3e451f36c08e" containerName="maas-api" containerID="cri-o://b6738cd1e7aa075448471ff86c4c1445eb35312140a2ff7b978e4be16cbc91d9" gracePeriod=30
Jul 15 10:57:57.012252 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:57.012220    2568 generic.go:356] "Generic (PLEG): container finished" podID="002db606-2100-4ad7-980e-3e451f36c08e" containerID="b6738cd1e7aa075448471ff86c4c1445eb35312140a2ff7b978e4be16cbc91d9" exitCode=0
Jul 15 10:57:57.012413 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:57.012287    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx" event={"ID":"002db606-2100-4ad7-980e-3e451f36c08e","Type":"ContainerDied","Data":"b6738cd1e7aa075448471ff86c4c1445eb35312140a2ff7b978e4be16cbc91d9"}
Jul 15 10:57:57.048204 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:57.048181    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"
Jul 15 10:57:57.145591 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:57.145524    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/002db606-2100-4ad7-980e-3e451f36c08e-maas-api-tls\") pod \"002db606-2100-4ad7-980e-3e451f36c08e\" (UID: \"002db606-2100-4ad7-980e-3e451f36c08e\") "
Jul 15 10:57:57.145591 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:57.145558    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/002db606-2100-4ad7-980e-3e451f36c08e-openshift-service-ca\") pod \"002db606-2100-4ad7-980e-3e451f36c08e\" (UID: \"002db606-2100-4ad7-980e-3e451f36c08e\") "
Jul 15 10:57:57.145769 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:57.145657    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66qmk\" (UniqueName: \"kubernetes.io/projected/002db606-2100-4ad7-980e-3e451f36c08e-kube-api-access-66qmk\") pod \"002db606-2100-4ad7-980e-3e451f36c08e\" (UID: \"002db606-2100-4ad7-980e-3e451f36c08e\") "
Jul 15 10:57:57.145938 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:57.145916    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/002db606-2100-4ad7-980e-3e451f36c08e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "002db606-2100-4ad7-980e-3e451f36c08e" (UID: "002db606-2100-4ad7-980e-3e451f36c08e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:57:57.147694 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:57.147671    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/002db606-2100-4ad7-980e-3e451f36c08e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "002db606-2100-4ad7-980e-3e451f36c08e" (UID: "002db606-2100-4ad7-980e-3e451f36c08e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:57:57.147807 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:57.147784    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/002db606-2100-4ad7-980e-3e451f36c08e-kube-api-access-66qmk" (OuterVolumeSpecName: "kube-api-access-66qmk") pod "002db606-2100-4ad7-980e-3e451f36c08e" (UID: "002db606-2100-4ad7-980e-3e451f36c08e"). InnerVolumeSpecName "kube-api-access-66qmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:57:57.246207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:57.246180    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/002db606-2100-4ad7-980e-3e451f36c08e-maas-api-tls\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:57:57.246207 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:57.246202    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/002db606-2100-4ad7-980e-3e451f36c08e-openshift-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:57:57.246341 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:57.246212    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66qmk\" (UniqueName: \"kubernetes.io/projected/002db606-2100-4ad7-980e-3e451f36c08e-kube-api-access-66qmk\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:57:58.018295 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:58.018269    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx" event={"ID":"002db606-2100-4ad7-980e-3e451f36c08e","Type":"ContainerDied","Data":"d4c5a252ecd959dbb6fd6ae920aae63b5287663d27c7e0f1762cca987fc19eda"}
Jul 15 10:57:58.018638 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:58.018298    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"
Jul 15 10:57:58.018638 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:58.018317    2568 scope.go:117] "RemoveContainer" containerID="b6738cd1e7aa075448471ff86c4c1445eb35312140a2ff7b978e4be16cbc91d9"
Jul 15 10:57:58.039244 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:58.039221    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"]
Jul 15 10:57:58.044275 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:58.044251    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-97bab6-869c644b67-sx8mx"]
Jul 15 10:57:59.648125 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:57:59.648077    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="002db606-2100-4ad7-980e-3e451f36c08e" path="/var/lib/kubelet/pods/002db606-2100-4ad7-980e-3e451f36c08e/volumes"
Jul 15 10:58:04.884672 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:04.884641    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:58:12.168559 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:12.168527    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"]
Jul 15 10:58:12.169022 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:12.168732    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j" podUID="1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" containerName="istio-proxy" containerID="cri-o://cbfa7e5fda08b0b5b4f023ef9c2b7c1272471a65dbf22d3d99fa986a7d2c4515" gracePeriod=30
Jul 15 10:58:15.271004 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:15.270947    2568 patch_prober.go:28] interesting pod/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 10:58:15.271425 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:15.271030    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j" podUID="1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:58:17.420128 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.420084    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:58:17.507126 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.507087    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-envoy\") pod \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") "
Jul 15 10:58:17.507270 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.507149    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-credential-socket\") pod \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") "
Jul 15 10:58:17.507270 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.507170    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-podinfo\") pod \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") "
Jul 15 10:58:17.507270 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.507190    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-data\") pod \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") "
Jul 15 10:58:17.507270 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.507226    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hjvx\" (UniqueName: \"kubernetes.io/projected/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-kube-api-access-2hjvx\") pod \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") "
Jul 15 10:58:17.507270 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.507257    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-workload-socket\") pod \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") "
Jul 15 10:58:17.507541 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.507281    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-workload-certs\") pod \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") "
Jul 15 10:58:17.507541 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.507316    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-token\") pod \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") "
Jul 15 10:58:17.507541 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.507356    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istiod-ca-cert\") pod \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\" (UID: \"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc\") "
Jul 15 10:58:17.507697 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.507512    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" (UID: "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:58:17.507697 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.507579    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" (UID: "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:58:17.507697 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.507636    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-workload-socket\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:17.508018 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.507698    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" (UID: "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:58:17.508018 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.507854    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" (UID: "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:58:17.508395 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.508361    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" (UID: "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:58:17.509464 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.509434    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" (UID: "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:58:17.509563 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.509485    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" (UID: "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 10:58:17.509563 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.509534    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" (UID: "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:58:17.509563 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.509553    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-kube-api-access-2hjvx" (OuterVolumeSpecName: "kube-api-access-2hjvx") pod "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" (UID: "1d333726-b646-42a2-9ec4-e3a9c7c4cbfc"). InnerVolumeSpecName "kube-api-access-2hjvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:58:17.608589 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.608559    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-workload-certs\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:17.608589 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.608589    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-token\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:17.608589 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.608598    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istiod-ca-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:17.608748 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.608606    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-envoy\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:17.608748 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.608613    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-credential-socket\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:17.608748 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.608622    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-podinfo\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:17.608748 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.608630    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-istio-data\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:17.608748 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:17.608638    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hjvx\" (UniqueName: \"kubernetes.io/projected/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc-kube-api-access-2hjvx\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:18.123026 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:18.122994    2568 generic.go:356] "Generic (PLEG): container finished" podID="1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" containerID="cbfa7e5fda08b0b5b4f023ef9c2b7c1272471a65dbf22d3d99fa986a7d2c4515" exitCode=0
Jul 15 10:58:18.123200 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:18.123039    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"
Jul 15 10:58:18.123200 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:18.123049    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j" event={"ID":"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc","Type":"ContainerDied","Data":"cbfa7e5fda08b0b5b4f023ef9c2b7c1272471a65dbf22d3d99fa986a7d2c4515"}
Jul 15 10:58:18.123200 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:18.123093    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j" event={"ID":"1d333726-b646-42a2-9ec4-e3a9c7c4cbfc","Type":"ContainerDied","Data":"e4549b7d1b7c43a660fd5afc8474dc00732aec21c9eea63535ec452891cc8dbf"}
Jul 15 10:58:18.123200 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:18.123137    2568 scope.go:117] "RemoveContainer" containerID="cbfa7e5fda08b0b5b4f023ef9c2b7c1272471a65dbf22d3d99fa986a7d2c4515"
Jul 15 10:58:18.131687 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:18.131667    2568 scope.go:117] "RemoveContainer" containerID="c5d5eb04d06c5ee9b2a3b075b3e0b5039bda4ea3a921a5787394577eef3154a3"
Jul 15 10:58:18.139834 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:18.139818    2568 scope.go:117] "RemoveContainer" containerID="cbfa7e5fda08b0b5b4f023ef9c2b7c1272471a65dbf22d3d99fa986a7d2c4515"
Jul 15 10:58:18.140099 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:58:18.140082    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbfa7e5fda08b0b5b4f023ef9c2b7c1272471a65dbf22d3d99fa986a7d2c4515\": container with ID starting with cbfa7e5fda08b0b5b4f023ef9c2b7c1272471a65dbf22d3d99fa986a7d2c4515 not found: ID does not exist" containerID="cbfa7e5fda08b0b5b4f023ef9c2b7c1272471a65dbf22d3d99fa986a7d2c4515"
Jul 15 10:58:18.140171 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:18.140106    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbfa7e5fda08b0b5b4f023ef9c2b7c1272471a65dbf22d3d99fa986a7d2c4515"} err="failed to get container status \"cbfa7e5fda08b0b5b4f023ef9c2b7c1272471a65dbf22d3d99fa986a7d2c4515\": rpc error: code = NotFound desc = could not find container \"cbfa7e5fda08b0b5b4f023ef9c2b7c1272471a65dbf22d3d99fa986a7d2c4515\": container with ID starting with cbfa7e5fda08b0b5b4f023ef9c2b7c1272471a65dbf22d3d99fa986a7d2c4515 not found: ID does not exist"
Jul 15 10:58:18.140171 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:18.140139    2568 scope.go:117] "RemoveContainer" containerID="c5d5eb04d06c5ee9b2a3b075b3e0b5039bda4ea3a921a5787394577eef3154a3"
Jul 15 10:58:18.140374 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:58:18.140359    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5d5eb04d06c5ee9b2a3b075b3e0b5039bda4ea3a921a5787394577eef3154a3\": container with ID starting with c5d5eb04d06c5ee9b2a3b075b3e0b5039bda4ea3a921a5787394577eef3154a3 not found: ID does not exist" containerID="c5d5eb04d06c5ee9b2a3b075b3e0b5039bda4ea3a921a5787394577eef3154a3"
Jul 15 10:58:18.140416 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:18.140379    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d5eb04d06c5ee9b2a3b075b3e0b5039bda4ea3a921a5787394577eef3154a3"} err="failed to get container status \"c5d5eb04d06c5ee9b2a3b075b3e0b5039bda4ea3a921a5787394577eef3154a3\": rpc error: code = NotFound desc = could not find container \"c5d5eb04d06c5ee9b2a3b075b3e0b5039bda4ea3a921a5787394577eef3154a3\": container with ID starting with c5d5eb04d06c5ee9b2a3b075b3e0b5039bda4ea3a921a5787394577eef3154a3 not found: ID does not exist"
Jul 15 10:58:18.144635 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:18.144612    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"]
Jul 15 10:58:18.149727 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:18.149704    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-97bab6-openshift-default-f7f8c9947-rkd9j"]
Jul 15 10:58:19.646897 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:19.646854    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" path="/var/lib/kubelet/pods/1d333726-b646-42a2-9ec4-e3a9c7c4cbfc/volumes"
Jul 15 10:58:23.272833 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:23.272798    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"]
Jul 15 10:58:23.273318 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:23.273012    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt" podUID="6fbf962d-8704-44a2-b8e7-b6460b4f5152" containerName="maas-api" containerID="cri-o://6ad06cce9b9b4e0cc82222242772fa2a6f58957768be8472f9033e3aad71d51b" gracePeriod=30
Jul 15 10:58:23.531358 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:23.531306    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"
Jul 15 10:58:23.659619 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:23.659593    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fbf962d-8704-44a2-b8e7-b6460b4f5152-maas-api-tls\") pod \"6fbf962d-8704-44a2-b8e7-b6460b4f5152\" (UID: \"6fbf962d-8704-44a2-b8e7-b6460b4f5152\") "
Jul 15 10:58:23.659740 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:23.659639    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fbf962d-8704-44a2-b8e7-b6460b4f5152-openshift-service-ca\") pod \"6fbf962d-8704-44a2-b8e7-b6460b4f5152\" (UID: \"6fbf962d-8704-44a2-b8e7-b6460b4f5152\") "
Jul 15 10:58:23.659740 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:23.659692    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwnsq\" (UniqueName: \"kubernetes.io/projected/6fbf962d-8704-44a2-b8e7-b6460b4f5152-kube-api-access-mwnsq\") pod \"6fbf962d-8704-44a2-b8e7-b6460b4f5152\" (UID: \"6fbf962d-8704-44a2-b8e7-b6460b4f5152\") "
Jul 15 10:58:23.660004 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:23.659979    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fbf962d-8704-44a2-b8e7-b6460b4f5152-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6fbf962d-8704-44a2-b8e7-b6460b4f5152" (UID: "6fbf962d-8704-44a2-b8e7-b6460b4f5152"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:58:23.661850 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:23.661828    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fbf962d-8704-44a2-b8e7-b6460b4f5152-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6fbf962d-8704-44a2-b8e7-b6460b4f5152" (UID: "6fbf962d-8704-44a2-b8e7-b6460b4f5152"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:58:23.661850 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:23.661833    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fbf962d-8704-44a2-b8e7-b6460b4f5152-kube-api-access-mwnsq" (OuterVolumeSpecName: "kube-api-access-mwnsq") pod "6fbf962d-8704-44a2-b8e7-b6460b4f5152" (UID: "6fbf962d-8704-44a2-b8e7-b6460b4f5152"). InnerVolumeSpecName "kube-api-access-mwnsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:58:23.760920 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:23.760901    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwnsq\" (UniqueName: \"kubernetes.io/projected/6fbf962d-8704-44a2-b8e7-b6460b4f5152-kube-api-access-mwnsq\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:23.760920 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:23.760921    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fbf962d-8704-44a2-b8e7-b6460b4f5152-maas-api-tls\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:23.761043 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:23.760930    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fbf962d-8704-44a2-b8e7-b6460b4f5152-openshift-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:24.159448 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:24.159416    2568 generic.go:356] "Generic (PLEG): container finished" podID="6fbf962d-8704-44a2-b8e7-b6460b4f5152" containerID="6ad06cce9b9b4e0cc82222242772fa2a6f58957768be8472f9033e3aad71d51b" exitCode=0
Jul 15 10:58:24.159601 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:24.159460    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"
Jul 15 10:58:24.159601 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:24.159493    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt" event={"ID":"6fbf962d-8704-44a2-b8e7-b6460b4f5152","Type":"ContainerDied","Data":"6ad06cce9b9b4e0cc82222242772fa2a6f58957768be8472f9033e3aad71d51b"}
Jul 15 10:58:24.159601 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:24.159536    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt" event={"ID":"6fbf962d-8704-44a2-b8e7-b6460b4f5152","Type":"ContainerDied","Data":"3f03c3613577d1082dc26d8261795108e475a4caf5a4472707520efcc359ea9e"}
Jul 15 10:58:24.159601 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:24.159562    2568 scope.go:117] "RemoveContainer" containerID="6ad06cce9b9b4e0cc82222242772fa2a6f58957768be8472f9033e3aad71d51b"
Jul 15 10:58:24.169479 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:24.169460    2568 scope.go:117] "RemoveContainer" containerID="6ad06cce9b9b4e0cc82222242772fa2a6f58957768be8472f9033e3aad71d51b"
Jul 15 10:58:24.169722 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:58:24.169705    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ad06cce9b9b4e0cc82222242772fa2a6f58957768be8472f9033e3aad71d51b\": container with ID starting with 6ad06cce9b9b4e0cc82222242772fa2a6f58957768be8472f9033e3aad71d51b not found: ID does not exist" containerID="6ad06cce9b9b4e0cc82222242772fa2a6f58957768be8472f9033e3aad71d51b"
Jul 15 10:58:24.169767 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:24.169729    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ad06cce9b9b4e0cc82222242772fa2a6f58957768be8472f9033e3aad71d51b"} err="failed to get container status \"6ad06cce9b9b4e0cc82222242772fa2a6f58957768be8472f9033e3aad71d51b\": rpc error: code = NotFound desc = could not find container \"6ad06cce9b9b4e0cc82222242772fa2a6f58957768be8472f9033e3aad71d51b\": container with ID starting with 6ad06cce9b9b4e0cc82222242772fa2a6f58957768be8472f9033e3aad71d51b not found: ID does not exist"
Jul 15 10:58:24.193290 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:24.193267    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"]
Jul 15 10:58:24.198042 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:24.198021    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a47e9a-7bf8d8fc86-pmlqt"]
Jul 15 10:58:25.647418 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:25.647389    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fbf962d-8704-44a2-b8e7-b6460b4f5152" path="/var/lib/kubelet/pods/6fbf962d-8704-44a2-b8e7-b6460b4f5152/volumes"
Jul 15 10:58:26.286605 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:26.286572    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:58:38.436651 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:38.436617    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"]
Jul 15 10:58:38.437158 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:38.436819    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt" podUID="3c50c59d-6cdd-49ed-b2ad-1ad661314777" containerName="istio-proxy" containerID="cri-o://094904ce9f5ace10da3d654b90f9bf8019d21c6ca6f783f7cbba34c206e3b4dd" gracePeriod=30
Jul 15 10:58:39.386912 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.386878    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"]
Jul 15 10:58:39.387313 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.387296    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fbf962d-8704-44a2-b8e7-b6460b4f5152" containerName="maas-api"
Jul 15 10:58:39.387412 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.387316    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fbf962d-8704-44a2-b8e7-b6460b4f5152" containerName="maas-api"
Jul 15 10:58:39.387412 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.387335    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" containerName="istio-proxy"
Jul 15 10:58:39.387412 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.387343    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" containerName="istio-proxy"
Jul 15 10:58:39.387412 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.387355    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" containerName="istio-proxy"
Jul 15 10:58:39.387412 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.387363    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" containerName="istio-proxy"
Jul 15 10:58:39.387412 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.387376    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="002db606-2100-4ad7-980e-3e451f36c08e" containerName="maas-api"
Jul 15 10:58:39.387412 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.387387    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="002db606-2100-4ad7-980e-3e451f36c08e" containerName="maas-api"
Jul 15 10:58:39.387760 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.387484    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="002db606-2100-4ad7-980e-3e451f36c08e" containerName="maas-api"
Jul 15 10:58:39.387760 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.387495    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fbf962d-8704-44a2-b8e7-b6460b4f5152" containerName="maas-api"
Jul 15 10:58:39.387760 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.387503    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" containerName="istio-proxy"
Jul 15 10:58:39.390464 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.390445    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.394556 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.394540    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-205b15-openshift-default-dockercfg-rfkck\""
Jul 15 10:58:39.409828 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.409806    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"]
Jul 15 10:58:39.478405 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.478363    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwgrl\" (UniqueName: \"kubernetes.io/projected/3dc85b09-c1d3-4600-8898-be08f0732a8f-kube-api-access-nwgrl\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.478793 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.478413    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-workload-certs\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.478793 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.478442    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-envoy\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.478793 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.478467    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-data\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.478793 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.478509    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dc85b09-c1d3-4600-8898-be08f0732a8f-istiod-ca-cert\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.478793 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.478536    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-workload-socket\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.478793 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.478574    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-token\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.478793 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.478604    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-podinfo\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.478793 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.478642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-credential-socket\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.579725 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.579693    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-token\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.579725 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.579726    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-podinfo\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.579969 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.579748    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-credential-socket\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.579969 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.579773    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwgrl\" (UniqueName: \"kubernetes.io/projected/3dc85b09-c1d3-4600-8898-be08f0732a8f-kube-api-access-nwgrl\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.579969 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.579797    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-workload-certs\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.579969 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.579827    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-envoy\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.579969 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.579856    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-data\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.579969 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.579905    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dc85b09-c1d3-4600-8898-be08f0732a8f-istiod-ca-cert\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.579969 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.579941    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-workload-socket\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.580357 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.580209    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-credential-socket\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.580357 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.580265    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-workload-certs\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.580357 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.580312    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-workload-socket\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.580456 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.580396    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-data\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.580779 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.580762    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dc85b09-c1d3-4600-8898-be08f0732a8f-istiod-ca-cert\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.582253 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.582235    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-envoy\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.582550 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.582529    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-podinfo\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.589689 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.589669    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-token\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.589832 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.589813    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwgrl\" (UniqueName: \"kubernetes.io/projected/3dc85b09-c1d3-4600-8898-be08f0732a8f-kube-api-access-nwgrl\") pod \"e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") " pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.700616 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.700545    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:39.845348 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.845321    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"]
Jul 15 10:58:39.846572 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:58:39.846550    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dc85b09_c1d3_4600_8898_be08f0732a8f.slice/crio-915773dacaeb9b1cf710746d798465a2611688c5aa90e43daae4a5e2a67c6fa4 WatchSource:0}: Error finding container 915773dacaeb9b1cf710746d798465a2611688c5aa90e43daae4a5e2a67c6fa4: Status 404 returned error can't find the container with id 915773dacaeb9b1cf710746d798465a2611688c5aa90e43daae4a5e2a67c6fa4
Jul 15 10:58:39.848720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.848692    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:58:39.848812 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.848749    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:58:39.848812 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:39.848775    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:58:40.242383 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:40.242350    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g" event={"ID":"3dc85b09-c1d3-4600-8898-be08f0732a8f","Type":"ContainerStarted","Data":"ebae5da0d7610c29a41a0a3aecd818a78edc49308511cf1218dc2eae904cddc0"}
Jul 15 10:58:40.242568 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:40.242427    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g" event={"ID":"3dc85b09-c1d3-4600-8898-be08f0732a8f","Type":"ContainerStarted","Data":"915773dacaeb9b1cf710746d798465a2611688c5aa90e43daae4a5e2a67c6fa4"}
Jul 15 10:58:40.272247 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:40.272195    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g" podStartSLOduration=1.272181215 podStartE2EDuration="1.272181215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:58:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:58:40.271508698 +0000 UTC m=+2319.091150582" watchObservedRunningTime="2026-07-15 10:58:40.272181215 +0000 UTC m=+2319.091823086"
Jul 15 10:58:40.701000 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:40.700967    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:40.705713 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:40.705686    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:41.248039 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:41.247999    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:41.248987 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:41.248969    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:42.411638 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.411610    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"]
Jul 15 10:58:42.412023 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.412002    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d333726-b646-42a2-9ec4-e3a9c7c4cbfc" containerName="istio-proxy"
Jul 15 10:58:42.415158 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.415134    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"
Jul 15 10:58:42.417619 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.417595    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-205b15-serving-cert\""
Jul 15 10:58:42.417741 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.417719    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zk7pv\""
Jul 15 10:58:42.418605 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.418586    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 10:58:42.418714 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.418616    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 10:58:42.433542 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.433517    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"]
Jul 15 10:58:42.506203 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.506170    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtfvr\" (UniqueName: \"kubernetes.io/projected/b816059b-9e55-4448-bbbd-8d46e86644da-kube-api-access-mtfvr\") pod \"maas-api-e2e-api-a-205b15-b459bdf88-2fdrb\" (UID: \"b816059b-9e55-4448-bbbd-8d46e86644da\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"
Jul 15 10:58:42.506314 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.506300    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b816059b-9e55-4448-bbbd-8d46e86644da-maas-api-tls\") pod \"maas-api-e2e-api-a-205b15-b459bdf88-2fdrb\" (UID: \"b816059b-9e55-4448-bbbd-8d46e86644da\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"
Jul 15 10:58:42.506373 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.506334    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b816059b-9e55-4448-bbbd-8d46e86644da-openshift-service-ca\") pod \"maas-api-e2e-api-a-205b15-b459bdf88-2fdrb\" (UID: \"b816059b-9e55-4448-bbbd-8d46e86644da\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"
Jul 15 10:58:42.607554 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.607526    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b816059b-9e55-4448-bbbd-8d46e86644da-maas-api-tls\") pod \"maas-api-e2e-api-a-205b15-b459bdf88-2fdrb\" (UID: \"b816059b-9e55-4448-bbbd-8d46e86644da\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"
Jul 15 10:58:42.607701 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.607563    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b816059b-9e55-4448-bbbd-8d46e86644da-openshift-service-ca\") pod \"maas-api-e2e-api-a-205b15-b459bdf88-2fdrb\" (UID: \"b816059b-9e55-4448-bbbd-8d46e86644da\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"
Jul 15 10:58:42.607701 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.607585    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtfvr\" (UniqueName: \"kubernetes.io/projected/b816059b-9e55-4448-bbbd-8d46e86644da-kube-api-access-mtfvr\") pod \"maas-api-e2e-api-a-205b15-b459bdf88-2fdrb\" (UID: \"b816059b-9e55-4448-bbbd-8d46e86644da\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"
Jul 15 10:58:42.608361 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.608268    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b816059b-9e55-4448-bbbd-8d46e86644da-openshift-service-ca\") pod \"maas-api-e2e-api-a-205b15-b459bdf88-2fdrb\" (UID: \"b816059b-9e55-4448-bbbd-8d46e86644da\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"
Jul 15 10:58:42.610178 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.610149    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b816059b-9e55-4448-bbbd-8d46e86644da-maas-api-tls\") pod \"maas-api-e2e-api-a-205b15-b459bdf88-2fdrb\" (UID: \"b816059b-9e55-4448-bbbd-8d46e86644da\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"
Jul 15 10:58:42.618584 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.618559    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtfvr\" (UniqueName: \"kubernetes.io/projected/b816059b-9e55-4448-bbbd-8d46e86644da-kube-api-access-mtfvr\") pod \"maas-api-e2e-api-a-205b15-b459bdf88-2fdrb\" (UID: \"b816059b-9e55-4448-bbbd-8d46e86644da\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"
Jul 15 10:58:42.726451 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.726399    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"
Jul 15 10:58:42.863229 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.863201    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"]
Jul 15 10:58:42.864499 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:58:42.864468    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb816059b_9e55_4448_bbbd_8d46e86644da.slice/crio-bc0e9f450c05bc3efcf8635953f7f6b9fb12ad0e875ce63f488de9f0a5fe83d6 WatchSource:0}: Error finding container bc0e9f450c05bc3efcf8635953f7f6b9fb12ad0e875ce63f488de9f0a5fe83d6: Status 404 returned error can't find the container with id bc0e9f450c05bc3efcf8635953f7f6b9fb12ad0e875ce63f488de9f0a5fe83d6
Jul 15 10:58:42.865899 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:42.865879    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 10:58:43.259161 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.259098    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb" event={"ID":"b816059b-9e55-4448-bbbd-8d46e86644da","Type":"ContainerStarted","Data":"bc0e9f450c05bc3efcf8635953f7f6b9fb12ad0e875ce63f488de9f0a5fe83d6"}
Jul 15 10:58:43.694560 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.694538    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:58:43.817332 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.817260    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-data\") pod \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") "
Jul 15 10:58:43.817332 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.817299    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-workload-certs\") pod \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") "
Jul 15 10:58:43.817332 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.817321    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-workload-socket\") pod \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") "
Jul 15 10:58:43.817613 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.817347    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-envoy\") pod \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") "
Jul 15 10:58:43.817613 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.817511    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-podinfo\") pod \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") "
Jul 15 10:58:43.817613 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.817550    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3c50c59d-6cdd-49ed-b2ad-1ad661314777" (UID: "3c50c59d-6cdd-49ed-b2ad-1ad661314777"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:58:43.817613 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.817571    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vnhv\" (UniqueName: \"kubernetes.io/projected/3c50c59d-6cdd-49ed-b2ad-1ad661314777-kube-api-access-4vnhv\") pod \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") "
Jul 15 10:58:43.817613 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.817607    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-credential-socket\") pod \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") "
Jul 15 10:58:43.817883 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.817635    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-token\") pod \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") "
Jul 15 10:58:43.817883 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.817634    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3c50c59d-6cdd-49ed-b2ad-1ad661314777" (UID: "3c50c59d-6cdd-49ed-b2ad-1ad661314777"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:58:43.817883 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.817661    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istiod-ca-cert\") pod \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\" (UID: \"3c50c59d-6cdd-49ed-b2ad-1ad661314777\") "
Jul 15 10:58:43.818041 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.818011    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3c50c59d-6cdd-49ed-b2ad-1ad661314777" (UID: "3c50c59d-6cdd-49ed-b2ad-1ad661314777"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:58:43.818041 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.818019    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-workload-certs\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:43.818187 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.818045    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-workload-socket\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:43.818187 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.818059    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-data" (OuterVolumeSpecName: "istio-data") pod "3c50c59d-6cdd-49ed-b2ad-1ad661314777" (UID: "3c50c59d-6cdd-49ed-b2ad-1ad661314777"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:58:43.818187 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.818171    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3c50c59d-6cdd-49ed-b2ad-1ad661314777" (UID: "3c50c59d-6cdd-49ed-b2ad-1ad661314777"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:58:43.819807 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.819773    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-token" (OuterVolumeSpecName: "istio-token") pod "3c50c59d-6cdd-49ed-b2ad-1ad661314777" (UID: "3c50c59d-6cdd-49ed-b2ad-1ad661314777"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:58:43.819933 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.819879    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c50c59d-6cdd-49ed-b2ad-1ad661314777-kube-api-access-4vnhv" (OuterVolumeSpecName: "kube-api-access-4vnhv") pod "3c50c59d-6cdd-49ed-b2ad-1ad661314777" (UID: "3c50c59d-6cdd-49ed-b2ad-1ad661314777"). InnerVolumeSpecName "kube-api-access-4vnhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:58:43.820208 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.820189    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3c50c59d-6cdd-49ed-b2ad-1ad661314777" (UID: "3c50c59d-6cdd-49ed-b2ad-1ad661314777"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 10:58:43.820208 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.820188    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3c50c59d-6cdd-49ed-b2ad-1ad661314777" (UID: "3c50c59d-6cdd-49ed-b2ad-1ad661314777"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:58:43.919501 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.919459    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-credential-socket\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:43.919501 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.919493    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-token\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:43.919501 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.919506    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istiod-ca-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:43.919799 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.919518    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-data\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:43.919799 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.919528    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-envoy\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:43.919799 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.919538    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c50c59d-6cdd-49ed-b2ad-1ad661314777-istio-podinfo\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:43.919799 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:43.919549    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vnhv\" (UniqueName: \"kubernetes.io/projected/3c50c59d-6cdd-49ed-b2ad-1ad661314777-kube-api-access-4vnhv\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:58:44.266830 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:44.266797    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb" event={"ID":"b816059b-9e55-4448-bbbd-8d46e86644da","Type":"ContainerStarted","Data":"a53659d7256a939e4e6547f3daea12d3e08b381ffd5bf8671ea81ec9b184ad8f"}
Jul 15 10:58:44.267047 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:44.266886    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"
Jul 15 10:58:44.268612 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:44.268587    2568 generic.go:356] "Generic (PLEG): container finished" podID="3c50c59d-6cdd-49ed-b2ad-1ad661314777" containerID="094904ce9f5ace10da3d654b90f9bf8019d21c6ca6f783f7cbba34c206e3b4dd" exitCode=0
Jul 15 10:58:44.268730 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:44.268640    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"
Jul 15 10:58:44.268730 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:44.268664    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt" event={"ID":"3c50c59d-6cdd-49ed-b2ad-1ad661314777","Type":"ContainerDied","Data":"094904ce9f5ace10da3d654b90f9bf8019d21c6ca6f783f7cbba34c206e3b4dd"}
Jul 15 10:58:44.268730 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:44.268707    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt" event={"ID":"3c50c59d-6cdd-49ed-b2ad-1ad661314777","Type":"ContainerDied","Data":"7e6107d812fb2a50f43d534055d67362b72ecf28514564291de231af0a61bae1"}
Jul 15 10:58:44.268730 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:44.268729    2568 scope.go:117] "RemoveContainer" containerID="094904ce9f5ace10da3d654b90f9bf8019d21c6ca6f783f7cbba34c206e3b4dd"
Jul 15 10:58:44.278836 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:44.278821    2568 scope.go:117] "RemoveContainer" containerID="4c17774d7c22f4693c6b2548da221c3167fc9739ad076c66b4ce90b0ad20bcca"
Jul 15 10:58:44.286887 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:44.286871    2568 scope.go:117] "RemoveContainer" containerID="094904ce9f5ace10da3d654b90f9bf8019d21c6ca6f783f7cbba34c206e3b4dd"
Jul 15 10:58:44.287194 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:58:44.287177    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"094904ce9f5ace10da3d654b90f9bf8019d21c6ca6f783f7cbba34c206e3b4dd\": container with ID starting with 094904ce9f5ace10da3d654b90f9bf8019d21c6ca6f783f7cbba34c206e3b4dd not found: ID does not exist" containerID="094904ce9f5ace10da3d654b90f9bf8019d21c6ca6f783f7cbba34c206e3b4dd"
Jul 15 10:58:44.287259 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:44.287203    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"094904ce9f5ace10da3d654b90f9bf8019d21c6ca6f783f7cbba34c206e3b4dd"} err="failed to get container status \"094904ce9f5ace10da3d654b90f9bf8019d21c6ca6f783f7cbba34c206e3b4dd\": rpc error: code = NotFound desc = could not find container \"094904ce9f5ace10da3d654b90f9bf8019d21c6ca6f783f7cbba34c206e3b4dd\": container with ID starting with 094904ce9f5ace10da3d654b90f9bf8019d21c6ca6f783f7cbba34c206e3b4dd not found: ID does not exist"
Jul 15 10:58:44.287259 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:44.287220    2568 scope.go:117] "RemoveContainer" containerID="4c17774d7c22f4693c6b2548da221c3167fc9739ad076c66b4ce90b0ad20bcca"
Jul 15 10:58:44.287461 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:58:44.287444    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c17774d7c22f4693c6b2548da221c3167fc9739ad076c66b4ce90b0ad20bcca\": container with ID starting with 4c17774d7c22f4693c6b2548da221c3167fc9739ad076c66b4ce90b0ad20bcca not found: ID does not exist" containerID="4c17774d7c22f4693c6b2548da221c3167fc9739ad076c66b4ce90b0ad20bcca"
Jul 15 10:58:44.287508 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:44.287467    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c17774d7c22f4693c6b2548da221c3167fc9739ad076c66b4ce90b0ad20bcca"} err="failed to get container status \"4c17774d7c22f4693c6b2548da221c3167fc9739ad076c66b4ce90b0ad20bcca\": rpc error: code = NotFound desc = could not find container \"4c17774d7c22f4693c6b2548da221c3167fc9739ad076c66b4ce90b0ad20bcca\": container with ID starting with 4c17774d7c22f4693c6b2548da221c3167fc9739ad076c66b4ce90b0ad20bcca not found: ID does not exist"
Jul 15 10:58:44.304163 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:44.304095    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb" podStartSLOduration=1.6221455219999998 podStartE2EDuration="2.304081568s" totalImagesPullingTime="681.936046ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:58:44.30052153 +0000 UTC m=+2323.120163400" watchObservedRunningTime="2026-07-15 10:58:44.304081568 +0000 UTC m=+2323.123723439"
Jul 15 10:58:44.324649 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:44.324623    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"]
Jul 15 10:58:44.340519 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:44.340498    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a47e9a-openshift-default-5f5ddf6957-lsjjt"]
Jul 15 10:58:45.647994 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:45.647961    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c50c59d-6cdd-49ed-b2ad-1ad661314777" path="/var/lib/kubelet/pods/3c50c59d-6cdd-49ed-b2ad-1ad661314777/volumes"
Jul 15 10:58:47.897365 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:47.897335    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:58:50.283748 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:50.283718    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"
Jul 15 10:58:51.128725 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.128692    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"]
Jul 15 10:58:51.129152 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.129134    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c50c59d-6cdd-49ed-b2ad-1ad661314777" containerName="istio-proxy"
Jul 15 10:58:51.129152 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.129153    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c50c59d-6cdd-49ed-b2ad-1ad661314777" containerName="istio-proxy"
Jul 15 10:58:51.129246 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.129171    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c50c59d-6cdd-49ed-b2ad-1ad661314777" containerName="istio-proxy"
Jul 15 10:58:51.129246 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.129176    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c50c59d-6cdd-49ed-b2ad-1ad661314777" containerName="istio-proxy"
Jul 15 10:58:51.129246 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.129229    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c50c59d-6cdd-49ed-b2ad-1ad661314777" containerName="istio-proxy"
Jul 15 10:58:51.129246 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.129237    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c50c59d-6cdd-49ed-b2ad-1ad661314777" containerName="istio-proxy"
Jul 15 10:58:51.133906 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.133885    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"
Jul 15 10:58:51.136744 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.136719    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-25c606-serving-cert\""
Jul 15 10:58:51.146170 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.146142    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"]
Jul 15 10:58:51.289189 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.289149    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e63735af-c41f-46e2-8fde-33e4669b8296-maas-api-tls\") pod \"maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn\" (UID: \"e63735af-c41f-46e2-8fde-33e4669b8296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"
Jul 15 10:58:51.289578 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.289209    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d7zw\" (UniqueName: \"kubernetes.io/projected/e63735af-c41f-46e2-8fde-33e4669b8296-kube-api-access-9d7zw\") pod \"maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn\" (UID: \"e63735af-c41f-46e2-8fde-33e4669b8296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"
Jul 15 10:58:51.289578 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.289230    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e63735af-c41f-46e2-8fde-33e4669b8296-openshift-service-ca\") pod \"maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn\" (UID: \"e63735af-c41f-46e2-8fde-33e4669b8296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"
Jul 15 10:58:51.390179 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.390053    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d7zw\" (UniqueName: \"kubernetes.io/projected/e63735af-c41f-46e2-8fde-33e4669b8296-kube-api-access-9d7zw\") pod \"maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn\" (UID: \"e63735af-c41f-46e2-8fde-33e4669b8296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"
Jul 15 10:58:51.390179 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.390097    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e63735af-c41f-46e2-8fde-33e4669b8296-openshift-service-ca\") pod \"maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn\" (UID: \"e63735af-c41f-46e2-8fde-33e4669b8296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"
Jul 15 10:58:51.390179 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.390170    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e63735af-c41f-46e2-8fde-33e4669b8296-maas-api-tls\") pod \"maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn\" (UID: \"e63735af-c41f-46e2-8fde-33e4669b8296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"
Jul 15 10:58:51.390921 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.390896    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e63735af-c41f-46e2-8fde-33e4669b8296-openshift-service-ca\") pod \"maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn\" (UID: \"e63735af-c41f-46e2-8fde-33e4669b8296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"
Jul 15 10:58:51.392720 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.392703    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e63735af-c41f-46e2-8fde-33e4669b8296-maas-api-tls\") pod \"maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn\" (UID: \"e63735af-c41f-46e2-8fde-33e4669b8296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"
Jul 15 10:58:51.403494 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.403474    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d7zw\" (UniqueName: \"kubernetes.io/projected/e63735af-c41f-46e2-8fde-33e4669b8296-kube-api-access-9d7zw\") pod \"maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn\" (UID: \"e63735af-c41f-46e2-8fde-33e4669b8296\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"
Jul 15 10:58:51.445682 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.445657    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"
Jul 15 10:58:51.645399 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:58:51.645368    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode63735af_c41f_46e2_8fde_33e4669b8296.slice/crio-7e37fe582606c43fc875c371723cfcbb6a88d684e40ab9fc333ef70932d43b28 WatchSource:0}: Error finding container 7e37fe582606c43fc875c371723cfcbb6a88d684e40ab9fc333ef70932d43b28: Status 404 returned error can't find the container with id 7e37fe582606c43fc875c371723cfcbb6a88d684e40ab9fc333ef70932d43b28
Jul 15 10:58:51.648123 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:51.648090    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"]
Jul 15 10:58:52.314747 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:52.314708    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn" event={"ID":"e63735af-c41f-46e2-8fde-33e4669b8296","Type":"ContainerStarted","Data":"461e1d74567c92f6283a55a856786dd10f42372ab21c613740d66d22e932dc33"}
Jul 15 10:58:52.315180 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:52.314769    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn" event={"ID":"e63735af-c41f-46e2-8fde-33e4669b8296","Type":"ContainerStarted","Data":"7e37fe582606c43fc875c371723cfcbb6a88d684e40ab9fc333ef70932d43b28"}
Jul 15 10:58:52.315180 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:52.314793    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"
Jul 15 10:58:52.351945 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:52.351842    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn" podStartSLOduration=0.8961474 podStartE2EDuration="1.351825965s" totalImagesPullingTime="455.678565ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:58:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:58:52.34935682 +0000 UTC m=+2331.168998693" watchObservedRunningTime="2026-07-15 10:58:52.351825965 +0000 UTC m=+2331.171467838"
Jul 15 10:58:56.249620 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:56.249583    2568 patch_prober.go:28] interesting pod/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 15 10:58:56.250059 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:56.249640    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g" podUID="3dc85b09-c1d3-4600-8898-be08f0732a8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 15 10:58:56.337714 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:56.337685    2568 generic.go:356] "Generic (PLEG): container finished" podID="3dc85b09-c1d3-4600-8898-be08f0732a8f" containerID="ebae5da0d7610c29a41a0a3aecd818a78edc49308511cf1218dc2eae904cddc0" exitCode=0
Jul 15 10:58:56.337875 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:56.337761    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g" event={"ID":"3dc85b09-c1d3-4600-8898-be08f0732a8f","Type":"ContainerDied","Data":"ebae5da0d7610c29a41a0a3aecd818a78edc49308511cf1218dc2eae904cddc0"}
Jul 15 10:58:56.338199 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:56.338181    2568 scope.go:117] "RemoveContainer" containerID="ebae5da0d7610c29a41a0a3aecd818a78edc49308511cf1218dc2eae904cddc0"
Jul 15 10:58:56.339156 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:56.339105    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:58:56.339266 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:56.339208    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:58:56.339266 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:56.339258    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:58:57.345650 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:57.345616    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g" event={"ID":"3dc85b09-c1d3-4600-8898-be08f0732a8f","Type":"ContainerStarted","Data":"d3b63e5fb5540d7e4d81f3421ba41e8df8e1d4e6ffc94348142132d951c3d51f"}
Jul 15 10:58:57.701313 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:57.701210    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:58:57.701476 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:57.701430    2568 patch_prober.go:28] interesting pod/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 15 10:58:57.701523 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:57.701477    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g" podUID="3dc85b09-c1d3-4600-8898-be08f0732a8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 15 10:58:58.326877 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:58.326851    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"
Jul 15 10:58:58.701170 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:58.701065    2568 patch_prober.go:28] interesting pod/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 15 10:58:58.701170 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:58.701155    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g" podUID="3dc85b09-c1d3-4600-8898-be08f0732a8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 15 10:58:59.701939 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:59.701902    2568 patch_prober.go:28] interesting pod/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 15 10:58:59.702356 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:58:59.701961    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g" podUID="3dc85b09-c1d3-4600-8898-be08f0732a8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 15 10:59:00.701953 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:00.701910    2568 patch_prober.go:28] interesting pod/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 15 10:59:00.702350 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:00.701967    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g" podUID="3dc85b09-c1d3-4600-8898-be08f0732a8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 15 10:59:01.705513 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:01.705487    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:59:01.705895 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:01.705744    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:59:01.706450 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:01.706428    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:59:02.891006 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:02.890953    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:59:03.651578 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:03.651536    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-205b15-98mfg"]
Jul 15 10:59:03.656890 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:03.656874    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-205b15-98mfg"
Jul 15 10:59:03.659560 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:03.659542    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zj826\""
Jul 15 10:59:03.664218 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:03.663796    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-205b15-98mfg"]
Jul 15 10:59:03.805366 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:03.805336    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74938f49-5211-47fb-bac8-3d8b62a91fc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-205b15-98mfg\" (UID: \"74938f49-5211-47fb-bac8-3d8b62a91fc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-205b15-98mfg"
Jul 15 10:59:03.905896 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:03.905840    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74938f49-5211-47fb-bac8-3d8b62a91fc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-205b15-98mfg\" (UID: \"74938f49-5211-47fb-bac8-3d8b62a91fc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-205b15-98mfg"
Jul 15 10:59:03.906427 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:03.906409    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74938f49-5211-47fb-bac8-3d8b62a91fc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-205b15-98mfg\" (UID: \"74938f49-5211-47fb-bac8-3d8b62a91fc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-205b15-98mfg"
Jul 15 10:59:03.969349 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:03.969331    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-205b15-98mfg"
Jul 15 10:59:04.104495 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:04.104469    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-205b15-98mfg"]
Jul 15 10:59:04.105353 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:59:04.105329    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74938f49_5211_47fb_bac8_3d8b62a91fc1.slice/crio-b92ebf6f2998eddc4187dbfeba9ae269f0e56ea073cefe63cd24183c5555a878 WatchSource:0}: Error finding container b92ebf6f2998eddc4187dbfeba9ae269f0e56ea073cefe63cd24183c5555a878: Status 404 returned error can't find the container with id b92ebf6f2998eddc4187dbfeba9ae269f0e56ea073cefe63cd24183c5555a878
Jul 15 10:59:04.387467 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:04.387441    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-205b15-98mfg" event={"ID":"74938f49-5211-47fb-bac8-3d8b62a91fc1","Type":"ContainerStarted","Data":"b92ebf6f2998eddc4187dbfeba9ae269f0e56ea073cefe63cd24183c5555a878"}
Jul 15 10:59:05.394055 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:05.394019    2568 generic.go:356] "Generic (PLEG): container finished" podID="74938f49-5211-47fb-bac8-3d8b62a91fc1" containerID="10b51a250726022adc632139f8e74a3117f0c4eca196fbaaf19d1e8497aa50c0" exitCode=0
Jul 15 10:59:05.394430 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:05.394105    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-205b15-98mfg" event={"ID":"74938f49-5211-47fb-bac8-3d8b62a91fc1","Type":"ContainerDied","Data":"10b51a250726022adc632139f8e74a3117f0c4eca196fbaaf19d1e8497aa50c0"}
Jul 15 10:59:06.529309 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:06.529286    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-205b15-98mfg"
Jul 15 10:59:06.627061 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:06.627035    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74938f49-5211-47fb-bac8-3d8b62a91fc1-maas-api-service-ca\") pod \"74938f49-5211-47fb-bac8-3d8b62a91fc1\" (UID: \"74938f49-5211-47fb-bac8-3d8b62a91fc1\") "
Jul 15 10:59:06.627367 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:06.627345    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74938f49-5211-47fb-bac8-3d8b62a91fc1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "74938f49-5211-47fb-bac8-3d8b62a91fc1" (UID: "74938f49-5211-47fb-bac8-3d8b62a91fc1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:59:06.727819 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:06.727751    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74938f49-5211-47fb-bac8-3d8b62a91fc1-maas-api-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:59:07.405820 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:07.405793    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-205b15-98mfg"
Jul 15 10:59:07.405985 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:07.405840    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-205b15-98mfg" event={"ID":"74938f49-5211-47fb-bac8-3d8b62a91fc1","Type":"ContainerDied","Data":"b92ebf6f2998eddc4187dbfeba9ae269f0e56ea073cefe63cd24183c5555a878"}
Jul 15 10:59:07.405985 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:07.405880    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b92ebf6f2998eddc4187dbfeba9ae269f0e56ea073cefe63cd24183c5555a878"
Jul 15 10:59:13.886731 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:13.886701    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"]
Jul 15 10:59:13.887230 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:13.886895    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb" podUID="b816059b-9e55-4448-bbbd-8d46e86644da" containerName="maas-api" containerID="cri-o://a53659d7256a939e4e6547f3daea12d3e08b381ffd5bf8671ea81ec9b184ad8f" gracePeriod=30
Jul 15 10:59:14.136163 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.136140    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"
Jul 15 10:59:14.179868 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.179802    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtfvr\" (UniqueName: \"kubernetes.io/projected/b816059b-9e55-4448-bbbd-8d46e86644da-kube-api-access-mtfvr\") pod \"b816059b-9e55-4448-bbbd-8d46e86644da\" (UID: \"b816059b-9e55-4448-bbbd-8d46e86644da\") "
Jul 15 10:59:14.179868 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.179838    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b816059b-9e55-4448-bbbd-8d46e86644da-openshift-service-ca\") pod \"b816059b-9e55-4448-bbbd-8d46e86644da\" (UID: \"b816059b-9e55-4448-bbbd-8d46e86644da\") "
Jul 15 10:59:14.180047 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.179876    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b816059b-9e55-4448-bbbd-8d46e86644da-maas-api-tls\") pod \"b816059b-9e55-4448-bbbd-8d46e86644da\" (UID: \"b816059b-9e55-4448-bbbd-8d46e86644da\") "
Jul 15 10:59:14.180256 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.180234    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b816059b-9e55-4448-bbbd-8d46e86644da-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b816059b-9e55-4448-bbbd-8d46e86644da" (UID: "b816059b-9e55-4448-bbbd-8d46e86644da"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:59:14.181989 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.181960    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b816059b-9e55-4448-bbbd-8d46e86644da-kube-api-access-mtfvr" (OuterVolumeSpecName: "kube-api-access-mtfvr") pod "b816059b-9e55-4448-bbbd-8d46e86644da" (UID: "b816059b-9e55-4448-bbbd-8d46e86644da"). InnerVolumeSpecName "kube-api-access-mtfvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:59:14.181989 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.181976    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b816059b-9e55-4448-bbbd-8d46e86644da-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b816059b-9e55-4448-bbbd-8d46e86644da" (UID: "b816059b-9e55-4448-bbbd-8d46e86644da"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:59:14.281260 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.281241    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtfvr\" (UniqueName: \"kubernetes.io/projected/b816059b-9e55-4448-bbbd-8d46e86644da-kube-api-access-mtfvr\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:59:14.281260 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.281261    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b816059b-9e55-4448-bbbd-8d46e86644da-openshift-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:59:14.281391 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.281270    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b816059b-9e55-4448-bbbd-8d46e86644da-maas-api-tls\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:59:14.443417 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.443337    2568 generic.go:356] "Generic (PLEG): container finished" podID="b816059b-9e55-4448-bbbd-8d46e86644da" containerID="a53659d7256a939e4e6547f3daea12d3e08b381ffd5bf8671ea81ec9b184ad8f" exitCode=0
Jul 15 10:59:14.443417 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.443388    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"
Jul 15 10:59:14.443592 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.443417    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb" event={"ID":"b816059b-9e55-4448-bbbd-8d46e86644da","Type":"ContainerDied","Data":"a53659d7256a939e4e6547f3daea12d3e08b381ffd5bf8671ea81ec9b184ad8f"}
Jul 15 10:59:14.443592 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.443468    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb" event={"ID":"b816059b-9e55-4448-bbbd-8d46e86644da","Type":"ContainerDied","Data":"bc0e9f450c05bc3efcf8635953f7f6b9fb12ad0e875ce63f488de9f0a5fe83d6"}
Jul 15 10:59:14.443592 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.443490    2568 scope.go:117] "RemoveContainer" containerID="a53659d7256a939e4e6547f3daea12d3e08b381ffd5bf8671ea81ec9b184ad8f"
Jul 15 10:59:14.452835 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.452818    2568 scope.go:117] "RemoveContainer" containerID="a53659d7256a939e4e6547f3daea12d3e08b381ffd5bf8671ea81ec9b184ad8f"
Jul 15 10:59:14.453092 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:59:14.453073    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a53659d7256a939e4e6547f3daea12d3e08b381ffd5bf8671ea81ec9b184ad8f\": container with ID starting with a53659d7256a939e4e6547f3daea12d3e08b381ffd5bf8671ea81ec9b184ad8f not found: ID does not exist" containerID="a53659d7256a939e4e6547f3daea12d3e08b381ffd5bf8671ea81ec9b184ad8f"
Jul 15 10:59:14.453175 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.453099    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a53659d7256a939e4e6547f3daea12d3e08b381ffd5bf8671ea81ec9b184ad8f"} err="failed to get container status \"a53659d7256a939e4e6547f3daea12d3e08b381ffd5bf8671ea81ec9b184ad8f\": rpc error: code = NotFound desc = could not find container \"a53659d7256a939e4e6547f3daea12d3e08b381ffd5bf8671ea81ec9b184ad8f\": container with ID starting with a53659d7256a939e4e6547f3daea12d3e08b381ffd5bf8671ea81ec9b184ad8f not found: ID does not exist"
Jul 15 10:59:14.466842 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.466811    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"]
Jul 15 10:59:14.469880 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:14.469854    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-205b15-b459bdf88-2fdrb"]
Jul 15 10:59:15.647725 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:15.647692    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b816059b-9e55-4448-bbbd-8d46e86644da" path="/var/lib/kubelet/pods/b816059b-9e55-4448-bbbd-8d46e86644da/volumes"
Jul 15 10:59:17.294848 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:17.294820    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:59:29.494496 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:29.494464    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"]
Jul 15 10:59:29.494898 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:29.494662    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g" podUID="3dc85b09-c1d3-4600-8898-be08f0732a8f" containerName="istio-proxy" containerID="cri-o://d3b63e5fb5540d7e4d81f3421ba41e8df8e1d4e6ffc94348142132d951c3d51f" gracePeriod=30
Jul 15 10:59:29.875267 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:29.875186    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c606-d2hbk"]
Jul 15 10:59:29.875514 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:29.875502    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74938f49-5211-47fb-bac8-3d8b62a91fc1" containerName="revoke-keys"
Jul 15 10:59:29.875602 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:29.875516    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="74938f49-5211-47fb-bac8-3d8b62a91fc1" containerName="revoke-keys"
Jul 15 10:59:29.875602 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:29.875528    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b816059b-9e55-4448-bbbd-8d46e86644da" containerName="maas-api"
Jul 15 10:59:29.875602 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:29.875534    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b816059b-9e55-4448-bbbd-8d46e86644da" containerName="maas-api"
Jul 15 10:59:29.875602 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:29.875598    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b816059b-9e55-4448-bbbd-8d46e86644da" containerName="maas-api"
Jul 15 10:59:29.875724 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:29.875606    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="74938f49-5211-47fb-bac8-3d8b62a91fc1" containerName="revoke-keys"
Jul 15 10:59:29.879726 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:29.879711    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c606-d2hbk"
Jul 15 10:59:29.882961 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:29.882942    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zj826\""
Jul 15 10:59:29.893801 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:29.893779    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c606-d2hbk"]
Jul 15 10:59:30.006186 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:30.006161    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d6c3a59-6f2f-4799-b7d1-67405f58a186-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-25c606-d2hbk\" (UID: \"7d6c3a59-6f2f-4799-b7d1-67405f58a186\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c606-d2hbk"
Jul 15 10:59:30.107260 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:30.107232    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d6c3a59-6f2f-4799-b7d1-67405f58a186-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-25c606-d2hbk\" (UID: \"7d6c3a59-6f2f-4799-b7d1-67405f58a186\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c606-d2hbk"
Jul 15 10:59:30.107773 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:30.107757    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d6c3a59-6f2f-4799-b7d1-67405f58a186-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-25c606-d2hbk\" (UID: \"7d6c3a59-6f2f-4799-b7d1-67405f58a186\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c606-d2hbk"
Jul 15 10:59:30.189923 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:30.189862    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c606-d2hbk"
Jul 15 10:59:30.321431 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:30.321406    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c606-d2hbk"]
Jul 15 10:59:30.322857 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:59:30.322832    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d6c3a59_6f2f_4799_b7d1_67405f58a186.slice/crio-9968cfe2608eefff9bedd58f7ff87bc80f813a821360acdaca12e26c0923754c WatchSource:0}: Error finding container 9968cfe2608eefff9bedd58f7ff87bc80f813a821360acdaca12e26c0923754c: Status 404 returned error can't find the container with id 9968cfe2608eefff9bedd58f7ff87bc80f813a821360acdaca12e26c0923754c
Jul 15 10:59:30.538259 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:30.538225    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c606-d2hbk" event={"ID":"7d6c3a59-6f2f-4799-b7d1-67405f58a186","Type":"ContainerStarted","Data":"9968cfe2608eefff9bedd58f7ff87bc80f813a821360acdaca12e26c0923754c"}
Jul 15 10:59:31.545347 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:31.545307    2568 generic.go:356] "Generic (PLEG): container finished" podID="7d6c3a59-6f2f-4799-b7d1-67405f58a186" containerID="115f0c9236e25ae9bc774c869149b3b61c149b1231437009a391d0d618bd870d" exitCode=0
Jul 15 10:59:31.545727 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:31.545396    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c606-d2hbk" event={"ID":"7d6c3a59-6f2f-4799-b7d1-67405f58a186","Type":"ContainerDied","Data":"115f0c9236e25ae9bc774c869149b3b61c149b1231437009a391d0d618bd870d"}
Jul 15 10:59:31.707363 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:31.707327    2568 patch_prober.go:28] interesting pod/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 10:59:31.707531 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:31.707388    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g" podUID="3dc85b09-c1d3-4600-8898-be08f0732a8f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:59:32.680871 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:32.680846    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c606-d2hbk"
Jul 15 10:59:32.733206 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:32.730833    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d6c3a59-6f2f-4799-b7d1-67405f58a186-maas-api-service-ca\") pod \"7d6c3a59-6f2f-4799-b7d1-67405f58a186\" (UID: \"7d6c3a59-6f2f-4799-b7d1-67405f58a186\") "
Jul 15 10:59:32.733206 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:32.731652    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d6c3a59-6f2f-4799-b7d1-67405f58a186-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7d6c3a59-6f2f-4799-b7d1-67405f58a186" (UID: "7d6c3a59-6f2f-4799-b7d1-67405f58a186"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:59:32.832615 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:32.832526    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d6c3a59-6f2f-4799-b7d1-67405f58a186-maas-api-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:59:33.557032 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:33.557006    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c606-d2hbk"
Jul 15 10:59:33.557216 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:33.557003    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c606-d2hbk" event={"ID":"7d6c3a59-6f2f-4799-b7d1-67405f58a186","Type":"ContainerDied","Data":"9968cfe2608eefff9bedd58f7ff87bc80f813a821360acdaca12e26c0923754c"}
Jul 15 10:59:33.557216 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:33.557171    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9968cfe2608eefff9bedd58f7ff87bc80f813a821360acdaca12e26c0923754c"
Jul 15 10:59:34.744562 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.744535    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:59:34.848733 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.848664    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-workload-socket\") pod \"3dc85b09-c1d3-4600-8898-be08f0732a8f\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") "
Jul 15 10:59:34.848733 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.848699    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-podinfo\") pod \"3dc85b09-c1d3-4600-8898-be08f0732a8f\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") "
Jul 15 10:59:34.848733 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.848720    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-envoy\") pod \"3dc85b09-c1d3-4600-8898-be08f0732a8f\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") "
Jul 15 10:59:34.848965 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.848757    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-credential-socket\") pod \"3dc85b09-c1d3-4600-8898-be08f0732a8f\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") "
Jul 15 10:59:34.848965 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.848807    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dc85b09-c1d3-4600-8898-be08f0732a8f-istiod-ca-cert\") pod \"3dc85b09-c1d3-4600-8898-be08f0732a8f\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") "
Jul 15 10:59:34.848965 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.848832    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-workload-certs\") pod \"3dc85b09-c1d3-4600-8898-be08f0732a8f\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") "
Jul 15 10:59:34.848965 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.848856    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-token\") pod \"3dc85b09-c1d3-4600-8898-be08f0732a8f\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") "
Jul 15 10:59:34.848965 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.848881    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-data\") pod \"3dc85b09-c1d3-4600-8898-be08f0732a8f\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") "
Jul 15 10:59:34.848965 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.848927    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3dc85b09-c1d3-4600-8898-be08f0732a8f" (UID: "3dc85b09-c1d3-4600-8898-be08f0732a8f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:59:34.849319 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.848969    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwgrl\" (UniqueName: \"kubernetes.io/projected/3dc85b09-c1d3-4600-8898-be08f0732a8f-kube-api-access-nwgrl\") pod \"3dc85b09-c1d3-4600-8898-be08f0732a8f\" (UID: \"3dc85b09-c1d3-4600-8898-be08f0732a8f\") "
Jul 15 10:59:34.849319 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.849079    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3dc85b09-c1d3-4600-8898-be08f0732a8f" (UID: "3dc85b09-c1d3-4600-8898-be08f0732a8f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:59:34.849319 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.849222    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dc85b09-c1d3-4600-8898-be08f0732a8f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3dc85b09-c1d3-4600-8898-be08f0732a8f" (UID: "3dc85b09-c1d3-4600-8898-be08f0732a8f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:59:34.849319 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.849248    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-workload-socket\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:59:34.849319 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.849278    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-workload-certs\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:59:34.849744 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.849456    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3dc85b09-c1d3-4600-8898-be08f0732a8f" (UID: "3dc85b09-c1d3-4600-8898-be08f0732a8f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:59:34.849744 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.849728    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-data" (OuterVolumeSpecName: "istio-data") pod "3dc85b09-c1d3-4600-8898-be08f0732a8f" (UID: "3dc85b09-c1d3-4600-8898-be08f0732a8f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:59:34.851079 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.851054    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3dc85b09-c1d3-4600-8898-be08f0732a8f" (UID: "3dc85b09-c1d3-4600-8898-be08f0732a8f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:59:34.851203 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.851097    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3dc85b09-c1d3-4600-8898-be08f0732a8f" (UID: "3dc85b09-c1d3-4600-8898-be08f0732a8f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 10:59:34.851553 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.851524    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-token" (OuterVolumeSpecName: "istio-token") pod "3dc85b09-c1d3-4600-8898-be08f0732a8f" (UID: "3dc85b09-c1d3-4600-8898-be08f0732a8f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:59:34.851647 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.851614    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dc85b09-c1d3-4600-8898-be08f0732a8f-kube-api-access-nwgrl" (OuterVolumeSpecName: "kube-api-access-nwgrl") pod "3dc85b09-c1d3-4600-8898-be08f0732a8f" (UID: "3dc85b09-c1d3-4600-8898-be08f0732a8f"). InnerVolumeSpecName "kube-api-access-nwgrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:59:34.950192 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.950166    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-podinfo\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:59:34.950192 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.950188    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-envoy\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:59:34.950192 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.950197    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-credential-socket\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:59:34.950374 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.950206    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dc85b09-c1d3-4600-8898-be08f0732a8f-istiod-ca-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:59:34.950374 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.950214    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-token\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:59:34.950374 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.950221    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dc85b09-c1d3-4600-8898-be08f0732a8f-istio-data\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:59:34.950374 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:34.950229    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwgrl\" (UniqueName: \"kubernetes.io/projected/3dc85b09-c1d3-4600-8898-be08f0732a8f-kube-api-access-nwgrl\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:59:35.569435 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:35.569391    2568 generic.go:356] "Generic (PLEG): container finished" podID="3dc85b09-c1d3-4600-8898-be08f0732a8f" containerID="d3b63e5fb5540d7e4d81f3421ba41e8df8e1d4e6ffc94348142132d951c3d51f" exitCode=0
Jul 15 10:59:35.569435 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:35.569426    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g" event={"ID":"3dc85b09-c1d3-4600-8898-be08f0732a8f","Type":"ContainerDied","Data":"d3b63e5fb5540d7e4d81f3421ba41e8df8e1d4e6ffc94348142132d951c3d51f"}
Jul 15 10:59:35.569655 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:35.569479    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g" event={"ID":"3dc85b09-c1d3-4600-8898-be08f0732a8f","Type":"ContainerDied","Data":"915773dacaeb9b1cf710746d798465a2611688c5aa90e43daae4a5e2a67c6fa4"}
Jul 15 10:59:35.569655 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:35.569501    2568 scope.go:117] "RemoveContainer" containerID="d3b63e5fb5540d7e4d81f3421ba41e8df8e1d4e6ffc94348142132d951c3d51f"
Jul 15 10:59:35.569655 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:35.569440    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"
Jul 15 10:59:35.579177 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:35.579156    2568 scope.go:117] "RemoveContainer" containerID="ebae5da0d7610c29a41a0a3aecd818a78edc49308511cf1218dc2eae904cddc0"
Jul 15 10:59:35.587455 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:35.587439    2568 scope.go:117] "RemoveContainer" containerID="d3b63e5fb5540d7e4d81f3421ba41e8df8e1d4e6ffc94348142132d951c3d51f"
Jul 15 10:59:35.587695 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:59:35.587678    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3b63e5fb5540d7e4d81f3421ba41e8df8e1d4e6ffc94348142132d951c3d51f\": container with ID starting with d3b63e5fb5540d7e4d81f3421ba41e8df8e1d4e6ffc94348142132d951c3d51f not found: ID does not exist" containerID="d3b63e5fb5540d7e4d81f3421ba41e8df8e1d4e6ffc94348142132d951c3d51f"
Jul 15 10:59:35.587744 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:35.587705    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3b63e5fb5540d7e4d81f3421ba41e8df8e1d4e6ffc94348142132d951c3d51f"} err="failed to get container status \"d3b63e5fb5540d7e4d81f3421ba41e8df8e1d4e6ffc94348142132d951c3d51f\": rpc error: code = NotFound desc = could not find container \"d3b63e5fb5540d7e4d81f3421ba41e8df8e1d4e6ffc94348142132d951c3d51f\": container with ID starting with d3b63e5fb5540d7e4d81f3421ba41e8df8e1d4e6ffc94348142132d951c3d51f not found: ID does not exist"
Jul 15 10:59:35.587744 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:35.587722    2568 scope.go:117] "RemoveContainer" containerID="ebae5da0d7610c29a41a0a3aecd818a78edc49308511cf1218dc2eae904cddc0"
Jul 15 10:59:35.587973 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:59:35.587955    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebae5da0d7610c29a41a0a3aecd818a78edc49308511cf1218dc2eae904cddc0\": container with ID starting with ebae5da0d7610c29a41a0a3aecd818a78edc49308511cf1218dc2eae904cddc0 not found: ID does not exist" containerID="ebae5da0d7610c29a41a0a3aecd818a78edc49308511cf1218dc2eae904cddc0"
Jul 15 10:59:35.588024 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:35.587978    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebae5da0d7610c29a41a0a3aecd818a78edc49308511cf1218dc2eae904cddc0"} err="failed to get container status \"ebae5da0d7610c29a41a0a3aecd818a78edc49308511cf1218dc2eae904cddc0\": rpc error: code = NotFound desc = could not find container \"ebae5da0d7610c29a41a0a3aecd818a78edc49308511cf1218dc2eae904cddc0\": container with ID starting with ebae5da0d7610c29a41a0a3aecd818a78edc49308511cf1218dc2eae904cddc0 not found: ID does not exist"
Jul 15 10:59:35.594952 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:35.594929    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"]
Jul 15 10:59:35.605602 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:35.605577    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-205b15-openshift-default-679bcb8b8f-wcs5g"]
Jul 15 10:59:35.646936 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:35.646907    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dc85b09-c1d3-4600-8898-be08f0732a8f" path="/var/lib/kubelet/pods/3dc85b09-c1d3-4600-8898-be08f0732a8f/volumes"
Jul 15 10:59:40.533381 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:40.533349    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"]
Jul 15 10:59:40.533782 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:40.533546    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn" podUID="e63735af-c41f-46e2-8fde-33e4669b8296" containerName="maas-api" containerID="cri-o://461e1d74567c92f6283a55a856786dd10f42372ab21c613740d66d22e932dc33" gracePeriod=30
Jul 15 10:59:40.795567 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:40.795510    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"
Jul 15 10:59:40.898816 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:40.898787    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e63735af-c41f-46e2-8fde-33e4669b8296-maas-api-tls\") pod \"e63735af-c41f-46e2-8fde-33e4669b8296\" (UID: \"e63735af-c41f-46e2-8fde-33e4669b8296\") "
Jul 15 10:59:40.899003 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:40.898827    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e63735af-c41f-46e2-8fde-33e4669b8296-openshift-service-ca\") pod \"e63735af-c41f-46e2-8fde-33e4669b8296\" (UID: \"e63735af-c41f-46e2-8fde-33e4669b8296\") "
Jul 15 10:59:40.899003 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:40.898849    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d7zw\" (UniqueName: \"kubernetes.io/projected/e63735af-c41f-46e2-8fde-33e4669b8296-kube-api-access-9d7zw\") pod \"e63735af-c41f-46e2-8fde-33e4669b8296\" (UID: \"e63735af-c41f-46e2-8fde-33e4669b8296\") "
Jul 15 10:59:40.899201 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:40.899177    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e63735af-c41f-46e2-8fde-33e4669b8296-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e63735af-c41f-46e2-8fde-33e4669b8296" (UID: "e63735af-c41f-46e2-8fde-33e4669b8296"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:59:40.900982 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:40.900962    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e63735af-c41f-46e2-8fde-33e4669b8296-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e63735af-c41f-46e2-8fde-33e4669b8296" (UID: "e63735af-c41f-46e2-8fde-33e4669b8296"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:59:40.901091 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:40.901074    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e63735af-c41f-46e2-8fde-33e4669b8296-kube-api-access-9d7zw" (OuterVolumeSpecName: "kube-api-access-9d7zw") pod "e63735af-c41f-46e2-8fde-33e4669b8296" (UID: "e63735af-c41f-46e2-8fde-33e4669b8296"). InnerVolumeSpecName "kube-api-access-9d7zw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:59:40.999687 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:40.999661    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e63735af-c41f-46e2-8fde-33e4669b8296-maas-api-tls\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:59:40.999687 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:40.999682    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e63735af-c41f-46e2-8fde-33e4669b8296-openshift-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:59:40.999820 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:40.999693    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d7zw\" (UniqueName: \"kubernetes.io/projected/e63735af-c41f-46e2-8fde-33e4669b8296-kube-api-access-9d7zw\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 10:59:41.603962 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:41.603923    2568 generic.go:356] "Generic (PLEG): container finished" podID="e63735af-c41f-46e2-8fde-33e4669b8296" containerID="461e1d74567c92f6283a55a856786dd10f42372ab21c613740d66d22e932dc33" exitCode=0
Jul 15 10:59:41.603962 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:41.603963    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"
Jul 15 10:59:41.604510 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:41.604005    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn" event={"ID":"e63735af-c41f-46e2-8fde-33e4669b8296","Type":"ContainerDied","Data":"461e1d74567c92f6283a55a856786dd10f42372ab21c613740d66d22e932dc33"}
Jul 15 10:59:41.604510 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:41.604072    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn" event={"ID":"e63735af-c41f-46e2-8fde-33e4669b8296","Type":"ContainerDied","Data":"7e37fe582606c43fc875c371723cfcbb6a88d684e40ab9fc333ef70932d43b28"}
Jul 15 10:59:41.604510 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:41.604097    2568 scope.go:117] "RemoveContainer" containerID="461e1d74567c92f6283a55a856786dd10f42372ab21c613740d66d22e932dc33"
Jul 15 10:59:41.613775 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:41.613760    2568 scope.go:117] "RemoveContainer" containerID="461e1d74567c92f6283a55a856786dd10f42372ab21c613740d66d22e932dc33"
Jul 15 10:59:41.614008 ip-10-0-134-102 kubenswrapper[2568]: E0715 10:59:41.613991    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"461e1d74567c92f6283a55a856786dd10f42372ab21c613740d66d22e932dc33\": container with ID starting with 461e1d74567c92f6283a55a856786dd10f42372ab21c613740d66d22e932dc33 not found: ID does not exist" containerID="461e1d74567c92f6283a55a856786dd10f42372ab21c613740d66d22e932dc33"
Jul 15 10:59:41.614045 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:41.614017    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"461e1d74567c92f6283a55a856786dd10f42372ab21c613740d66d22e932dc33"} err="failed to get container status \"461e1d74567c92f6283a55a856786dd10f42372ab21c613740d66d22e932dc33\": rpc error: code = NotFound desc = could not find container \"461e1d74567c92f6283a55a856786dd10f42372ab21c613740d66d22e932dc33\": container with ID starting with 461e1d74567c92f6283a55a856786dd10f42372ab21c613740d66d22e932dc33 not found: ID does not exist"
Jul 15 10:59:41.629847 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:41.629819    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"]
Jul 15 10:59:41.632792 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:41.632773    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25c606-5c9bc4957d-tkwjn"]
Jul 15 10:59:41.646438 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:41.646418    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e63735af-c41f-46e2-8fde-33e4669b8296" path="/var/lib/kubelet/pods/e63735af-c41f-46e2-8fde-33e4669b8296/volumes"
Jul 15 10:59:43.992190 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:43.992159    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 10:59:56.662800 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.662768    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"]
Jul 15 10:59:56.663260 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.663097    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dc85b09-c1d3-4600-8898-be08f0732a8f" containerName="istio-proxy"
Jul 15 10:59:56.663260 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.663125    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dc85b09-c1d3-4600-8898-be08f0732a8f" containerName="istio-proxy"
Jul 15 10:59:56.663260 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.663134    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d6c3a59-6f2f-4799-b7d1-67405f58a186" containerName="revoke-keys"
Jul 15 10:59:56.663260 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.663139    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d6c3a59-6f2f-4799-b7d1-67405f58a186" containerName="revoke-keys"
Jul 15 10:59:56.663260 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.663156    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dc85b09-c1d3-4600-8898-be08f0732a8f" containerName="istio-proxy"
Jul 15 10:59:56.663260 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.663162    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dc85b09-c1d3-4600-8898-be08f0732a8f" containerName="istio-proxy"
Jul 15 10:59:56.663260 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.663170    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e63735af-c41f-46e2-8fde-33e4669b8296" containerName="maas-api"
Jul 15 10:59:56.663260 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.663175    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e63735af-c41f-46e2-8fde-33e4669b8296" containerName="maas-api"
Jul 15 10:59:56.663260 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.663239    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dc85b09-c1d3-4600-8898-be08f0732a8f" containerName="istio-proxy"
Jul 15 10:59:56.663260 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.663247    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d6c3a59-6f2f-4799-b7d1-67405f58a186" containerName="revoke-keys"
Jul 15 10:59:56.663260 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.663253    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dc85b09-c1d3-4600-8898-be08f0732a8f" containerName="istio-proxy"
Jul 15 10:59:56.663260 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.663260    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e63735af-c41f-46e2-8fde-33e4669b8296" containerName="maas-api"
Jul 15 10:59:56.667692 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.667675    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.670465 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.670445    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-b2a040-openshift-default-dockercfg-zpfn4\""
Jul 15 10:59:56.681058 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.681039    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"]
Jul 15 10:59:56.819491 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.819457    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-token\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.819491 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.819498    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-podinfo\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.819738 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.819562    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-credential-socket\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.819738 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.819626    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g42ng\" (UniqueName: \"kubernetes.io/projected/2415a259-510c-4c3a-bbc2-e9fa37e29780-kube-api-access-g42ng\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.819738 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.819695    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-workload-socket\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.819738 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.819729    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-workload-certs\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.819920 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.819764    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2415a259-510c-4c3a-bbc2-e9fa37e29780-istiod-ca-cert\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.819920 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.819793    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-envoy\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.819920 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.819860    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-data\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.920922 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.920854    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-credential-socket\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.920922 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.920890    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g42ng\" (UniqueName: \"kubernetes.io/projected/2415a259-510c-4c3a-bbc2-e9fa37e29780-kube-api-access-g42ng\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.921095 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.920920    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-workload-socket\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.921095 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.920947    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-workload-certs\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.921095 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.920980    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2415a259-510c-4c3a-bbc2-e9fa37e29780-istiod-ca-cert\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.921095 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.921007    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-envoy\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.921335 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.921159    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-data\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.921335 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.921211    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-token\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.921335 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.921252    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-podinfo\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.921335 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.921317    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-credential-socket\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.921505 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.921368    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-workload-socket\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.921565 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.921533    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-workload-certs\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.921615 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.921600    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-data\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.921651 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.921637    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2415a259-510c-4c3a-bbc2-e9fa37e29780-istiod-ca-cert\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.923539 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.923522    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-envoy\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.923587 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.923567    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-podinfo\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.933681 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.933658    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-token\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.933779 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.933695    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g42ng\" (UniqueName: \"kubernetes.io/projected/2415a259-510c-4c3a-bbc2-e9fa37e29780-kube-api-access-g42ng\") pod \"e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") " pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:56.978022 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:56.978003    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:57.119315 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:57.119286    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"]
Jul 15 10:59:57.120870 ip-10-0-134-102 kubenswrapper[2568]: W0715 10:59:57.120844    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2415a259_510c_4c3a_bbc2_e9fa37e29780.slice/crio-6902643a327038dceaf2337d738771ce1191fdf48a0b5d38e3d36c3d29f54a38 WatchSource:0}: Error finding container 6902643a327038dceaf2337d738771ce1191fdf48a0b5d38e3d36c3d29f54a38: Status 404 returned error can't find the container with id 6902643a327038dceaf2337d738771ce1191fdf48a0b5d38e3d36c3d29f54a38
Jul 15 10:59:57.122757 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:57.122727    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:59:57.122841 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:57.122789    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:59:57.122841 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:57.122816    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 10:59:57.696352 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:57.696316    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw" event={"ID":"2415a259-510c-4c3a-bbc2-e9fa37e29780","Type":"ContainerStarted","Data":"9e34e92382cea712f90a7f859e554ef4f06ff51cf7601d0dce382b6447383c4d"}
Jul 15 10:59:57.696727 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:57.696375    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw" event={"ID":"2415a259-510c-4c3a-bbc2-e9fa37e29780","Type":"ContainerStarted","Data":"6902643a327038dceaf2337d738771ce1191fdf48a0b5d38e3d36c3d29f54a38"}
Jul 15 10:59:57.720936 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:57.720894    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw" podStartSLOduration=1.720879606 podStartE2EDuration="1.720879606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:59:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:59:57.719795089 +0000 UTC m=+2396.539436962" watchObservedRunningTime="2026-07-15 10:59:57.720879606 +0000 UTC m=+2396.540521478"
Jul 15 10:59:57.979063 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:57.978998    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:58.983857 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:58.983821    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:59.706763 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:59.706727    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:59.707630 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:59.707609    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 10:59:59.953658 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:59.953619    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"]
Jul 15 10:59:59.957232 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:59.957169    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"
Jul 15 10:59:59.961490 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:59.961470    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-b2a040-serving-cert\""
Jul 15 10:59:59.961490 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:59.961483    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 10:59:59.961773 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:59.961758    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 10:59:59.962258 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:59.962238    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zk7pv\""
Jul 15 10:59:59.977740 ip-10-0-134-102 kubenswrapper[2568]: I0715 10:59:59.977720    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"]
Jul 15 11:00:00.049346 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.049307    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb\" (UID: \"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"
Jul 15 11:00:00.049664 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.049361    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-maas-api-tls\") pod \"maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb\" (UID: \"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"
Jul 15 11:00:00.049664 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.049435    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-946ll\" (UniqueName: \"kubernetes.io/projected/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-kube-api-access-946ll\") pod \"maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb\" (UID: \"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"
Jul 15 11:00:00.150748 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.150726    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-946ll\" (UniqueName: \"kubernetes.io/projected/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-kube-api-access-946ll\") pod \"maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb\" (UID: \"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"
Jul 15 11:00:00.150878 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.150782    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb\" (UID: \"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"
Jul 15 11:00:00.150878 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.150829    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-maas-api-tls\") pod \"maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb\" (UID: \"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"
Jul 15 11:00:00.151476 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.151459    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb\" (UID: \"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"
Jul 15 11:00:00.153347 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.153330    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-maas-api-tls\") pod \"maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb\" (UID: \"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"
Jul 15 11:00:00.159194 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.159170    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft"]
Jul 15 11:00:00.162699 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.162683    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft"
Jul 15 11:00:00.170121 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.170098    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zj826\""
Jul 15 11:00:00.172298 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.172282    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735220-wglnn"]
Jul 15 11:00:00.172439 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.172423    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft"
Jul 15 11:00:00.175470 ip-10-0-134-102 kubenswrapper[2568]: E0715 11:00:00.175179    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft\" is forbidden: User \"system:node:ip-10-0-134-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-134-102.ec2.internal' and this object" podUID="91b2db29-7f13-4e60-821b-804716355f80" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft"
Jul 15 11:00:00.175470 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.175412    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-wglnn"
Jul 15 11:00:00.176327 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.176311    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-946ll\" (UniqueName: \"kubernetes.io/projected/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-kube-api-access-946ll\") pod \"maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb\" (UID: \"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"
Jul 15 11:00:00.185817 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.185797    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft"]
Jul 15 11:00:00.209560 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.209511    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-wglnn"
Jul 15 11:00:00.252405 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.252376    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735220-wglnn"]
Jul 15 11:00:00.268031 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.267793    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"
Jul 15 11:00:00.356010 ip-10-0-134-102 kubenswrapper[2568]: W0715 11:00:00.355982    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91b2db29_7f13_4e60_821b_804716355f80.slice/crio-6b721a0a354b0476d963280a1fd2e4f7fc3c15556bb5244650418334efcc98d6 WatchSource:0}: Error finding container 6b721a0a354b0476d963280a1fd2e4f7fc3c15556bb5244650418334efcc98d6: Status 404 returned error can't find the container with id 6b721a0a354b0476d963280a1fd2e4f7fc3c15556bb5244650418334efcc98d6
Jul 15 11:00:00.356167 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.356038    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft"]
Jul 15 11:00:00.383555 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.383530    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735220-wglnn"]
Jul 15 11:00:00.392295 ip-10-0-134-102 kubenswrapper[2568]: W0715 11:00:00.392271    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dc5cd4b_0662_4dab_a98f_66da17f48386.slice/crio-d0620de0d6cd839fd7e862c0654b9851129decd7584710ef908361af8e9fbd5e WatchSource:0}: Error finding container d0620de0d6cd839fd7e862c0654b9851129decd7584710ef908361af8e9fbd5e: Status 404 returned error can't find the container with id d0620de0d6cd839fd7e862c0654b9851129decd7584710ef908361af8e9fbd5e
Jul 15 11:00:00.447075 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.447050    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"]
Jul 15 11:00:00.447446 ip-10-0-134-102 kubenswrapper[2568]: W0715 11:00:00.447424    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7bc0fcc_c1a7_41fe_a6fe_2d3129898492.slice/crio-57d5ec1b426b0990bf8e2135cff029d98a829eabd39087ff3302738ee0f7115c WatchSource:0}: Error finding container 57d5ec1b426b0990bf8e2135cff029d98a829eabd39087ff3302738ee0f7115c: Status 404 returned error can't find the container with id 57d5ec1b426b0990bf8e2135cff029d98a829eabd39087ff3302738ee0f7115c
Jul 15 11:00:00.716877 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.716845    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft" event={"ID":"91b2db29-7f13-4e60-821b-804716355f80","Type":"ContainerStarted","Data":"9ad466fd91526cf2181fe6e778c04f7cd2f9d3ee7b4b32031ee69909513027a0"}
Jul 15 11:00:00.717002 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.716907    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft" event={"ID":"91b2db29-7f13-4e60-821b-804716355f80","Type":"ContainerStarted","Data":"6b721a0a354b0476d963280a1fd2e4f7fc3c15556bb5244650418334efcc98d6"}
Jul 15 11:00:00.718657 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.718635    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-wglnn" event={"ID":"7dc5cd4b-0662-4dab-a98f-66da17f48386","Type":"ContainerStarted","Data":"9f457248d047b2a1e5243c12e966c62ef1ea87c6aa484a15a1e2e09a6a26b3ef"}
Jul 15 11:00:00.718761 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.718674    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-wglnn" event={"ID":"7dc5cd4b-0662-4dab-a98f-66da17f48386","Type":"ContainerStarted","Data":"d0620de0d6cd839fd7e862c0654b9851129decd7584710ef908361af8e9fbd5e"}
Jul 15 11:00:00.719860 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.719840    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb" event={"ID":"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492","Type":"ContainerStarted","Data":"57d5ec1b426b0990bf8e2135cff029d98a829eabd39087ff3302738ee0f7115c"}
Jul 15 11:00:00.746644 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.746601    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft" podStartSLOduration=0.746589618 podStartE2EDuration="746.589618ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:00:00.743291386 +0000 UTC m=+2399.562933257" watchObservedRunningTime="2026-07-15 11:00:00.746589618 +0000 UTC m=+2399.566231468"
Jul 15 11:00:00.770523 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:00.770475    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-wglnn" podStartSLOduration=0.770463457 podStartE2EDuration="770.463457ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:00:00.769580668 +0000 UTC m=+2399.589222532" watchObservedRunningTime="2026-07-15 11:00:00.770463457 +0000 UTC m=+2399.590105327"
Jul 15 11:00:01.728351 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:01.728261    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb" event={"ID":"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492","Type":"ContainerStarted","Data":"263b7c6e7ad9f4d89b67388c08d87dfdcf5d94463c45b8bcd4458ba05c81c01f"}
Jul 15 11:00:01.728758 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:01.728365    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"
Jul 15 11:00:01.729949 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:01.729920    2568 generic.go:356] "Generic (PLEG): container finished" podID="91b2db29-7f13-4e60-821b-804716355f80" containerID="9ad466fd91526cf2181fe6e778c04f7cd2f9d3ee7b4b32031ee69909513027a0" exitCode=7
Jul 15 11:00:01.730093 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:01.729950    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft" event={"ID":"91b2db29-7f13-4e60-821b-804716355f80","Type":"ContainerDied","Data":"9ad466fd91526cf2181fe6e778c04f7cd2f9d3ee7b4b32031ee69909513027a0"}
Jul 15 11:00:01.730204 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:01.730130    2568 scope.go:117] "RemoveContainer" containerID="9ad466fd91526cf2181fe6e778c04f7cd2f9d3ee7b4b32031ee69909513027a0"
Jul 15 11:00:01.731420 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:01.731395    2568 generic.go:356] "Generic (PLEG): container finished" podID="7dc5cd4b-0662-4dab-a98f-66da17f48386" containerID="9f457248d047b2a1e5243c12e966c62ef1ea87c6aa484a15a1e2e09a6a26b3ef" exitCode=0
Jul 15 11:00:01.731552 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:01.731470    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-wglnn" event={"ID":"7dc5cd4b-0662-4dab-a98f-66da17f48386","Type":"ContainerDied","Data":"9f457248d047b2a1e5243c12e966c62ef1ea87c6aa484a15a1e2e09a6a26b3ef"}
Jul 15 11:00:01.741080 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:01.741061    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 11:00:01.748944 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:01.748929    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 11:00:01.756624 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:01.756573    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb" podStartSLOduration=2.212400021 podStartE2EDuration="2.75655693s" totalImagesPullingTime="544.156909ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:59:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:00:01.755292072 +0000 UTC m=+2400.574933948" watchObservedRunningTime="2026-07-15 11:00:01.75655693 +0000 UTC m=+2400.576198802"
Jul 15 11:00:02.738302 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:02.738232    2568 generic.go:356] "Generic (PLEG): container finished" podID="91b2db29-7f13-4e60-821b-804716355f80" containerID="46d56fbbea3d7b816c1e476f32357bdd1d9aa3e8c29abb0a4b06e4b7fe660e7d" exitCode=7
Jul 15 11:00:02.738721 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:02.738311    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft" event={"ID":"91b2db29-7f13-4e60-821b-804716355f80","Type":"ContainerDied","Data":"46d56fbbea3d7b816c1e476f32357bdd1d9aa3e8c29abb0a4b06e4b7fe660e7d"}
Jul 15 11:00:02.738721 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:02.738371    2568 scope.go:117] "RemoveContainer" containerID="9ad466fd91526cf2181fe6e778c04f7cd2f9d3ee7b4b32031ee69909513027a0"
Jul 15 11:00:02.738721 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:02.738558    2568 scope.go:117] "RemoveContainer" containerID="46d56fbbea3d7b816c1e476f32357bdd1d9aa3e8c29abb0a4b06e4b7fe660e7d"
Jul 15 11:00:02.738905 ip-10-0-134-102 kubenswrapper[2568]: E0715 11:00:02.738741    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft_odh-ai-gateway-infra(91b2db29-7f13-4e60-821b-804716355f80)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft" podUID="91b2db29-7f13-4e60-821b-804716355f80"
Jul 15 11:00:02.870741 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:02.870713    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-wglnn"
Jul 15 11:00:03.745068 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:03.745040    2568 scope.go:117] "RemoveContainer" containerID="46d56fbbea3d7b816c1e476f32357bdd1d9aa3e8c29abb0a4b06e4b7fe660e7d"
Jul 15 11:00:03.745472 ip-10-0-134-102 kubenswrapper[2568]: E0715 11:00:03.745257    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft_odh-ai-gateway-infra(91b2db29-7f13-4e60-821b-804716355f80)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft" podUID="91b2db29-7f13-4e60-821b-804716355f80"
Jul 15 11:00:03.746281 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:03.746259    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-wglnn"
Jul 15 11:00:03.746281 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:03.746268    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-wglnn" event={"ID":"7dc5cd4b-0662-4dab-a98f-66da17f48386","Type":"ContainerDied","Data":"d0620de0d6cd839fd7e862c0654b9851129decd7584710ef908361af8e9fbd5e"}
Jul 15 11:00:03.746439 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:03.746307    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0620de0d6cd839fd7e862c0654b9851129decd7584710ef908361af8e9fbd5e"
Jul 15 11:00:04.696093 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:04.696046    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:00:04.861676 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:04.861650    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"]
Jul 15 11:00:04.862041 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:04.861971    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dc5cd4b-0662-4dab-a98f-66da17f48386" containerName="cleanup"
Jul 15 11:00:04.862041 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:04.861982    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dc5cd4b-0662-4dab-a98f-66da17f48386" containerName="cleanup"
Jul 15 11:00:04.862041 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:04.862041    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dc5cd4b-0662-4dab-a98f-66da17f48386" containerName="cleanup"
Jul 15 11:00:04.864981 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:04.864959    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:04.869522 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:04.869504    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-ceb9f0-openshift-default-dockercfg-s8gq7\""
Jul 15 11:00:04.883521 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:04.883489    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"]
Jul 15 11:00:04.995259 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:04.995234    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istiod-ca-cert\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:04.995430 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:04.995274    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-workload-socket\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:04.995430 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:04.995301    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-workload-certs\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:04.995430 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:04.995374    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-credential-socket\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:04.995430 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:04.995395    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-data\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:04.995671 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:04.995456    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-envoy\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:04.995671 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:04.995511    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-token\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:04.995671 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:04.995544    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-podinfo\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:04.995671 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:04.995571    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j992h\" (UniqueName: \"kubernetes.io/projected/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-kube-api-access-j992h\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.096445 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.096408    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-token\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.096445 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.096447    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-podinfo\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.096659 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.096471    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j992h\" (UniqueName: \"kubernetes.io/projected/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-kube-api-access-j992h\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.096659 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.096529    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istiod-ca-cert\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.096659 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.096563    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-workload-socket\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.096659 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.096602    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-workload-certs\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.096869 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.096665    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-credential-socket\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.096869 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.096687    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-data\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.096869 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.096713    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-envoy\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.097086 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.097061    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-workload-certs\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.097182 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.097094    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-workload-socket\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.097182 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.097133    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-credential-socket\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.097465 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.097223    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-data\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.097465 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.097339    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istiod-ca-cert\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.099044 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.099011    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-envoy\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.099239 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.099219    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-podinfo\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.108744 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.108715    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-token\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.108744 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.108741    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j992h\" (UniqueName: \"kubernetes.io/projected/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-kube-api-access-j992h\") pod \"e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") " pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.174483 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.174457    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:05.324400 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.324374    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"]
Jul 15 11:00:05.325716 ip-10-0-134-102 kubenswrapper[2568]: W0715 11:00:05.325690    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode47dfaf4_2ab2_427d_96dc_62f8dcc70e67.slice/crio-14a67113364d7b1ad356bbd01dd050809619d86a63b84751b8102ff9d0e4a20b WatchSource:0}: Error finding container 14a67113364d7b1ad356bbd01dd050809619d86a63b84751b8102ff9d0e4a20b: Status 404 returned error can't find the container with id 14a67113364d7b1ad356bbd01dd050809619d86a63b84751b8102ff9d0e4a20b
Jul 15 11:00:05.327824 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.327797    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 11:00:05.327877 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.327864    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 11:00:05.327912 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.327894    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 11:00:05.757477 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.757446    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx" event={"ID":"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67","Type":"ContainerStarted","Data":"4463a5beb7f6dea4e60fa35ae528c0e4fa29ce462a37f1111c114dad62d0bdca"}
Jul 15 11:00:05.757633 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.757497    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx" event={"ID":"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67","Type":"ContainerStarted","Data":"14a67113364d7b1ad356bbd01dd050809619d86a63b84751b8102ff9d0e4a20b"}
Jul 15 11:00:05.808906 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:05.808854    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx" podStartSLOduration=1.80883857 podStartE2EDuration="1.80883857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:00:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:00:05.808011229 +0000 UTC m=+2404.627653099" watchObservedRunningTime="2026-07-15 11:00:05.80883857 +0000 UTC m=+2404.628480440"
Jul 15 11:00:06.175038 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:06.174938    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:06.179532 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:06.179506    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:06.773134 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:06.772756    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:06.779133 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:06.778370    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:07.743512 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:07.743485    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"
Jul 15 11:00:13.705565 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:13.705489    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:00:13.815417 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:13.815383    2568 generic.go:356] "Generic (PLEG): container finished" podID="2415a259-510c-4c3a-bbc2-e9fa37e29780" containerID="9e34e92382cea712f90a7f859e554ef4f06ff51cf7601d0dce382b6447383c4d" exitCode=0
Jul 15 11:00:13.815602 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:13.815464    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw" event={"ID":"2415a259-510c-4c3a-bbc2-e9fa37e29780","Type":"ContainerDied","Data":"9e34e92382cea712f90a7f859e554ef4f06ff51cf7601d0dce382b6447383c4d"}
Jul 15 11:00:13.815876 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:13.815859    2568 scope.go:117] "RemoveContainer" containerID="9e34e92382cea712f90a7f859e554ef4f06ff51cf7601d0dce382b6447383c4d"
Jul 15 11:00:13.816872 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:13.816846    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 11:00:13.816969 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:13.816908    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 11:00:13.816969 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:13.816940    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 11:00:14.707208 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:14.707176    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 11:00:14.823024 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:14.822986    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw" event={"ID":"2415a259-510c-4c3a-bbc2-e9fa37e29780","Type":"ContainerStarted","Data":"7da910bae79861ec3e77ea11bae2e3e85cac26ed3b6b209c5001cf6a5105be98"}
Jul 15 11:00:14.980051 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:14.979949    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 11:00:14.980465 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:14.980440    2568 patch_prober.go:28] interesting pod/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 15 11:00:14.980652 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:14.980627    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw" podUID="2415a259-510c-4c3a-bbc2-e9fa37e29780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 15 11:00:15.642542 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:15.642515    2568 scope.go:117] "RemoveContainer" containerID="46d56fbbea3d7b816c1e476f32357bdd1d9aa3e8c29abb0a4b06e4b7fe660e7d"
Jul 15 11:00:15.978717 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:15.978678    2568 patch_prober.go:28] interesting pod/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 15 11:00:15.979230 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:15.978739    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw" podUID="2415a259-510c-4c3a-bbc2-e9fa37e29780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 15 11:00:16.835314 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:16.835275    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft" event={"ID":"91b2db29-7f13-4e60-821b-804716355f80","Type":"ContainerStarted","Data":"d360a33fece81c556fa27060f4426266921911ec830e0d13cf10606f7f4c6c3d"}
Jul 15 11:00:16.979395 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:16.979359    2568 patch_prober.go:28] interesting pod/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 15 11:00:16.979976 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:16.979940    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw" podUID="2415a259-510c-4c3a-bbc2-e9fa37e29780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 15 11:00:17.842357 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:17.842324    2568 generic.go:356] "Generic (PLEG): container finished" podID="91b2db29-7f13-4e60-821b-804716355f80" containerID="d360a33fece81c556fa27060f4426266921911ec830e0d13cf10606f7f4c6c3d" exitCode=0
Jul 15 11:00:17.842552 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:17.842390    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft" event={"ID":"91b2db29-7f13-4e60-821b-804716355f80","Type":"ContainerDied","Data":"d360a33fece81c556fa27060f4426266921911ec830e0d13cf10606f7f4c6c3d"}
Jul 15 11:00:17.842552 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:17.842447    2568 scope.go:117] "RemoveContainer" containerID="46d56fbbea3d7b816c1e476f32357bdd1d9aa3e8c29abb0a4b06e4b7fe660e7d"
Jul 15 11:00:17.904138 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:17.902173    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft"]
Jul 15 11:00:17.979344 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:17.979302    2568 patch_prober.go:28] interesting pod/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 15 11:00:17.979547 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:17.979377    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw" podUID="2415a259-510c-4c3a-bbc2-e9fa37e29780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 15 11:00:18.983268 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:18.983231    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 11:00:18.983689 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:18.983658    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 11:00:18.984679 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:18.984659    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 11:00:19.005551 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:19.005529    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft"
Jul 15 11:00:19.858101 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:19.858067    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft"
Jul 15 11:00:19.858101 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:19.858073    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft" event={"ID":"91b2db29-7f13-4e60-821b-804716355f80","Type":"ContainerDied","Data":"6b721a0a354b0476d963280a1fd2e4f7fc3c15556bb5244650418334efcc98d6"}
Jul 15 11:00:19.858352 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:19.858163    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b721a0a354b0476d963280a1fd2e4f7fc3c15556bb5244650418334efcc98d6"
Jul 15 11:00:19.908163 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:19.908052    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft"]
Jul 15 11:00:19.921416 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:19.921376    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b2a040-29735220-46dft"]
Jul 15 11:00:21.647208 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:21.647097    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91b2db29-7f13-4e60-821b-804716355f80" path="/var/lib/kubelet/pods/91b2db29-7f13-4e60-821b-804716355f80/volumes"
Jul 15 11:00:21.774137 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:21.774079    2568 patch_prober.go:28] interesting pod/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 15 11:00:21.774299 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:21.774162    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx" podUID="e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 15 11:00:21.870216 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:21.870188    2568 generic.go:356] "Generic (PLEG): container finished" podID="e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" containerID="4463a5beb7f6dea4e60fa35ae528c0e4fa29ce462a37f1111c114dad62d0bdca" exitCode=0
Jul 15 11:00:21.870379 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:21.870272    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx" event={"ID":"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67","Type":"ContainerDied","Data":"4463a5beb7f6dea4e60fa35ae528c0e4fa29ce462a37f1111c114dad62d0bdca"}
Jul 15 11:00:21.870777 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:21.870757    2568 scope.go:117] "RemoveContainer" containerID="4463a5beb7f6dea4e60fa35ae528c0e4fa29ce462a37f1111c114dad62d0bdca"
Jul 15 11:00:21.871833 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:21.871805    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 11:00:21.871920 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:21.871869    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 11:00:21.871920 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:21.871901    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 15 11:00:22.879103 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:22.879059    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx" event={"ID":"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67","Type":"ContainerStarted","Data":"83866d4bb079d145bfad866208e6a8e0e3d2e31272b48bd343601ba0c6bd3a91"}
Jul 15 11:00:23.175867 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:23.175740    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:23.176255 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:23.176228    2568 patch_prober.go:28] interesting pod/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 15 11:00:23.176452 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:23.176429    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx" podUID="e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 15 11:00:24.175808 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:24.175761    2568 patch_prober.go:28] interesting pod/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 15 11:00:24.176313 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:24.175831    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx" podUID="e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 15 11:00:25.175423 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:25.175389    2568 patch_prober.go:28] interesting pod/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 15 11:00:25.175712 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:25.175683    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx" podUID="e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 15 11:00:25.892901 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:25.892865    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:00:26.175804 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:26.175709    2568 patch_prober.go:28] interesting pod/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 15 11:00:26.176080 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:26.176041    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx" podUID="e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 15 11:00:27.175336 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:27.175296    2568 patch_prober.go:28] interesting pod/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 15 11:00:27.175844 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:27.175349    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx" podUID="e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 15 11:00:28.178424 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:28.178391    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:28.178854 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:28.178651    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:00:28.179334 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:00:28.179317    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:01:06.490731 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:01:06.490699    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:01:20.220299 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:01:20.220269    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:01:36.618894 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:01:36.618863    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:01:53.696704 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:01:53.696630    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:02:07.706265 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:02:07.706236    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:02:24.988582 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:02:24.988551    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:02:41.409377 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:02:41.409346    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:02:59.694503 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:02:59.694464    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:03:17.388082 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:03:17.388034    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:03:38.403215 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:03:38.403134    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:03:52.785015 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:03:52.784982    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:04:11.893106 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:04:11.893074    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:04:30.091280 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:04:30.091243    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:04:50.600653 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:04:50.600611    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:05:01.776197 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:05:01.776096    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 11:05:01.786598 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:05:01.786578    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b94br_28e62077-4f3c-41b1-a6da-ffd066a86033/ovn-acl-logging/0.log"
Jul 15 11:05:05.485946 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:05:05.485912    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:05:25.792094 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:05:25.792058    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:05:39.900292 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:05:39.900251    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:06:02.104292 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.104257    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"]
Jul 15 11:06:02.104705 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.104465    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb" podUID="b7bc0fcc-c1a7-41fe-a6fe-2d3129898492" containerName="maas-api" containerID="cri-o://263b7c6e7ad9f4d89b67388c08d87dfdcf5d94463c45b8bcd4458ba05c81c01f" gracePeriod=30
Jul 15 11:06:02.359206 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.359143    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"
Jul 15 11:06:02.544431 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.544388    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-maas-api-tls\") pod \"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492\" (UID: \"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492\") "
Jul 15 11:06:02.544621 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.544461    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-946ll\" (UniqueName: \"kubernetes.io/projected/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-kube-api-access-946ll\") pod \"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492\" (UID: \"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492\") "
Jul 15 11:06:02.544621 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.544541    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-openshift-service-ca\") pod \"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492\" (UID: \"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492\") "
Jul 15 11:06:02.544942 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.544914    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b7bc0fcc-c1a7-41fe-a6fe-2d3129898492" (UID: "b7bc0fcc-c1a7-41fe-a6fe-2d3129898492"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 11:06:02.546799 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.546772    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b7bc0fcc-c1a7-41fe-a6fe-2d3129898492" (UID: "b7bc0fcc-c1a7-41fe-a6fe-2d3129898492"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 11:06:02.546898 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.546836    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-kube-api-access-946ll" (OuterVolumeSpecName: "kube-api-access-946ll") pod "b7bc0fcc-c1a7-41fe-a6fe-2d3129898492" (UID: "b7bc0fcc-c1a7-41fe-a6fe-2d3129898492"). InnerVolumeSpecName "kube-api-access-946ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 11:06:02.645456 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.645366    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-openshift-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:02.645456 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.645394    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-maas-api-tls\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:02.645456 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.645404    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-946ll\" (UniqueName: \"kubernetes.io/projected/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492-kube-api-access-946ll\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:02.722823 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.722791    2568 generic.go:356] "Generic (PLEG): container finished" podID="b7bc0fcc-c1a7-41fe-a6fe-2d3129898492" containerID="263b7c6e7ad9f4d89b67388c08d87dfdcf5d94463c45b8bcd4458ba05c81c01f" exitCode=0
Jul 15 11:06:02.723039 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.722835    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"
Jul 15 11:06:02.723039 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.722881    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb" event={"ID":"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492","Type":"ContainerDied","Data":"263b7c6e7ad9f4d89b67388c08d87dfdcf5d94463c45b8bcd4458ba05c81c01f"}
Jul 15 11:06:02.723039 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.722950    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb" event={"ID":"b7bc0fcc-c1a7-41fe-a6fe-2d3129898492","Type":"ContainerDied","Data":"57d5ec1b426b0990bf8e2135cff029d98a829eabd39087ff3302738ee0f7115c"}
Jul 15 11:06:02.723039 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.722979    2568 scope.go:117] "RemoveContainer" containerID="263b7c6e7ad9f4d89b67388c08d87dfdcf5d94463c45b8bcd4458ba05c81c01f"
Jul 15 11:06:02.732961 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.732944    2568 scope.go:117] "RemoveContainer" containerID="263b7c6e7ad9f4d89b67388c08d87dfdcf5d94463c45b8bcd4458ba05c81c01f"
Jul 15 11:06:02.733240 ip-10-0-134-102 kubenswrapper[2568]: E0715 11:06:02.733221    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"263b7c6e7ad9f4d89b67388c08d87dfdcf5d94463c45b8bcd4458ba05c81c01f\": container with ID starting with 263b7c6e7ad9f4d89b67388c08d87dfdcf5d94463c45b8bcd4458ba05c81c01f not found: ID does not exist" containerID="263b7c6e7ad9f4d89b67388c08d87dfdcf5d94463c45b8bcd4458ba05c81c01f"
Jul 15 11:06:02.733311 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.733249    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"263b7c6e7ad9f4d89b67388c08d87dfdcf5d94463c45b8bcd4458ba05c81c01f"} err="failed to get container status \"263b7c6e7ad9f4d89b67388c08d87dfdcf5d94463c45b8bcd4458ba05c81c01f\": rpc error: code = NotFound desc = could not find container \"263b7c6e7ad9f4d89b67388c08d87dfdcf5d94463c45b8bcd4458ba05c81c01f\": container with ID starting with 263b7c6e7ad9f4d89b67388c08d87dfdcf5d94463c45b8bcd4458ba05c81c01f not found: ID does not exist"
Jul 15 11:06:02.747384 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.747350    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"]
Jul 15 11:06:02.753359 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:02.753335    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b2a040-84bf5658fc-r6dtb"]
Jul 15 11:06:03.648471 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:03.648438    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7bc0fcc-c1a7-41fe-a6fe-2d3129898492" path="/var/lib/kubelet/pods/b7bc0fcc-c1a7-41fe-a6fe-2d3129898492/volumes"
Jul 15 11:06:05.310223 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:05.310181    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:06:17.361029 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.360992    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"]
Jul 15 11:06:17.361495 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.361260    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw" podUID="2415a259-510c-4c3a-bbc2-e9fa37e29780" containerName="istio-proxy" containerID="cri-o://7da910bae79861ec3e77ea11bae2e3e85cac26ed3b6b209c5001cf6a5105be98" gracePeriod=30
Jul 15 11:06:17.709509 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.709430    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt"]
Jul 15 11:06:17.709829 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.709815    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7bc0fcc-c1a7-41fe-a6fe-2d3129898492" containerName="maas-api"
Jul 15 11:06:17.709889 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.709833    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7bc0fcc-c1a7-41fe-a6fe-2d3129898492" containerName="maas-api"
Jul 15 11:06:17.709889 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.709847    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91b2db29-7f13-4e60-821b-804716355f80" containerName="cleanup"
Jul 15 11:06:17.709889 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.709854    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b2db29-7f13-4e60-821b-804716355f80" containerName="cleanup"
Jul 15 11:06:17.709889 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.709869    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91b2db29-7f13-4e60-821b-804716355f80" containerName="cleanup"
Jul 15 11:06:17.709889 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.709874    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b2db29-7f13-4e60-821b-804716355f80" containerName="cleanup"
Jul 15 11:06:17.710044 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.709936    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="91b2db29-7f13-4e60-821b-804716355f80" containerName="cleanup"
Jul 15 11:06:17.710044 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.709946    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="91b2db29-7f13-4e60-821b-804716355f80" containerName="cleanup"
Jul 15 11:06:17.710044 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.709951    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7bc0fcc-c1a7-41fe-a6fe-2d3129898492" containerName="maas-api"
Jul 15 11:06:17.713100 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.713078    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt"
Jul 15 11:06:17.715751 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.715726    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 11:06:17.715886 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.715814    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zj826\""
Jul 15 11:06:17.722668 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.722638    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt"]
Jul 15 11:06:17.759187 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.759159    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c0ebfe3-fe94-4beb-baed-7b885bfa38a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt\" (UID: \"5c0ebfe3-fe94-4beb-baed-7b885bfa38a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt"
Jul 15 11:06:17.860455 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.860425    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c0ebfe3-fe94-4beb-baed-7b885bfa38a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt\" (UID: \"5c0ebfe3-fe94-4beb-baed-7b885bfa38a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt"
Jul 15 11:06:17.861002 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:17.860977    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c0ebfe3-fe94-4beb-baed-7b885bfa38a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt\" (UID: \"5c0ebfe3-fe94-4beb-baed-7b885bfa38a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt"
Jul 15 11:06:18.024459 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:18.024435    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt"
Jul 15 11:06:18.169201 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:18.169171    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt"]
Jul 15 11:06:18.170340 ip-10-0-134-102 kubenswrapper[2568]: W0715 11:06:18.170312    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c0ebfe3_fe94_4beb_baed_7b885bfa38a0.slice/crio-df4571ed418e49a8e61e6f60f9c6851e9d4123209ea97dbe51454b4e61962b30 WatchSource:0}: Error finding container df4571ed418e49a8e61e6f60f9c6851e9d4123209ea97dbe51454b4e61962b30: Status 404 returned error can't find the container with id df4571ed418e49a8e61e6f60f9c6851e9d4123209ea97dbe51454b4e61962b30
Jul 15 11:06:18.813180 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:18.813141    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt" event={"ID":"5c0ebfe3-fe94-4beb-baed-7b885bfa38a0","Type":"ContainerStarted","Data":"6571fcc57a27716dcd3bd52b94ab3df862db9cdca4257f6bb659422ffb95ec56"}
Jul 15 11:06:18.813565 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:18.813240    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt" event={"ID":"5c0ebfe3-fe94-4beb-baed-7b885bfa38a0","Type":"ContainerStarted","Data":"df4571ed418e49a8e61e6f60f9c6851e9d4123209ea97dbe51454b4e61962b30"}
Jul 15 11:06:18.852797 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:18.852752    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt" podStartSLOduration=1.8527379499999999 podStartE2EDuration="1.85273795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:06:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:06:18.849818848 +0000 UTC m=+2777.669460721" watchObservedRunningTime="2026-07-15 11:06:18.85273795 +0000 UTC m=+2777.672379842"
Jul 15 11:06:18.985783 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:18.985750    2568 patch_prober.go:28] interesting pod/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 11:06:18.985898 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:18.985802    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw" podUID="2415a259-510c-4c3a-bbc2-e9fa37e29780" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 11:06:19.820871 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:19.820836    2568 generic.go:356] "Generic (PLEG): container finished" podID="5c0ebfe3-fe94-4beb-baed-7b885bfa38a0" containerID="6571fcc57a27716dcd3bd52b94ab3df862db9cdca4257f6bb659422ffb95ec56" exitCode=0
Jul 15 11:06:19.821265 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:19.820929    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt" event={"ID":"5c0ebfe3-fe94-4beb-baed-7b885bfa38a0","Type":"ContainerDied","Data":"6571fcc57a27716dcd3bd52b94ab3df862db9cdca4257f6bb659422ffb95ec56"}
Jul 15 11:06:20.954035 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:20.954011    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt"
Jul 15 11:06:20.983184 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:20.983157    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c0ebfe3-fe94-4beb-baed-7b885bfa38a0-maas-api-service-ca\") pod \"5c0ebfe3-fe94-4beb-baed-7b885bfa38a0\" (UID: \"5c0ebfe3-fe94-4beb-baed-7b885bfa38a0\") "
Jul 15 11:06:20.983478 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:20.983457    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c0ebfe3-fe94-4beb-baed-7b885bfa38a0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5c0ebfe3-fe94-4beb-baed-7b885bfa38a0" (UID: "5c0ebfe3-fe94-4beb-baed-7b885bfa38a0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 11:06:21.084567 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:21.084494    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c0ebfe3-fe94-4beb-baed-7b885bfa38a0-maas-api-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:21.833495 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:21.833467    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt"
Jul 15 11:06:21.833658 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:21.833460    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt" event={"ID":"5c0ebfe3-fe94-4beb-baed-7b885bfa38a0","Type":"ContainerDied","Data":"df4571ed418e49a8e61e6f60f9c6851e9d4123209ea97dbe51454b4e61962b30"}
Jul 15 11:06:21.833658 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:21.833595    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df4571ed418e49a8e61e6f60f9c6851e9d4123209ea97dbe51454b4e61962b30"
Jul 15 11:06:22.616944 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.616922    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 11:06:22.699280 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.699205    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-data\") pod \"2415a259-510c-4c3a-bbc2-e9fa37e29780\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") "
Jul 15 11:06:22.699280 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.699238    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-workload-socket\") pod \"2415a259-510c-4c3a-bbc2-e9fa37e29780\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") "
Jul 15 11:06:22.699280 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.699267    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-token\") pod \"2415a259-510c-4c3a-bbc2-e9fa37e29780\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") "
Jul 15 11:06:22.699515 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.699307    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-workload-certs\") pod \"2415a259-510c-4c3a-bbc2-e9fa37e29780\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") "
Jul 15 11:06:22.699515 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.699345    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g42ng\" (UniqueName: \"kubernetes.io/projected/2415a259-510c-4c3a-bbc2-e9fa37e29780-kube-api-access-g42ng\") pod \"2415a259-510c-4c3a-bbc2-e9fa37e29780\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") "
Jul 15 11:06:22.699515 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.699389    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-podinfo\") pod \"2415a259-510c-4c3a-bbc2-e9fa37e29780\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") "
Jul 15 11:06:22.699515 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.699438    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-credential-socket\") pod \"2415a259-510c-4c3a-bbc2-e9fa37e29780\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") "
Jul 15 11:06:22.699515 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.699462    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2415a259-510c-4c3a-bbc2-e9fa37e29780-istiod-ca-cert\") pod \"2415a259-510c-4c3a-bbc2-e9fa37e29780\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") "
Jul 15 11:06:22.699515 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.699494    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-envoy\") pod \"2415a259-510c-4c3a-bbc2-e9fa37e29780\" (UID: \"2415a259-510c-4c3a-bbc2-e9fa37e29780\") "
Jul 15 11:06:22.699515 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.699502    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2415a259-510c-4c3a-bbc2-e9fa37e29780" (UID: "2415a259-510c-4c3a-bbc2-e9fa37e29780"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 11:06:22.699831 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.699625    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2415a259-510c-4c3a-bbc2-e9fa37e29780" (UID: "2415a259-510c-4c3a-bbc2-e9fa37e29780"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 11:06:22.699894 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.699827    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2415a259-510c-4c3a-bbc2-e9fa37e29780-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2415a259-510c-4c3a-bbc2-e9fa37e29780" (UID: "2415a259-510c-4c3a-bbc2-e9fa37e29780"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 11:06:22.699952 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.699930    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2415a259-510c-4c3a-bbc2-e9fa37e29780-istiod-ca-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:22.700006 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.699950    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-workload-socket\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:22.700006 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.699965    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-workload-certs\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:22.700006 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.699954    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2415a259-510c-4c3a-bbc2-e9fa37e29780" (UID: "2415a259-510c-4c3a-bbc2-e9fa37e29780"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 11:06:22.700393 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.700357    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-data" (OuterVolumeSpecName: "istio-data") pod "2415a259-510c-4c3a-bbc2-e9fa37e29780" (UID: "2415a259-510c-4c3a-bbc2-e9fa37e29780"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 11:06:22.701809 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.701788    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-token" (OuterVolumeSpecName: "istio-token") pod "2415a259-510c-4c3a-bbc2-e9fa37e29780" (UID: "2415a259-510c-4c3a-bbc2-e9fa37e29780"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 11:06:22.701809 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.701788    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2415a259-510c-4c3a-bbc2-e9fa37e29780" (UID: "2415a259-510c-4c3a-bbc2-e9fa37e29780"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 11:06:22.702046 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.702023    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2415a259-510c-4c3a-bbc2-e9fa37e29780-kube-api-access-g42ng" (OuterVolumeSpecName: "kube-api-access-g42ng") pod "2415a259-510c-4c3a-bbc2-e9fa37e29780" (UID: "2415a259-510c-4c3a-bbc2-e9fa37e29780"). InnerVolumeSpecName "kube-api-access-g42ng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 11:06:22.702269 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.702249    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2415a259-510c-4c3a-bbc2-e9fa37e29780" (UID: "2415a259-510c-4c3a-bbc2-e9fa37e29780"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 11:06:22.800536 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.800511    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-envoy\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:22.800536 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.800532    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-data\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:22.800536 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.800540    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-token\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:22.800693 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.800549    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g42ng\" (UniqueName: \"kubernetes.io/projected/2415a259-510c-4c3a-bbc2-e9fa37e29780-kube-api-access-g42ng\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:22.800693 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.800558    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2415a259-510c-4c3a-bbc2-e9fa37e29780-istio-podinfo\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:22.800693 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.800567    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2415a259-510c-4c3a-bbc2-e9fa37e29780-credential-socket\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:22.841432 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.841406    2568 generic.go:356] "Generic (PLEG): container finished" podID="2415a259-510c-4c3a-bbc2-e9fa37e29780" containerID="7da910bae79861ec3e77ea11bae2e3e85cac26ed3b6b209c5001cf6a5105be98" exitCode=0
Jul 15 11:06:22.841536 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.841454    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"
Jul 15 11:06:22.841536 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.841492    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw" event={"ID":"2415a259-510c-4c3a-bbc2-e9fa37e29780","Type":"ContainerDied","Data":"7da910bae79861ec3e77ea11bae2e3e85cac26ed3b6b209c5001cf6a5105be98"}
Jul 15 11:06:22.841607 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.841547    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw" event={"ID":"2415a259-510c-4c3a-bbc2-e9fa37e29780","Type":"ContainerDied","Data":"6902643a327038dceaf2337d738771ce1191fdf48a0b5d38e3d36c3d29f54a38"}
Jul 15 11:06:22.841607 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.841569    2568 scope.go:117] "RemoveContainer" containerID="7da910bae79861ec3e77ea11bae2e3e85cac26ed3b6b209c5001cf6a5105be98"
Jul 15 11:06:22.853413 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.853398    2568 scope.go:117] "RemoveContainer" containerID="9e34e92382cea712f90a7f859e554ef4f06ff51cf7601d0dce382b6447383c4d"
Jul 15 11:06:22.861531 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.861514    2568 scope.go:117] "RemoveContainer" containerID="7da910bae79861ec3e77ea11bae2e3e85cac26ed3b6b209c5001cf6a5105be98"
Jul 15 11:06:22.861783 ip-10-0-134-102 kubenswrapper[2568]: E0715 11:06:22.861766    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7da910bae79861ec3e77ea11bae2e3e85cac26ed3b6b209c5001cf6a5105be98\": container with ID starting with 7da910bae79861ec3e77ea11bae2e3e85cac26ed3b6b209c5001cf6a5105be98 not found: ID does not exist" containerID="7da910bae79861ec3e77ea11bae2e3e85cac26ed3b6b209c5001cf6a5105be98"
Jul 15 11:06:22.861818 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.861794    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7da910bae79861ec3e77ea11bae2e3e85cac26ed3b6b209c5001cf6a5105be98"} err="failed to get container status \"7da910bae79861ec3e77ea11bae2e3e85cac26ed3b6b209c5001cf6a5105be98\": rpc error: code = NotFound desc = could not find container \"7da910bae79861ec3e77ea11bae2e3e85cac26ed3b6b209c5001cf6a5105be98\": container with ID starting with 7da910bae79861ec3e77ea11bae2e3e85cac26ed3b6b209c5001cf6a5105be98 not found: ID does not exist"
Jul 15 11:06:22.861818 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.861812    2568 scope.go:117] "RemoveContainer" containerID="9e34e92382cea712f90a7f859e554ef4f06ff51cf7601d0dce382b6447383c4d"
Jul 15 11:06:22.862069 ip-10-0-134-102 kubenswrapper[2568]: E0715 11:06:22.862051    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e34e92382cea712f90a7f859e554ef4f06ff51cf7601d0dce382b6447383c4d\": container with ID starting with 9e34e92382cea712f90a7f859e554ef4f06ff51cf7601d0dce382b6447383c4d not found: ID does not exist" containerID="9e34e92382cea712f90a7f859e554ef4f06ff51cf7601d0dce382b6447383c4d"
Jul 15 11:06:22.862125 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.862077    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e34e92382cea712f90a7f859e554ef4f06ff51cf7601d0dce382b6447383c4d"} err="failed to get container status \"9e34e92382cea712f90a7f859e554ef4f06ff51cf7601d0dce382b6447383c4d\": rpc error: code = NotFound desc = could not find container \"9e34e92382cea712f90a7f859e554ef4f06ff51cf7601d0dce382b6447383c4d\": container with ID starting with 9e34e92382cea712f90a7f859e554ef4f06ff51cf7601d0dce382b6447383c4d not found: ID does not exist"
Jul 15 11:06:22.872728 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.872709    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"]
Jul 15 11:06:22.876229 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:22.876208    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-b2a040-openshift-default-847c97455f-qwsxw"]
Jul 15 11:06:23.647822 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:23.647788    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2415a259-510c-4c3a-bbc2-e9fa37e29780" path="/var/lib/kubelet/pods/2415a259-510c-4c3a-bbc2-e9fa37e29780/volumes"
Jul 15 11:06:31.626615 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:31.626582    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mxbk2"]
Jul 15 11:06:43.603876 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:43.603843    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"]
Jul 15 11:06:43.604366 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:43.604068    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx" podUID="e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" containerName="istio-proxy" containerID="cri-o://83866d4bb079d145bfad866208e6a8e0e3d2e31272b48bd343601ba0c6bd3a91" gracePeriod=30
Jul 15 11:06:48.858641 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.858617    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:06:48.918509 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.918437    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-workload-certs\") pod \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") "
Jul 15 11:06:48.918509 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.918479    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istiod-ca-cert\") pod \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") "
Jul 15 11:06:48.918509 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.918496    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-credential-socket\") pod \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") "
Jul 15 11:06:48.918746 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.918513    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j992h\" (UniqueName: \"kubernetes.io/projected/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-kube-api-access-j992h\") pod \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") "
Jul 15 11:06:48.918746 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.918545    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-envoy\") pod \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") "
Jul 15 11:06:48.918746 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.918575    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-workload-socket\") pod \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") "
Jul 15 11:06:48.918746 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.918592    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-data\") pod \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") "
Jul 15 11:06:48.918746 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.918612    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-token\") pod \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") "
Jul 15 11:06:48.918746 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.918651    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-podinfo\") pod \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\" (UID: \"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67\") "
Jul 15 11:06:48.919068 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.918762    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" (UID: "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 11:06:48.919068 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.918778    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" (UID: "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 11:06:48.919068 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.918908    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-workload-certs\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:48.919068 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.918935    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-credential-socket\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:48.919068 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.918973    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" (UID: "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 11:06:48.919068 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.919025    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" (UID: "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 11:06:48.919653 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.919613    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-data" (OuterVolumeSpecName: "istio-data") pod "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" (UID: "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 11:06:48.920869 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.920851    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" (UID: "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 11:06:48.920993 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.920976    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-token" (OuterVolumeSpecName: "istio-token") pod "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" (UID: "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 11:06:48.921272 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.921243    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-kube-api-access-j992h" (OuterVolumeSpecName: "kube-api-access-j992h") pod "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" (UID: "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67"). InnerVolumeSpecName "kube-api-access-j992h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 11:06:48.921398 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.921335    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" (UID: "e47dfaf4-2ab2-427d-96dc-62f8dcc70e67"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 11:06:48.980306 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.980263    2568 generic.go:356] "Generic (PLEG): container finished" podID="e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" containerID="83866d4bb079d145bfad866208e6a8e0e3d2e31272b48bd343601ba0c6bd3a91" exitCode=0
Jul 15 11:06:48.980422 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.980313    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"
Jul 15 11:06:48.980422 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.980325    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx" event={"ID":"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67","Type":"ContainerDied","Data":"83866d4bb079d145bfad866208e6a8e0e3d2e31272b48bd343601ba0c6bd3a91"}
Jul 15 11:06:48.980422 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.980378    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx" event={"ID":"e47dfaf4-2ab2-427d-96dc-62f8dcc70e67","Type":"ContainerDied","Data":"14a67113364d7b1ad356bbd01dd050809619d86a63b84751b8102ff9d0e4a20b"}
Jul 15 11:06:48.980422 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.980400    2568 scope.go:117] "RemoveContainer" containerID="83866d4bb079d145bfad866208e6a8e0e3d2e31272b48bd343601ba0c6bd3a91"
Jul 15 11:06:48.989903 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.989885    2568 scope.go:117] "RemoveContainer" containerID="4463a5beb7f6dea4e60fa35ae528c0e4fa29ce462a37f1111c114dad62d0bdca"
Jul 15 11:06:48.998008 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.997990    2568 scope.go:117] "RemoveContainer" containerID="83866d4bb079d145bfad866208e6a8e0e3d2e31272b48bd343601ba0c6bd3a91"
Jul 15 11:06:48.998284 ip-10-0-134-102 kubenswrapper[2568]: E0715 11:06:48.998265    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83866d4bb079d145bfad866208e6a8e0e3d2e31272b48bd343601ba0c6bd3a91\": container with ID starting with 83866d4bb079d145bfad866208e6a8e0e3d2e31272b48bd343601ba0c6bd3a91 not found: ID does not exist" containerID="83866d4bb079d145bfad866208e6a8e0e3d2e31272b48bd343601ba0c6bd3a91"
Jul 15 11:06:48.998348 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.998292    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83866d4bb079d145bfad866208e6a8e0e3d2e31272b48bd343601ba0c6bd3a91"} err="failed to get container status \"83866d4bb079d145bfad866208e6a8e0e3d2e31272b48bd343601ba0c6bd3a91\": rpc error: code = NotFound desc = could not find container \"83866d4bb079d145bfad866208e6a8e0e3d2e31272b48bd343601ba0c6bd3a91\": container with ID starting with 83866d4bb079d145bfad866208e6a8e0e3d2e31272b48bd343601ba0c6bd3a91 not found: ID does not exist"
Jul 15 11:06:48.998348 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.998308    2568 scope.go:117] "RemoveContainer" containerID="4463a5beb7f6dea4e60fa35ae528c0e4fa29ce462a37f1111c114dad62d0bdca"
Jul 15 11:06:48.998519 ip-10-0-134-102 kubenswrapper[2568]: E0715 11:06:48.998499    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4463a5beb7f6dea4e60fa35ae528c0e4fa29ce462a37f1111c114dad62d0bdca\": container with ID starting with 4463a5beb7f6dea4e60fa35ae528c0e4fa29ce462a37f1111c114dad62d0bdca not found: ID does not exist" containerID="4463a5beb7f6dea4e60fa35ae528c0e4fa29ce462a37f1111c114dad62d0bdca"
Jul 15 11:06:48.998576 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:48.998528    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4463a5beb7f6dea4e60fa35ae528c0e4fa29ce462a37f1111c114dad62d0bdca"} err="failed to get container status \"4463a5beb7f6dea4e60fa35ae528c0e4fa29ce462a37f1111c114dad62d0bdca\": rpc error: code = NotFound desc = could not find container \"4463a5beb7f6dea4e60fa35ae528c0e4fa29ce462a37f1111c114dad62d0bdca\": container with ID starting with 4463a5beb7f6dea4e60fa35ae528c0e4fa29ce462a37f1111c114dad62d0bdca not found: ID does not exist"
Jul 15 11:06:49.008337 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:49.008105    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"]
Jul 15 11:06:49.013677 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:49.013655    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-ceb9f0-openshift-default-f7f7b49dc-frzmx"]
Jul 15 11:06:49.019360 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:49.019340    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istiod-ca-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:49.019421 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:49.019364    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j992h\" (UniqueName: \"kubernetes.io/projected/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-kube-api-access-j992h\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:49.019421 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:49.019375    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-envoy\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:49.019421 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:49.019383    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-workload-socket\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:49.019421 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:49.019391    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-data\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:49.019421 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:49.019399    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-token\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:49.019421 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:49.019405    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67-istio-podinfo\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\""
Jul 15 11:06:49.647644 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:49.647609    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" path="/var/lib/kubelet/pods/e47dfaf4-2ab2-427d-96dc-62f8dcc70e67/volumes"
Jul 15 11:06:50.250627 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:50.250595    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gnx2f_01d7e671-9d90-4b42-8dbe-4710b0dbaeac/server/0.log"
Jul 15 11:06:50.380264 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:50.380238    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-57fpv_9373b6ed-a7b7-4dc5-a38f-2c67845957a9/manager/0.log"
Jul 15 11:06:50.638997 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:50.638919    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656947bb4-lp8tc_eff584cf-e96b-4235-b839-206180ab4e9f/copy-manifests/0.log"
Jul 15 11:06:50.649132 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:50.649095    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656947bb4-lp8tc_eff584cf-e96b-4235-b839-206180ab4e9f/manager/0.log"
Jul 15 11:06:51.422384 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:51.422357    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735205-jdsrn_9f74ea10-a4d3-4ab5-a950-06ad44e21c8f/cleanup/0.log"
Jul 15 11:06:51.537314 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:51.537281    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735220-wglnn_7dc5cd4b-0662-4dab-a98f-66da17f48386/cleanup/0.log"
Jul 15 11:06:51.648775 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:51.648746    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-5b874627-t66d9_010eaeba-2545-4d73-9c58-25968fbff877/revoke-keys/0.log"
Jul 15 11:06:51.758773 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:51.758744    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-8452aa9e-7gk7m_24b7e037-8848-4f1a-be86-efe2194b129f/revoke-keys/0.log"
Jul 15 11:06:51.867297 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:51.867278    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-205b15-98mfg_74938f49-5211-47fb-bac8-3d8b62a91fc1/revoke-keys/0.log"
Jul 15 11:06:51.987281 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:51.987259    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-25c606-d2hbk_7d6c3a59-6f2f-4799-b7d1-67405f58a186/revoke-keys/0.log"
Jul 15 11:06:52.104621 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:52.104552    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-73e6f609-mz8ld_0195ef77-083b-493f-aa52-c315bc600ed7/revoke-keys/0.log"
Jul 15 11:06:52.455590 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:52.455516    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-2b6d2c8d-8g65q_c47d889c-cbc9-4132-aa51-bbfecbfa7bbf/revoke-keys/0.log"
Jul 15 11:06:52.572055 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:52.572032    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-339d043d-qlj2f_e6911ea7-0200-48ec-a648-ceed799e0bdd/revoke-keys/0.log"
Jul 15 11:06:52.688045 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:52.688023    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-e595ab4b-5wj5k_92289ae2-b24e-4821-8b86-615a0d1a6424/revoke-keys/0.log"
Jul 15 11:06:52.914977 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:52.914953    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-ceb9f0-29ftt_5c0ebfe3-fe94-4beb-baed-7b885bfa38a0/revoke-keys/0.log"
Jul 15 11:06:53.829806 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:53.829775    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6_a33674c4-292d-49e5-a88d-cb1770e8eee2/util/0.log"
Jul 15 11:06:53.840644 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:53.840615    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6_a33674c4-292d-49e5-a88d-cb1770e8eee2/pull/0.log"
Jul 15 11:06:53.860408 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:53.860387    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6_a33674c4-292d-49e5-a88d-cb1770e8eee2/extract/0.log"
Jul 15 11:06:53.977995 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:53.977972    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm_0ae1dc92-2cdb-49e1-82c7-8b1ada016b41/extract/0.log"
Jul 15 11:06:53.997404 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:53.997382    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm_0ae1dc92-2cdb-49e1-82c7-8b1ada016b41/util/0.log"
Jul 15 11:06:54.009617 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:54.009595    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm_0ae1dc92-2cdb-49e1-82c7-8b1ada016b41/pull/0.log"
Jul 15 11:06:54.131397 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:54.131337    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv_c9c96d45-ae54-498f-a174-bb01bcc96a23/util/0.log"
Jul 15 11:06:54.144520 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:54.144498    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv_c9c96d45-ae54-498f-a174-bb01bcc96a23/pull/0.log"
Jul 15 11:06:54.157504 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:54.157481    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv_c9c96d45-ae54-498f-a174-bb01bcc96a23/extract/0.log"
Jul 15 11:06:54.277773 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:54.277750    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh_86d243ec-3643-4e6f-8b0e-b2b2a894c44a/util/0.log"
Jul 15 11:06:54.291843 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:54.291818    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh_86d243ec-3643-4e6f-8b0e-b2b2a894c44a/pull/0.log"
Jul 15 11:06:54.306179 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:54.306161    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh_86d243ec-3643-4e6f-8b0e-b2b2a894c44a/extract/0.log"
Jul 15 11:06:55.154148 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:55.154104    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mxbk2_3c5b720b-ac89-4c77-8de9-b8502dff3223/limitador/0.log"
Jul 15 11:06:55.756155 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:06:55.756129    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-crccp_92996e10-e666-4c5f-bd3b-c4943f2fb7cb/discovery/0.log"
Jul 15 11:07:01.971499 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:01.971463    2568 scope.go:117] "RemoveContainer" containerID="d360a33fece81c556fa27060f4426266921911ec830e0d13cf10606f7f4c6c3d"
Jul 15 11:07:02.945153 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945099    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-68cgz/must-gather-wbc6h"]
Jul 15 11:07:02.945440 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945428    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91b2db29-7f13-4e60-821b-804716355f80" containerName="cleanup"
Jul 15 11:07:02.945486 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945442    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b2db29-7f13-4e60-821b-804716355f80" containerName="cleanup"
Jul 15 11:07:02.945486 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945456    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2415a259-510c-4c3a-bbc2-e9fa37e29780" containerName="istio-proxy"
Jul 15 11:07:02.945486 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945462    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2415a259-510c-4c3a-bbc2-e9fa37e29780" containerName="istio-proxy"
Jul 15 11:07:02.945486 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945470    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2415a259-510c-4c3a-bbc2-e9fa37e29780" containerName="istio-proxy"
Jul 15 11:07:02.945486 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945477    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2415a259-510c-4c3a-bbc2-e9fa37e29780" containerName="istio-proxy"
Jul 15 11:07:02.945486 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945485    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" containerName="istio-proxy"
Jul 15 11:07:02.945674 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945491    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" containerName="istio-proxy"
Jul 15 11:07:02.945674 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945502    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c0ebfe3-fe94-4beb-baed-7b885bfa38a0" containerName="revoke-keys"
Jul 15 11:07:02.945674 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945508    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c0ebfe3-fe94-4beb-baed-7b885bfa38a0" containerName="revoke-keys"
Jul 15 11:07:02.945674 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945560    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2415a259-510c-4c3a-bbc2-e9fa37e29780" containerName="istio-proxy"
Jul 15 11:07:02.945674 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945567    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" containerName="istio-proxy"
Jul 15 11:07:02.945674 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945573    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="91b2db29-7f13-4e60-821b-804716355f80" containerName="cleanup"
Jul 15 11:07:02.945674 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945578    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c0ebfe3-fe94-4beb-baed-7b885bfa38a0" containerName="revoke-keys"
Jul 15 11:07:02.945674 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945586    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" containerName="istio-proxy"
Jul 15 11:07:02.945674 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945638    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" containerName="istio-proxy"
Jul 15 11:07:02.945674 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945643    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e47dfaf4-2ab2-427d-96dc-62f8dcc70e67" containerName="istio-proxy"
Jul 15 11:07:02.945962 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.945692    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2415a259-510c-4c3a-bbc2-e9fa37e29780" containerName="istio-proxy"
Jul 15 11:07:02.950536 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.950514    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-68cgz/must-gather-wbc6h"
Jul 15 11:07:02.953449 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.953433    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-68cgz\"/\"default-dockercfg-8vwgn\""
Jul 15 11:07:02.954446 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.954430    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-68cgz\"/\"openshift-service-ca.crt\""
Jul 15 11:07:02.954516 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.954465    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-68cgz\"/\"kube-root-ca.crt\""
Jul 15 11:07:02.964505 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:02.964478    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-68cgz/must-gather-wbc6h"]
Jul 15 11:07:03.026632 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:03.026591    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8pw5\" (UniqueName: \"kubernetes.io/projected/0289b503-cb93-49bc-aa20-2e258ec49425-kube-api-access-v8pw5\") pod \"must-gather-wbc6h\" (UID: \"0289b503-cb93-49bc-aa20-2e258ec49425\") " pod="openshift-must-gather-68cgz/must-gather-wbc6h"
Jul 15 11:07:03.026632 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:03.026630    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0289b503-cb93-49bc-aa20-2e258ec49425-must-gather-output\") pod \"must-gather-wbc6h\" (UID: \"0289b503-cb93-49bc-aa20-2e258ec49425\") " pod="openshift-must-gather-68cgz/must-gather-wbc6h"
Jul 15 11:07:03.127615 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:03.127577    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8pw5\" (UniqueName: \"kubernetes.io/projected/0289b503-cb93-49bc-aa20-2e258ec49425-kube-api-access-v8pw5\") pod \"must-gather-wbc6h\" (UID: \"0289b503-cb93-49bc-aa20-2e258ec49425\") " pod="openshift-must-gather-68cgz/must-gather-wbc6h"
Jul 15 11:07:03.127615 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:03.127619    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0289b503-cb93-49bc-aa20-2e258ec49425-must-gather-output\") pod \"must-gather-wbc6h\" (UID: \"0289b503-cb93-49bc-aa20-2e258ec49425\") " pod="openshift-must-gather-68cgz/must-gather-wbc6h"
Jul 15 11:07:03.127988 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:03.127970    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0289b503-cb93-49bc-aa20-2e258ec49425-must-gather-output\") pod \"must-gather-wbc6h\" (UID: \"0289b503-cb93-49bc-aa20-2e258ec49425\") " pod="openshift-must-gather-68cgz/must-gather-wbc6h"
Jul 15 11:07:03.138644 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:03.138614    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8pw5\" (UniqueName: \"kubernetes.io/projected/0289b503-cb93-49bc-aa20-2e258ec49425-kube-api-access-v8pw5\") pod \"must-gather-wbc6h\" (UID: \"0289b503-cb93-49bc-aa20-2e258ec49425\") " pod="openshift-must-gather-68cgz/must-gather-wbc6h"
Jul 15 11:07:03.260127 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:03.260075    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-68cgz/must-gather-wbc6h"
Jul 15 11:07:03.402239 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:03.401954    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-68cgz/must-gather-wbc6h"]
Jul 15 11:07:03.405964 ip-10-0-134-102 kubenswrapper[2568]: W0715 11:07:03.405922    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0289b503_cb93_49bc_aa20_2e258ec49425.slice/crio-a70348b0f795e6528a00847f1d28585c0843431923ec407972287386ce70a2ed WatchSource:0}: Error finding container a70348b0f795e6528a00847f1d28585c0843431923ec407972287386ce70a2ed: Status 404 returned error can't find the container with id a70348b0f795e6528a00847f1d28585c0843431923ec407972287386ce70a2ed
Jul 15 11:07:03.407911 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:03.407891    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 11:07:04.072573 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:04.072531    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-68cgz/must-gather-wbc6h" event={"ID":"0289b503-cb93-49bc-aa20-2e258ec49425","Type":"ContainerStarted","Data":"a70348b0f795e6528a00847f1d28585c0843431923ec407972287386ce70a2ed"}
Jul 15 11:07:05.083702 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:05.082866    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-68cgz/must-gather-wbc6h" event={"ID":"0289b503-cb93-49bc-aa20-2e258ec49425","Type":"ContainerStarted","Data":"fbf88295269d7745590f19575600f569fe60285f3f14ebef470f6b23692a4977"}
Jul 15 11:07:05.083702 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:05.082933    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-68cgz/must-gather-wbc6h" event={"ID":"0289b503-cb93-49bc-aa20-2e258ec49425","Type":"ContainerStarted","Data":"2f6c968387eea97159e768383990bab408682b385b855b75ec7ea7d4a1170aa1"}
Jul 15 11:07:05.103609 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:05.103557    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-68cgz/must-gather-wbc6h" podStartSLOduration=2.138557036 podStartE2EDuration="3.103539786s" totalImagesPullingTime="964.98275ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:07:05.102975835 +0000 UTC m=+2823.922617708" watchObservedRunningTime="2026-07-15 11:07:05.103539786 +0000 UTC m=+2823.923181703"
Jul 15 11:07:06.225794 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:06.225761    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5r2sb_141455ed-ae53-465c-8979-db50257b660f/global-pull-secret-syncer/0.log"
Jul 15 11:07:06.432103 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:06.432073    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dwq9h_d2b9d577-b496-4c9f-81d1-888e0bb7af84/konnectivity-agent/0.log"
Jul 15 11:07:06.577434 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:06.577407    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-102.ec2.internal_6fd61ae3c3b82a20bce79ca2b950fe8e/haproxy/0.log"
Jul 15 11:07:11.334359 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:11.334322    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6_a33674c4-292d-49e5-a88d-cb1770e8eee2/extract/0.log"
Jul 15 11:07:11.387371 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:11.387336    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6_a33674c4-292d-49e5-a88d-cb1770e8eee2/util/0.log"
Jul 15 11:07:11.447630 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:11.447603    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q4w6_a33674c4-292d-49e5-a88d-cb1770e8eee2/pull/0.log"
Jul 15 11:07:11.504874 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:11.504849    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm_0ae1dc92-2cdb-49e1-82c7-8b1ada016b41/extract/0.log"
Jul 15 11:07:11.622395 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:11.622314    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm_0ae1dc92-2cdb-49e1-82c7-8b1ada016b41/util/0.log"
Jul 15 11:07:11.667299 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:11.667266    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04vhkm_0ae1dc92-2cdb-49e1-82c7-8b1ada016b41/pull/0.log"
Jul 15 11:07:11.715014 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:11.714984    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv_c9c96d45-ae54-498f-a174-bb01bcc96a23/extract/0.log"
Jul 15 11:07:11.766185 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:11.766043    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv_c9c96d45-ae54-498f-a174-bb01bcc96a23/util/0.log"
Jul 15 11:07:11.802104 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:11.802064    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vnkv_c9c96d45-ae54-498f-a174-bb01bcc96a23/pull/0.log"
Jul 15 11:07:11.844898 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:11.844789    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh_86d243ec-3643-4e6f-8b0e-b2b2a894c44a/extract/0.log"
Jul 15 11:07:11.886560 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:11.886436    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh_86d243ec-3643-4e6f-8b0e-b2b2a894c44a/util/0.log"
Jul 15 11:07:11.928439 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:11.928409    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19d2nh_86d243ec-3643-4e6f-8b0e-b2b2a894c44a/pull/0.log"
Jul 15 11:07:12.573427 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:12.573371    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mxbk2_3c5b720b-ac89-4c77-8de9-b8502dff3223/limitador/0.log"
Jul 15 11:07:14.953568 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:14.953539    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-58cc6c9c45-hqtr4_b449311f-82bb-4d91-ae8f-8010ad6a19b2/metrics-server/0.log"
Jul 15 11:07:14.994868 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:14.994839    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-zthlj_aec4a18c-eb9a-4052-85b5-3837f8667689/monitoring-plugin/0.log"
Jul 15 11:07:15.037191 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:15.037130    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4hfq6_b4cfb5f6-ca86-42d0-9738-dc58e9d64764/node-exporter/0.log"
Jul 15 11:07:15.071554 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:15.071502    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4hfq6_b4cfb5f6-ca86-42d0-9738-dc58e9d64764/kube-rbac-proxy/0.log"
Jul 15 11:07:15.105212 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:15.105183    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4hfq6_b4cfb5f6-ca86-42d0-9738-dc58e9d64764/init-textfile/0.log"
Jul 15 11:07:15.325741 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:15.325707    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-hqzw7_6e55538b-79fc-44d1-9407-df40bcf048e4/kube-rbac-proxy-main/0.log"
Jul 15 11:07:15.354690 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:15.354659    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-hqzw7_6e55538b-79fc-44d1-9407-df40bcf048e4/kube-rbac-proxy-self/0.log"
Jul 15 11:07:15.386633 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:15.386602    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-hqzw7_6e55538b-79fc-44d1-9407-df40bcf048e4/openshift-state-metrics/0.log"
Jul 15 11:07:15.723455 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:15.723350    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-n89h2_2bcd61b6-e659-4167-9b2d-2c55a5c6170e/prometheus-operator-admission-webhook/0.log"
Jul 15 11:07:15.862360 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:15.862319    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"]
Jul 15 11:07:15.868521 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:15.868493    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:15.879126 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:15.879083    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"]
Jul 15 11:07:15.958591 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:15.958559    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6be5ab29-3d54-443f-a622-178a6f863b00-podres\") pod \"perf-node-gather-daemonset-84lvf\" (UID: \"6be5ab29-3d54-443f-a622-178a6f863b00\") " pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:15.958591 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:15.958597    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmzw5\" (UniqueName: \"kubernetes.io/projected/6be5ab29-3d54-443f-a622-178a6f863b00-kube-api-access-cmzw5\") pod \"perf-node-gather-daemonset-84lvf\" (UID: \"6be5ab29-3d54-443f-a622-178a6f863b00\") " pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:15.959154 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:15.958625    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6be5ab29-3d54-443f-a622-178a6f863b00-sys\") pod \"perf-node-gather-daemonset-84lvf\" (UID: \"6be5ab29-3d54-443f-a622-178a6f863b00\") " pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:15.959154 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:15.958713    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6be5ab29-3d54-443f-a622-178a6f863b00-proc\") pod \"perf-node-gather-daemonset-84lvf\" (UID: \"6be5ab29-3d54-443f-a622-178a6f863b00\") " pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:15.959154 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:15.958752    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6be5ab29-3d54-443f-a622-178a6f863b00-lib-modules\") pod \"perf-node-gather-daemonset-84lvf\" (UID: \"6be5ab29-3d54-443f-a622-178a6f863b00\") " pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:16.059612 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:16.059568    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6be5ab29-3d54-443f-a622-178a6f863b00-podres\") pod \"perf-node-gather-daemonset-84lvf\" (UID: \"6be5ab29-3d54-443f-a622-178a6f863b00\") " pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:16.059805 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:16.059629    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmzw5\" (UniqueName: \"kubernetes.io/projected/6be5ab29-3d54-443f-a622-178a6f863b00-kube-api-access-cmzw5\") pod \"perf-node-gather-daemonset-84lvf\" (UID: \"6be5ab29-3d54-443f-a622-178a6f863b00\") " pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:16.059805 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:16.059671    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6be5ab29-3d54-443f-a622-178a6f863b00-sys\") pod \"perf-node-gather-daemonset-84lvf\" (UID: \"6be5ab29-3d54-443f-a622-178a6f863b00\") " pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:16.059805 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:16.059713    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6be5ab29-3d54-443f-a622-178a6f863b00-proc\") pod \"perf-node-gather-daemonset-84lvf\" (UID: \"6be5ab29-3d54-443f-a622-178a6f863b00\") " pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:16.059805 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:16.059760    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6be5ab29-3d54-443f-a622-178a6f863b00-lib-modules\") pod \"perf-node-gather-daemonset-84lvf\" (UID: \"6be5ab29-3d54-443f-a622-178a6f863b00\") " pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:16.059805 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:16.059769    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6be5ab29-3d54-443f-a622-178a6f863b00-podres\") pod \"perf-node-gather-daemonset-84lvf\" (UID: \"6be5ab29-3d54-443f-a622-178a6f863b00\") " pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:16.060025 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:16.059891    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6be5ab29-3d54-443f-a622-178a6f863b00-sys\") pod \"perf-node-gather-daemonset-84lvf\" (UID: \"6be5ab29-3d54-443f-a622-178a6f863b00\") " pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:16.060025 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:16.059905    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6be5ab29-3d54-443f-a622-178a6f863b00-lib-modules\") pod \"perf-node-gather-daemonset-84lvf\" (UID: \"6be5ab29-3d54-443f-a622-178a6f863b00\") " pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:16.060025 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:16.059959    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6be5ab29-3d54-443f-a622-178a6f863b00-proc\") pod \"perf-node-gather-daemonset-84lvf\" (UID: \"6be5ab29-3d54-443f-a622-178a6f863b00\") " pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:16.071648 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:16.071587    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmzw5\" (UniqueName: \"kubernetes.io/projected/6be5ab29-3d54-443f-a622-178a6f863b00-kube-api-access-cmzw5\") pod \"perf-node-gather-daemonset-84lvf\" (UID: \"6be5ab29-3d54-443f-a622-178a6f863b00\") " pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:16.180535 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:16.180499    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:16.360090 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:16.360042    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"]
Jul 15 11:07:16.360324 ip-10-0-134-102 kubenswrapper[2568]: W0715 11:07:16.360127    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6be5ab29_3d54_443f_a622_178a6f863b00.slice/crio-df92d24f69a278325bc94242e74c730a666f62779d11e3cc632d71e358237587 WatchSource:0}: Error finding container df92d24f69a278325bc94242e74c730a666f62779d11e3cc632d71e358237587: Status 404 returned error can't find the container with id df92d24f69a278325bc94242e74c730a666f62779d11e3cc632d71e358237587
Jul 15 11:07:17.183738 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:17.183679    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf" event={"ID":"6be5ab29-3d54-443f-a622-178a6f863b00","Type":"ContainerStarted","Data":"79cbd682e0afe6dbff7e970263c31e5ec093ea8091f8616e7e7dc37a69d18dbe"}
Jul 15 11:07:17.184265 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:17.183755    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf" event={"ID":"6be5ab29-3d54-443f-a622-178a6f863b00","Type":"ContainerStarted","Data":"df92d24f69a278325bc94242e74c730a666f62779d11e3cc632d71e358237587"}
Jul 15 11:07:17.184482 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:17.184464    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:17.210136 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:17.207008    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf" podStartSLOduration=2.206992803 podStartE2EDuration="2.206992803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 11:07:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:07:17.205681083 +0000 UTC m=+2836.025322957" watchObservedRunningTime="2026-07-15 11:07:17.206992803 +0000 UTC m=+2836.026634677"
Jul 15 11:07:18.300377 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:18.300348    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-msktx_24646643-3ded-4ec7-bb42-ea442c25dc7a/download-server/0.log"
Jul 15 11:07:20.049525 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:20.049486    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7rhhh_40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6/dns/0.log"
Jul 15 11:07:20.079266 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:20.079240    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7rhhh_40d1bebd-b7ed-4f6a-a2e9-31dafdb0aff6/kube-rbac-proxy/0.log"
Jul 15 11:07:20.287281 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:20.287250    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xlk4p_793964cf-e10f-455e-ade5-5724240979d1/dns-node-resolver/0.log"
Jul 15 11:07:20.875242 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:20.875205    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-554ff97b4d-q2v5t_ff9accb2-9d0c-4388-9c5a-130130b39c0e/registry/0.log"
Jul 15 11:07:20.930692 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:20.930655    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n7pj6_04d03060-07a3-4ce5-a041-d56a227e615c/node-ca/0.log"
Jul 15 11:07:22.144904 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:22.144873    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-crccp_92996e10-e666-4c5f-bd3b-c4943f2fb7cb/discovery/0.log"
Jul 15 11:07:23.178468 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:23.178438    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6xzcz_2e06b4d6-70ef-41f0-b4c7-70523622703a/serve-healthcheck-canary/0.log"
Jul 15 11:07:23.848962 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:23.848897    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k8c9s_8e5304fd-c68b-43fe-8f79-049af23c39d6/kube-rbac-proxy/0.log"
Jul 15 11:07:23.882454 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:23.882425    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k8c9s_8e5304fd-c68b-43fe-8f79-049af23c39d6/exporter/0.log"
Jul 15 11:07:23.922583 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:23.922542    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k8c9s_8e5304fd-c68b-43fe-8f79-049af23c39d6/extractor/0.log"
Jul 15 11:07:24.210575 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:24.210497    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-68cgz/perf-node-gather-daemonset-84lvf"
Jul 15 11:07:26.268591 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:26.268556    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-crccp_92996e10-e666-4c5f-bd3b-c4943f2fb7cb/discovery/0.log"
Jul 15 11:07:26.758890 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:26.758457    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gnx2f_01d7e671-9d90-4b42-8dbe-4710b0dbaeac/server/0.log"
Jul 15 11:07:26.853180 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:26.853145    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-57fpv_9373b6ed-a7b7-4dc5-a38f-2c67845957a9/manager/0.log"
Jul 15 11:07:26.940266 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:26.940237    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656947bb4-lp8tc_eff584cf-e96b-4235-b839-206180ab4e9f/manager/0.log"
Jul 15 11:07:26.969011 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:26.968985    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656947bb4-lp8tc_eff584cf-e96b-4235-b839-206180ab4e9f/copy-manifests/0.log"
Jul 15 11:07:27.837000 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:27.836968    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-crccp_92996e10-e666-4c5f-bd3b-c4943f2fb7cb/discovery/0.log"
Jul 15 11:07:28.469318 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:28.469284    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-587d8d67f-s5tb7_06220b24-e647-4843-8e15-5c208c06efdd/manager/0.log"
Jul 15 11:07:33.428204 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:33.428173    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-rs65s_f33a2eac-6ada-48c8-8a3e-3a97437eb596/migrator/0.log"
Jul 15 11:07:33.463707 ip-10-0-134-102 kubenswrapper[2568]: I0715 11:07:33.463674    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-rs65s_f33a2eac-6ada-48c8-8a3e-3a97437eb596/graceful-termination/0.log"